[jbosstools-issues] [JBoss JIRA] Issue Comment Edited: (JBDS-1668) set up rsync to Brno MacPro server

[Nick Boldt (JIRA)]

    [ https://issues.jboss.org/browse/JBDS-1668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12605369#comment-12605369 ] 

Nick Boldt edited comment on JBDS-1668 at 5/30/11 10:09 PM:
------------------------------------------------------------

Have got mirroring using wget pull running every 3 hrs for all files except index.html*, which are purged every other minute as they're created by the recursive wget mirroring operation.

Here's the crontab:

{code}
05 0,3,6,09,12,15,18,21 * * * /opt/sync/download.jboss.org.sh
25 1,4,7,10,13,16,19,22 * * * /opt/sync/devstudio.jboss.com.sh
45 2,5,8,11,14,17,20,23 * * * /opt/sync/www.qa.jboss.com.sh
*/2 * * * * find /Volumes/Argolid4/XAMPP/htdocs/ -name "index.html*" -exec rm -fr {} \;
{code}

Scripts are here: 

http://svn.jboss.org/repos/devstudio/trunk/releng/machydra.brq.redhat.com/OSX/opt/sync/

If there's anything else you want mirrored, let me know (or edit those scripts and commit the changes, then I can pull them out into /opt/sync/ to incorporate your additional sync rules.

If you have nothing else to mirror, then we can simply close this JIRA.

(You might want to look at mirroring things like http://www.qa.jboss.com/binaries/RHDS/builds/staging/, but we'll need a cleanup script like this [1] too to purge old things or else we'll run out of space over time.)

[1] https://svn.jboss.org/repos/devstudio/trunk/releng/org.jboss.ide.eclipse.releng/hudson/cleanup/devstudio-product-cleanup.sh

      was (Author: nickboldt):
    Have got mirroring using wget pull running every 3 hrs for all files except index.html*, which are purged every other minute as they're created by the recursive wget mirroring operation.

Here's the crontab:

{code}
05 0,3,6,09,12,15,18,21 * * * /opt/sync/download.jboss.org.sh
25 1,4,7,10,13,16,19,22 * * * /opt/sync/devstudio.jboss.com.sh
45 2,5,8,11,14,17,20,23 * * * /opt/sync/www.qa.jboss.com.sh
*/2 * * * * find /Volumes/Argolid4/XAMPP/htdocs/ -name "index.html*" -exec rm -fr {} \;
{code}

Scripts are here: 

http://svn.jboss.org/repos/devstudio/trunk/releng/machydra.brq.redhat.com/OSX/opt/sync/

If there's anything else you want mirrored, let me know (or edit those scripts and commit the changes, then I can pull them out into /opt/sync/ to incorporate your additional sync rules.


  
> set up rsync to Brno MacPro server
> ----------------------------------
>
>                 Key: JBDS-1668
>                 URL: https://issues.jboss.org/browse/JBDS-1668
>             Project: Developer Studio (JBoss Developer Studio)
>          Issue Type: Bug
>          Components: servers
>    Affects Versions: 4.1.0.M1, 5.0.0.M2
>            Reporter: Nick Boldt
>            Assignee: Martin Malina
>             Fix For: 4.1.0.GA, 5.0.0.GA
>
>
> Need to establish rules for synching these servers onto MacPro.
> devstudio.jboss.com
> download.jboss.org
> www.qa.jboss.com
> I've set up ssh access from home -> machydra, and have Hudson and Apache running here:
> http://dhcp-1-156.brq.redhat.com/ (Apache)
> http://dhcp-1-156.brq.redhat.com:8080/ (Hudson)
> Apache home dir is mounted on /Volumes/Argolid4 so it's got lots of room to grow.
> I've started crontab & scripts for rsync, but it appears to not be connecting out. 
> See: /opt/rsync/*.sh and `crontab -e` to view crontab config.
> --
> Ideally, we could set up a Hudson job like this one (https://hudson.qa.jboss.com/hudson/view/DevStudio/view/DevStudio_All/job/devstudio-minsk-upload-nightly/configure) to push bits to the new server over ssh.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira