[ https://issues.jboss.org/browse/JBDS-1668?page=com.atlassian.jira.plugin.... ] Work on JBDS-1668 started by Nick Boldt. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[ https://issues.jboss.org/browse/JBDS-1668?page=com.atlassian.jira.plugin.... ] Nick Boldt commented on JBDS-1668: ---------------------------------- See also https://docspace.corp.redhat.com/message/24270#24270 (VPN required) -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[ https://issues.jboss.org/browse/JBDS-1668?page=com.atlassian.jira.plugin.... ] Martin Malina commented on JBDS-1668: ------------------------------------- I've had a ticket with helpdesk to add a DNS record for machydra.brq.redhat.com. The ticket has been closed, but unfortunately it still doesn't work. I reopened the ticket and will let you know once it's fixed. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[ https://issues.jboss.org/browse/JBDS-1668?page=com.atlassian.jira.plugin.... ] Martin Malina commented on JBDS-1668: ------------------------------------- The DNS entry has been finally updated so the Mac Pro is now available here: machydra.brq.redhat.com (10.34.26.59) Nick, please update the hostname wherever you use it, thanks. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[ https://issues.jboss.org/browse/JBDS-1668?page=com.atlassian.jira.plugin.... ] Martin Malina commented on JBDS-1668: ------------------------------------- I talked to Tomas Herfert today and apparently this will never work - we will not get a permission to push data from BOS lab to machydra. So why not use globalsync for this? https://docspace.corp.redhat.com/thread/6857?start=0&tstart=0 -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[ https://issues.jboss.org/browse/JBDS-1668?page=com.atlassian.jira.plugin.... ] Libor Zoubek commented on JBDS-1668: ------------------------------------ globalsync is afaik only set of rsync scripts under control of eng-ops. Currenly we are waiting for eng-ops to set it up for us. Then we will get exact folder, where to push the bits and then we can set it up on hudson slaves and in machydra -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[ https://issues.jboss.org/browse/JBDS-1668?page=com.atlassian.jira.plugin.... ] Nick Boldt edited comment on JBDS-1668 at 5/30/11 10:09 PM: ------------------------------------------------------------ Have got mirroring using wget pull running every 3 hrs for all files except index.html*, which are purged every other minute as they're created by the recursive wget mirroring operation. Here's the crontab: {code} 05 0,3,6,09,12,15,18,21 * * * /opt/sync/download.jboss.org.sh 25 1,4,7,10,13,16,19,22 * * * /opt/sync/devstudio.jboss.com.sh 45 2,5,8,11,14,17,20,23 * * * /opt/sync/www.qa.jboss.com.sh */2 * * * * find /Volumes/Argolid4/XAMPP/htdocs/ -name "index.html*" -exec rm -fr {} \; {code} Scripts are here: http://svn.jboss.org/repos/devstudio/trunk/releng/machydra.brq.redhat.com... If there's anything else you want mirrored, let me know (or edit those scripts and commit the changes, then I can pull them out into /opt/sync/ to incorporate your additional sync rules. If you have nothing else to mirror, then we can simply close this JIRA. (You might want to look at mirroring things like http://www.qa.jboss.com/binaries/RHDS/builds/staging/, but we'll need a cleanup script like this [1] too to purge old things or else we'll run out of space over time.) [1] https://svn.jboss.org/repos/devstudio/trunk/releng/org.jboss.ide.eclipse.... was (Author: nickboldt): Have got mirroring using wget pull running every 3 hrs for all files except index.html*, which are purged every other minute as they're created by the recursive wget mirroring operation. Here's the crontab: {code} 05 0,3,6,09,12,15,18,21 * * * /opt/sync/download.jboss.org.sh 25 1,4,7,10,13,16,19,22 * * * /opt/sync/devstudio.jboss.com.sh 45 2,5,8,11,14,17,20,23 * * * /opt/sync/www.qa.jboss.com.sh */2 * * * * find /Volumes/Argolid4/XAMPP/htdocs/ -name "index.html*" -exec rm -fr {} \; {code} Scripts are here: http://svn.jboss.org/repos/devstudio/trunk/releng/machydra.brq.redhat.com... If there's anything else you want mirrored, let me know (or edit those scripts and commit the changes, then I can pull them out into /opt/sync/ to incorporate your additional sync rules. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[ https://issues.jboss.org/browse/JBDS-1668?page=com.atlassian.jira.plugin.... ] Libor Zoubek commented on JBDS-1668: ------------------------------------ I've done client script, you can check it /Users/lzoubek/http-sync. The only think it needs is to generate index file on server that is being mirrored. This could be done by {noformat} find /somewhere -type f -exec md5sum {} \; | sed 's;/somewhere/;;' > contents.txt {noformat} It supposed to run on linux machine. Note that above script falls back to wget -m if it does not find index file. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[ https://issues.jboss.org/browse/JBDS-1668?page=com.atlassian.jira.plugin.... ] Nick Boldt commented on JBDS-1668: ---------------------------------- well, we don't have to wget the root of the server - could wget a subset so it'd go faster. Not everything changes daily - perhaps only the published update sites in updates/nightly/ would be worth synching? Also, I agree - rsync solution would be MUCH better... but we can't do that yet. Any progress on globalsync? -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[ https://issues.jboss.org/browse/JBDS-1668?page=com.atlassian.jira.plugin.... ] Nick Boldt commented on JBDS-1668: ---------------------------------- Could still do the full pull weekly, with updates/nightly/ being pulled, well, nightly. :) Let me know if you need help w/ tweaking the wget scripts to better pull only what's needed. Otherwise I'll assume you have all the tools in place (minus globalsync) to performance tune this setup to best meet your needs. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[ https://issues.jboss.org/browse/JBDS-1668?page=com.atlassian.jira.plugin.... ] Libor Zoubek commented on JBDS-1668: ------------------------------------ Nick, what is the difference between bits on www.qa.jboss.com/binaries/RHDS/updates and download.jboss.org/jbosstools/updates ? -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[ https://issues.jboss.org/browse/JBDS-1668?page=com.atlassian.jira.plugin.... ] Libor Zoubek resolved JBDS-1668. -------------------------------- Resolution: Done -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira