If it's updated by someone who's whitelisted (member of JBoss Tools organization on GitHub), then yes, it should be relaunched automatically. If it's from someone external, I believe someone has to say "testPR" to relaunch.Did it get relaunched when the PR is updated ?