I tried this this command in an "Execute Shell" build step:
mkdir -p target/surefire-reports/
touch target/surefire-reports/TEST-dummy.xml
And it works well. Builds moves from Red to Orange.
I think we could use it and get rid of the collect.test.results task
and of the new build.xml.