The wildfly-provisioning plugin is being called in the compile phase, in particular, and some other plugins are being called a bit late. As a result, generating test files from IDEA is close to impossible (IDEA doesn't handle the pre-integration-test phase when generating test resources, for instance).