Resolved by supporting a new bundle ContributorValidationMessages which will be aggregated from all files of that name found on the classpath.