There is no way how users can configure custom policies in SwitchYard editor (Design mode). They need to open switchyard.xml in text editor and specify them manually.

Once users implement new custom policy, they should be able to assign them to either component service or component implementation bean. SwitchYard editor contains ability to configure transaction and security policies atm. so we could add new tab 'Custom policies' where user can specify which custom policy to use (editor would need to detect classes which are implementing Policy interface).

https://bugzilla.redhat.com/show_bug.cgi?id=1012385