Noticed this with push and metrics provisioned. I've created bindings for both, then deleted the one for metrics. Service configuration for push disappeared.