Based on David Martin remarks [1] and previous conversation with John Frizelle, we should add at least some tests that would be run against vanila Kubernetes, instead of openshift.

[1] "interesting topic which came up when chatting with darahayes this morning was how we want to target kuberentes where possible (for community), but we test everything on openshift. Probably not something to act on wrt testing at this time, but just thought it interesting"