In a few cases, we need the inverse operation of what is doable with the TypeVariableBindings results. We currently sort of reverse the map every time but it's counter productive.

Apart from that, we could probably cache the results of TypeVariableBindings.