Remember an easy workaround is to use the MassIndexer to rebuild it all.
Would that still not leave the old index around. After all this index is not backed anymore by an entity. How would the mass indexer delete it?