Sweden ruled over Finland for 500+ years and the Finnish language still survived. I guess the same could be said for the Norman ruling class in Britain where the court spoke French and the people English. I think it is mostly about what language is used in what setting and how common it is that people switch back and forth between these settings.