Remember, the majority of French people don't think that speaking English is rude. They are simply more comfortable speaking French with you. Try asking some simple questions in French to break the ice. Once they see you are attempting to speak French, they may feel more comfortable using English with you.