The important thing to understand about de Gaulle, is that no one outside of France actually liked de Gaulle. There's a reason that the US was seriously leaning towards using Darlan as a replacement leader for the Free French until a Gaullist assassinated him. The British were more sympathetic, but even they had basically decided that he was an arrogant blowhard after the Dakar debacle, useful for the occasional propaganda broadcast but otherwise a massive pain. And the Soviets obviously preferred their own Communist resistance movements, which were plentiful throughout France.