Your US taxes should be close to nothing, and filling your french taxes can be done in anything from 2 minutes to a couple hours, depending on how large/complicated your savings are. The only burden there is is with the US asking you to fill in taxes when there's nothing to pay.

I agree that coming without planning to learn a bit of french might be a burden.