That's not necessary. The landlord needs a bank account number, and some might ( of course, entirely depending on the person) accept a foreign one + the explanation that you're in the process of creating a French one. I've done it and know people who have done it, but of course it limits your options, especially in high in demand cities like Paris.

And there are always the neobanks - IIRC Aumax and Boursorama didn't ask for "justificatif de domicile" ( a utility bill or similar).

And there's another trick, you can get a phone contract online, with only a credit card; and this will get you a bill with any address you choose, but that's gaming the system.