The rule is the same if France though. Water is drinkable by default and will be signed "eau non potable" if it isn't (and even then it usually means it's never tested, not that it's unsafe).