Yes, under conditions. Mainly: stable residency, plus legal immigration papers.

Legal immigration is pretty low in France (compared to other European countries for instance), but what you mention IS a source of tensions, and the bread of extreme right parties.