French here in the process of buying a house in Isère.

The cheapest regions in France are probably in the center, in Seine et Loire I saw many offers for very cheap houses.

Be careful about buying medieval ruins: they can be cheap but they come with a VERY heavy regulatory framework. You have almost no freedom in how you will rebuild something that is classified as a historical monument and the cost of work and maintenance will be several times the buying cost there.