It's like the "curse of oil". If you have too much of a natural resource, your economy is very unlikely to create a healthy mix of industries. The high-margin resource crowds out investment in other activities.
For example, the textile industry was quickly wiped out in just a handful of years, recently (about 10 years ago).
Industry represents only 10% of French GDP. For neighbouring countries, it is 12% in Spain, 14% in Italy (that's the average in EU) and... 20% in Germany!
That's the country of Alcatel, the company that decided to become "a company with no factory" 15 years ago. It's like an exceptional moment worth a celebration when you discover a "Made in France" behind a product.
Which in turn is built around the cultural identity of the 20 somethings who move into this area to try to make their way in the world.
One is certainly the presence of malls and big box stores nearby. I live within walking distance of several groceries and bakeries but I mainly shop at Costco, because of the insane convenience of getting 90% of what I need at one place, with parking, that also happens to be very inexpensive.
Another is tourism. In tourist towns (Albi is one, apparently), there's a tipping-point where shops can make more money selling bottled water and tchotchkes to tourists than they could selling staples to locals, and once you pass that point things go downhill fast.
Lastly, jobs. If Albi is like many small cities in the US, the jobs are simply elsewhere.