One niche application which impressed me was the use of the TILE-Gx in Mikrotik's CCR routers. I used one for a good few years and you really got a lot of performance (provided your setup was suitably parallelizable) for very little outlay and a tiny power expenditure.

Nvidia bought the architecture and killed it, which kind of proves your point.