potatoboiler

This assumes a level of institutional control that is nearly impossible (even now). Even if hardware is prohibitively expensive now, I can't imagine training compute will remain that way for long.

I wonder if the JIT model prevents predictable benchmarking/optimization, making long-term robustness difficult? It might also make using MPI difficult. But this is mostly speculation on my part.

I have been wondering the same thing; scouring Wellfound seems to yield little of interest, for example.

As a current undergraduate, programming for fun is ubiquitous in my peers. Surprises me also that the author has to ask.