dval
Re:Inference business simulator – don't go broke, rent GPUs, serve tokens
on Friday November 06, 2026 @03:58PM (#50398431)
Most labs should be doing RSI but it's only now starting to come out.
Your question about keeping page with other black boxes that are also doing RSI is very profound. The good thing is that as AI gets better, it's more and more able to deal with black boxes. The hard thing (putting on my physicist hat!) is that I am not familiar with equilibrium models that work well yet for such "turtles all the way" problems. It's a very exciting time!
Re:Inference business simulator – don't go broke, rent GPUs, serve tokens
on Friday November 06, 2026 @03:55PM (#50398392)
Elise is pretty stable, but is under development in terms of continuously extending her capabilities. Luckily the recursive self-improvement helps a lot. One of the most interesting part right now is the human <> AI multi-agent interaction!
Re:Inference business simulator – don't go broke, rent GPUs, serve tokens
on Thursday November 05, 2026 @05:00PM (#50385088)
Hi HN, we made a game out of the fast-growing inference business. See if you can run the most profitable inference business in this market, or at least not go bankrupt.
You start with $10k and no GPUs. You rent GPUs, pick which open-weights models to serve on which of them, guess where the market is going, and take over the world, er, market share. Spare GPUs go to Elise, our research agent, who finds speedups for the engine that you then install. Your score is the capital you end the year with.
We made it because the job of Elise, one of our research agent, is tuning inference engines like vLLM on AMD and NVIDIA GPUs, and it's a lot more fun to explain that to friends and family with a game than with our report: https://makermaker.ai/breakthroughs/inference/ (the code and baselines are there if you want the long version).
The game is open source https://github.com/MakerMakerMakerMakerMaker/Inference-Machi.... Bug reports welcome there, or run your own copy.
Re:Ask HN: Who is hiring? (September 2021)
on Thursday September 02, 2021 @10:11AM (#28392219)
MIT Quest for Intelligence | Cambridge, MA | Full-time | https://quest.mit.edu/job-opportunities
We looking for an Engineering Team Lead! Want to lead a team building and maintaining computational platforms designed to benchmark cutting edge models of natural intelligence? The Engineering Team Lead will work closely with various faculty and research engaged in Quest research missions , guiding the engineering team to rapidly develop, iterate, and deploy solutions. There is potential for a partial remote work schedule. More info and application at the link here: https://careers.peopleclick.com/careerscp/client_mit/externa...