News for hackers. Stuff that matters.
Re:TimeCapsuleLLM: LLM trained only on data from 1800-1875 by armcat on Monday January 12, 2026 @11:56AM (#46591107)
I think this would be an awesome experiment. However you would effectively need to train something of a GPT-5.2 equivalent. So you need lot of text, a much larger parameterization (compared to nanoGPT and Phi-1.5), and the 1800s equivalents of supervised finetuning and reinforcement learning with human feedback.

There are no comments on this comment yet.