Re:TimeCapsuleLLM: LLM trained only on data from 1800-1875
by armcat on Monday January 12, 2026 @11:56AM
(#46591107)
I think this would be an awesome experiment. However you would effectively need to train something of a GPT-5.2 equivalent. So you need lot of text, a much larger parameterization (compared to nanoGPT and Phi-1.5), and the 1800s equivalents of supervised finetuning and reinforcement learning with human feedback.
[ Parent
| on HN ]
There are no comments on this comment yet.