News for hackers. Stuff that matters.

A comment on TimeCapsuleLLM: LLM trained only on data from 1800-1875. Parent comment

Re:TimeCapsuleLLM: LLM trained only on data from 1800-1875 by dogma1138 on Monday January 12, 2026 @11:36AM (#46590800)
Ofc they are because their primary goal is to be useful and to be useful they need to always be relevant.

But considering that Special Relativity was published in 1905 which means all its building blocks were already floating in the ether by 1900 it would be a very interesting experiment to train something on Claude/Gemini scale and then say give in the field equations and ask it to build a theory around them.

[ Parent | on HN ]
Re:TimeCapsuleLLM: LLM trained only on data from 1800-1875 by famouswaffles on Monday January 12, 2026 @11:43AM (#46590920)
His point is that we can't train a Gemini 3/Claude 4.5 etc model because we don't have the data to match the training scale of those models. There aren't trillions of tokens of digitized pre-1900s text.
[ Parent | on HN ]
Re:TimeCapsuleLLM: LLM trained only on data from 1800-1875 by p1esk on Monday January 12, 2026 @11:42AM (#46590893)
How can you train a Claude/Gemini scale model if you’re limited to <10% of the training data?
[ Parent | on HN ]