Trained LLMs exclusively on pre-1913 texts

Re:Trained LLMs exclusively on pre-1913 texts by Aerolfos on Friday December 19, 2025 @06:37AM (#46324688)

> https://github.com/DGoettlich/history-llms/blob/main/ranke-4...

Given the training notes, it seems like you can't get the performance they give examples of?

I'm not sure about the exact details but there is some kind of targetted distillation of GPT-5 involved to try and get more conversational text and better performance. Which seems a bit iffy to me.

[ Parent | on HN ]

Re:Trained LLMs exclusively on pre-1913 texts by DGoettlich on Friday December 19, 2025 @06:04PM (#46331992)

Thanks for the comment. Could you elaborate on what you find iffy about our approach? I'm sure we can improve!

[ Parent | on HN ]

Re:Trained LLMs exclusively on pre-1913 texts by Aerolfos on Monday December 22, 2025 @04:28AM (#46352542)

Well, it would be nice to see examples (or weights to be completely open) for the baseline model, without any GPT-5 influence whatsoever. Basically let people see what the "raw" output from historical texts is like, and for that matter actively demonstrating why the extra tweaks and layers are needed to make a useful model. Show, don't tell, really.

[ Parent | on HN ]