Re:Trained LLMs exclusively on pre-1913 texts
by nemomarx on Thursday December 18, 2025 @07:44PM
(#46320915)
I wonder if the historical format you might want to look at for "Chat" is letters? Definitely wordier segments, but it's at least the back and forth feel and we often have complete correspondence over long stretches from certain figures.
This would probably get easier towards the start of the 20th century ofc
Re:Trained LLMs exclusively on pre-1913 texts
by libraryofbabel on Thursday December 18, 2025 @07:48PM
(#46320948)
Good point, informal letters might actually be a better source - AI chat is (usually) a written rather than spoken interaction after all! And we do have a lot transcribed collections of letters to train on, although they’re mostly from people who were famous or became famous, which certainly introduces some bias.
Re:Trained LLMs exclusively on pre-1913 texts
by pigpop on Friday December 19, 2025 @03:31PM
(#46330547)
The question then would be whether to train it to respond to short prompts with longer correspondence style "letters" or to leave it up to the user to write a proper letter as a prompt. Now that would be amusing
Dear Hon. Historical LLM
I hope this letter finds you well. It is with no small urgency that I write to you seeking assistance, believing such an erudite and learned fellow as yourself should be the best one to furnish me with an answer to such a vexing question as this which I now pose to you. Pray tell, what is the capital of France?
Re:Trained LLMs exclusively on pre-1913 texts
by dleeftink on Thursday December 18, 2025 @07:21PM
(#46320761)
While not specifically Victorian, couldn't we learn much from what daily conversations were like by looking at surviving oral cultures, or other relatively secluded communal pockets? I'd also say time and progress are not always equally distributed, and even within geographical regions (as the U.K.) there are likely large differences in the rate of language shifts since then, some possibly surviving well into the 20th century.
Re:Trained LLMs exclusively on pre-1913 texts
by bryancoxwell on Thursday December 18, 2025 @09:11PM
(#46321543)
Fascinating, thanks for sharing
Re:Trained LLMs exclusively on pre-1913 texts
by NooneAtAll3 on Friday December 19, 2025 @02:41AM
(#46323248)
don't we have parlament transcripts? I remember something about Germany (or maybe even Prussia) developing fast script to preserve 1-to-1 what was said
Re:Trained LLMs exclusively on pre-1913 texts
by libraryofbabel on Friday December 19, 2025 @12:57PM
(#46328790)
I mentioned those in the post you’re replying to :)
It’s a better source for how people spoke than books etc, but it’s not really an accurate source for patterns of everyday conversation because people were making speeches rather than chatting.
Re:Trained LLMs exclusively on pre-1913 texts
by DGoettlich on Friday December 19, 2025 @07:58PM
(#46332777)
very interesting observation!
To go a little deeper on the idea of 19th-century "chat": I did a PhD on this period and yet I would be hard-pushed to tell you what actual 19th-century conversations were like. There are plenty of literary depictions of conversation from the 19th century of presumably varying levels of accuracy, but we don't really have great direct historical sources of everyday human conversations until sound recording technology got good in the 20th century. Even good 19th-century transcripts of actual human speech tend to be from formal things like court testimony or parliamentary speeches, not everyday interactions. The vast majority of human communication in the premodern past was the spoken word, and it's almost all invisible in the historical sources.
Anyway, this is a really interesting project, and I'm looking forward to trying the models out myself!