News for hackers. Stuff that matters.
Re:Short Message Compression Using LLMs by duskwuff on Monday December 30, 2024 @02:42PM (#42552687)
Comes up as a minor plot point in Vernor Vinge's The Blabber (1988):

> “And from your standpoint, Hamid, there’s one big drawback. The mean bandwidth of this thing [an ansible, more or less] is just under six bits per minute.”

> “Huh? Ten seconds to send a single bit?”

> “Yup. Skandr left three protocols at the Lothlrimarre end: ASCII, a Hamming map to a subset of English, and an AI scheme that guesses what you’d say if you used more bits. The first is Skandr’s idea of a joke, and I wouldn’t trust the third more than wishful thinking.”

(Good advice at the end there.)

Re:Short Message Compression Using LLMs by dekhn on Monday December 30, 2024 @05:18PM (#42554159)
A bit of an aside- in one of the sequels to A Fire Upon the Deep, somebody has to interpret some very lossy audio and video into the most likely explanation, but they are stuck with a stupider than usual AI and it misinterprets the results (it's implied if they had their full AI it would have gotten the interpretation correct even with the ambiguity). This episode in the book completely changed how I think about imputation under uncertainty. Often, I don't want a single high confidence prediction, I want a probability distribution of the most likely predictions, rank ordered.
Re:Short Message Compression Using LLMs by wat10000 on Monday December 30, 2024 @05:44PM (#42554379)
Fire has evocations, which are videos compressed down to something like just a description, then rendered at the receiving end in a way that hopefully has some resemblance to the original.

One viewer stumbles onto a key insight about the struggle taking place, but they only have evocations so they’re not sure. And they sound like a total kook so everyone ignores them.

Re:Short Message Compression Using LLMs by dekhn on Monday December 30, 2024 @06:46PM (#42554893)
I can't find an exact reference and I don't want to spoil too much, I think this was in Children of the Sky, at some point one of the wolf creatures is imprisoned and somebody uses the ship's reduced AI to spy on them.
Re:Short Message Compression Using LLMs by abecedarius on Monday December 30, 2024 @10:07PM (#42556028)
Slight correction: the person with the spy system didn't believe its reports in the end -- the doubt/dismissal problem came before sharing with others, as I remember it. Agreed this was in Children of the Sky.

(aFutD also had a case of high-stakes suspicion of highly compressed messages during Zone turbulence, as I think the GP meant.)

Re:Short Message Compression Using LLMs by askvictor on Monday December 30, 2024 @10:29PM (#42556161)
I shudder to think how current LLMs would go with this. I guess we can currently do this easily for still images and audio. Kind of reminds me of Translation Party.
Re:Short Message Compression Using LLMs by duskwuff on Monday December 30, 2024 @10:35PM (#42556198)
"Hexapodia is the key insight."
Re:Short Message Compression Using LLMs by taylorius on Tuesday December 31, 2024 @06:20AM (#42558042)
I see you Twirlip of the mists