Re:Neural audio codecs: how to get audio into LLMs
by PaulDavisThe1st on Tuesday October 21, 2025 @11:05AM
(#45656731)
Humans that read (at least) Indo-European languages can read texts in their native language with all the vowels removed. Does that suggest that it would be a good idea to remove the vowels from text before using it for training text-based LLMs ?
Presumably you want to train on as rich a set of data as possible, even if some of that data is redundant or irrelevant when it comes to human perception.
Re:Neural audio codecs: how to get audio into LLMs
by Tangurena2 on Tuesday October 21, 2025 @11:25AM
(#45656983)
Generally, the difference between regional dialects is almost all in vowels (sample: 0). This is why SOUNDEX [1] eliminated vowels.
0 - https://www.acelinguist.com/2020/01/the-pin-pen-merger.html
Re:Neural audio codecs: how to get audio into LLMs
by 542354234235 on Tuesday October 21, 2025 @11:03AM
(#45656712)
I imagine it would be like if there were Rosetta Stones of text, written with a language you could read and a language you couldn't. For your purposes, discarding the text you can't read would be fine and you wouldn't lose anything. But if you were ingesting a bunch into an LLM, the additional text would give the LLM more context and help it make connections and relate words more accurately, even if you never were going to have it output anything in the language you don't understand.
The inaudible sounds add context and additional datapoints on how the audible sounds are related.
Re:Neural audio codecs: how to get audio into LLMs
by CaptainOfCoit on Tuesday October 21, 2025 @10:48AM
(#45656507)
Maybe that things outside our audible range could impact/influence things inside of our audible range?
I'm not sure I follow. If there is a set of tokens that the average human cannot perceive, why wouldn't we want to eliminate them from the search space? Who is the target audience for this model?