News for hackers. Stuff that matters.

blutfink

Of course an LLM uses more space internally for a token. But so do humans.

My point was that you compared how the LLM represents a token internally versus how “English” transmits a word. That’s a category error.

The LLM can also “say” “cat” with few bits. Note that the meaning of the word as stored in your brain takes more than 24 bits.
Re:Testing sync at Dropbox (2020) on Friday May 31, 2024 @01:16PM (#40537760)
(2020)*
Re:Was cancer less likely in a pre-industrial world? on Saturday May 15, 2021 @05:22PM (#27169141)
Betteridge's Law of headlines: "Any headline that ends in a question mark can be answered by the word no."
Re:Why US Inequality Is Worse Than Other Developed Nations on Thursday October 18, 2018 @06:18PM (#18252657)
But your total defense spending should be informed by your enemies' total defense spending, not necessarily by the size of your economy. From that perspective I find the above statement pretty illustrative.
I wonder if the family of Benjaman Kyle [0] will eventually be found as more and more people are added to the databases.

[0] https://en.wikipedia.org/wiki/Benjaman_Kyle

Re:The Octonion Math That Could Underpin Physics on Friday July 20, 2018 @12:34PM (#17576499)
There are equivalent formulations of SR using quaternions.
Headline is wrong. 68GJ per month, not GW, which is roughly 26kW.
Re:A French King Who Believed He Was Made of Glass on Friday April 06, 2018 @04:55PM (#16777338)
Wikipedia article about the psychiatric disorder: https://en.wikipedia.org/wiki/Glass_delusion
Re:Apple and NeXT announce merger (1996) on Wednesday December 20, 2017 @08:15PM (#15975525)
The cost of a WebObjects deployment license was about $50,000 then.
Re:Snowflake macro photography (2013) on Wednesday September 20, 2017 @06:36PM (#15298982)
;)

Selection by the photographer might create the impression of a more prevalent, more perfect symmetry than appears in nature.

Re:Snowflake macro photography (2013) on Wednesday September 20, 2017 @05:18PM (#15298367)
I was wondering the same thing. Part of it may be selection bias, though.
Re:Why Finnish babies sleep in cardboard boxes (2013) on Wednesday September 21, 2016 @01:27PM (#12550313)
My "little" brother is 11 months and 20 days younger than me.
Re:Poisonous MD5 – Wolves Among the Sheep on Wednesday June 10, 2015 @09:11PM (#9696793)
The "Reactions" table is hilarious – thanks for the link.