News for hackers. Stuff that matters.
Re:Why DeepSeek is cheap at scale but expensive to run locally by rpmisms on Sunday June 01, 2025 @02:50PM (#44152946)
Please go into more detail about this proposal, this piqued my interest in a really strange way.
Re:Why DeepSeek is cheap at scale but expensive to run locally by cyptus on Sunday June 01, 2025 @03:01PM (#44153031)
The idea is to replicate the weights of the network in the electronics. Somehow like our brains work? This way an analog input signal could lead to a neural network processed output signal without the digital emulation on an gpu. As this is very much simplified, the question is if this could work for modern llms?
Re:Why DeepSeek is cheap at scale but expensive to run locally by koiueo on Sunday June 01, 2025 @04:35PM (#44153585)
Suddenly "temperature" parameter starts making sense

(If you ever tried fine-tuning an analog circuit, you'll know how finicky the process due to the environment, including temperature)

Re:Why DeepSeek is cheap at scale but expensive to run locally by cyptus on Sunday June 01, 2025 @06:10PM (#44154110)
haha very true!