Re:Why DeepSeek is cheap at scale but expensive to run locally
by rpmisms on Sunday June 01, 2025 @02:50PM
(#44152946)
Please go into more detail about this proposal, this piqued my interest in a really strange way.
[ Parent
| on HN ]
Re:Why DeepSeek is cheap at scale but expensive to run locally
by cyptus on Sunday June 01, 2025 @03:01PM
(#44153031)
The idea is to replicate the weights of the network in the electronics. Somehow like our brains work? This way an analog input signal could lead to a neural network processed output signal without the digital emulation on an gpu. As this is very much simplified, the question is if this could work for modern llms?
Re:Why DeepSeek is cheap at scale but expensive to run locally
by koiueo on Sunday June 01, 2025 @04:35PM
(#44153585)
Suddenly "temperature" parameter starts making sense
(If you ever tried fine-tuning an analog circuit, you'll know how finicky the process due to the environment, including temperature)