Re:Stochastic gradient descent written in SQL
by teruakohatu on Tuesday March 07, 2023 @06:19PM
(#35062778)
> This is great! Moving away from the proprietary nature of GPUs and complex math gatekeeping should help democratize AI.
I understand the sentiment but you can run ML on plain CPUs, in fact it is easier to do so, you just don't get the massive speed benefits of GPUs. Hugging face's public models are all run on CPUs to save costs.
> Right now AI algorithms kind of look imperative and stateful to me, like state machines.
The maths is not stateful or imperative, only our implementation. Much like how functional languages are executed on a stateful CPU.
I understand the sentiment but you can run ML on plain CPUs, in fact it is easier to do so, you just don't get the massive speed benefits of GPUs. Hugging face's public models are all run on CPUs to save costs.
> Right now AI algorithms kind of look imperative and stateful to me, like state machines.
The maths is not stateful or imperative, only our implementation. Much like how functional languages are executed on a stateful CPU.
Research in parallelization is ongoing.