News for hackers. Stuff that matters.

A comment on Transformers.js: State-of-the-art Machine Learning for the web. Parent comment

Re:Transformers.js: State-of-the-art Machine Learning for th... by jfoster on Thursday April 11, 2024 @10:17AM (#40002405)
> I think cloud hosted models will probably always be far better for most tasks

It might depend on just how good you need it to be. There are lots of use-cases where an LLM like GPT 3.5 might be "good enough" such that a better model won't be so noticeable.

Cloud models will likely have the advantage of being more cutting-edge, but running "good enough" models locally will probably be more economical.

[ Parent | on HN ]
Re:Transformers.js: State-of-the-art Machine Learning for th... by fauigerzigerk on Thursday April 11, 2024 @10:44AM (#40002765)
I agree. The economic advantages of a hybrid approach could be very significant.
[ Parent | on HN ]