News for hackers. Stuff that matters.

A comment on Is Bing too belligerent? Microsoft looks to tame AI chatbot. Parent comment

Re:Is Bing too belligerent? Microsoft looks to tame AI chatbot by tyfon on Saturday February 18, 2023 @05:53AM (#34845883)
One day it will though.

I think we will also see a lot of weights optimisation/pruning and model architecture optimisations that allow them to run on much less hardware.

[ Parent | on HN ]
Re:Is Bing too belligerent? Microsoft looks to tame AI chatbot by Baeocystin on Saturday February 18, 2023 @02:55PM (#34850409)
Like you say, we can self-host GPT-2 today. And Bloom is a large-scale open source LLM model available for anyone, and has been around for months.

Look how rapidly the RAM/hardware requirements for the diffusion generators has dropped over the past couple of months, now that they passed the critical interest threshold. I see no reason not to expect similar here.

[ Parent | on HN ]