News for hackers. Stuff that matters.
Re:Introducing ChatGPT Enterprise by willsmith72 on Monday August 28, 2023 @01:56PM (#37297973)
most teams don't want to self-host, and definitely don't want to have to run on-device eating up their ram
Re:Introducing ChatGPT Enterprise by lancesells on Monday August 28, 2023 @02:06PM (#37298145)
I get the self-host part, but if you had a dedicated machine would the ram be an issue? Can you run it on a machine with like 128GB of ram or the GPU equivalent?
Re:Introducing ChatGPT Enterprise by whimsicalism on Monday August 28, 2023 @02:04PM (#37298109)
There is no reason these models will be selfhost only.
Re:Introducing ChatGPT Enterprise by willsmith72 on Monday August 28, 2023 @02:16PM (#37298305)
agreed, and I can't wait for gpt4 to have great competition in terms of ease, price and performance. I was responding to this

> something that should just be completely on-device or self-hosted if you don't trust cloud-based AI models like ChatGPT Enterprise and want it all private and low cost