News for hackers. Stuff that matters.

A comment on (Databricks cofounder) How Is ChatGPT’s Behavior Changing over Time?. Parent comment

Re:(Databricks cofounder) How Is ChatGPT’s Behavior Changing... by avion23 on Wednesday July 19, 2023 @10:01AM (#36786489)
> and $10,000+ of compute hardware per inference session.

That is not true. A common macbook with lots of RAM (>32GB) is enough. Or any x86 computer with lots of RAM. llama.cpp is CPU only and quite fast

[ Parent | on HN ]

There are no comments on this comment yet.