News for hackers. Stuff that matters.

A comment on Ask HN: Who is using small OS LLMs in production?. Parent comment

Re:Ask HN: Who is using small OS LLMs in production? by pavlov on Wednesday August 02, 2023 @09:54AM (#36970947)
“Way behind” seems harsh when they have one of the best models available.
[ Parent | on HN ]
Re:Ask HN: Who is using small OS LLMs in production? by TradingPlaces on Wednesday August 02, 2023 @10:14AM (#36971185)
Not that impressed with llama 2 70b so far tbh. It’s a GPT3-level bullshit machine imo. But huge advantages in running privately and at the edge, so that’s going to be the dividing line imo. Commercial v free. Small v big. H100s in the cloud v edge
[ Parent | on HN ]