News for hackers. Stuff that matters.

A comment on Ask HN: Who is using small OS LLMs in production?.

Re:Ask HN: Who is using small OS LLMs in production? by TradingPlaces on Wednesday August 02, 2023 @09:26AM (#36970588)
Facebook is working very hard to make the main dividing line in generative AI not company vs. company but commercial vs free. Starting from way behind, they are trying to make that irrelevant.
[ Parent | on HN ]
Re:Ask HN: Who is using small OS LLMs in production? by pavlov on Wednesday August 02, 2023 @09:54AM (#36970947)
“Way behind” seems harsh when they have one of the best models available.
[ Parent | on HN ]
Re:Ask HN: Who is using small OS LLMs in production? by TradingPlaces on Wednesday August 02, 2023 @10:14AM (#36971185)
Not that impressed with llama 2 70b so far tbh. It’s a GPT3-level bullshit machine imo. But huge advantages in running privately and at the edge, so that’s going to be the dividing line imo. Commercial v free. Small v big. H100s in the cloud v edge
[ Parent | on HN ]