News for hackers. Stuff that matters.

A comment on Ask HN: What is the current (Apr. 2024) gold standard of running an LLM locally?. Parent comment

Re:Ask HN: What is the current (Apr. 2024) gold standard of ... by brushfoot on Monday April 01, 2024 @09:28AM (#39893970)
How does Ollama distribute these models? The downloads page on the Llama website, https://llama.meta.com/llama-downloads/, has a heading that reads:

> Request access to Llama

Which to me gives the impression that access is gated and by application only. But Ollama downloaded it without so much as a "y".

Is that just Meta's website UI? Registration isn't actually required?

[ Parent | on HN ]
Re:Ask HN: What is the current (Apr. 2024) gold standard of ... by whimsicalism on Monday April 01, 2024 @11:38AM (#39895316)
because this field is a baby, noncompliance is rampant
[ Parent | on HN ]
Re:Ask HN: What is the current (Apr. 2024) gold standard of ... by cymor on Monday April 01, 2024 @09:49AM (#39894162)
It doesn't distribute. The app pulls from hugging face.
[ Parent | on HN ]
Re:Ask HN: What is the current (Apr. 2024) gold standard of ... by brushfoot on Monday April 01, 2024 @10:06AM (#39894323)
Hugging Face's Llama 2 page says, "You need to share contact information with Meta to access this model":

https://huggingface.co/meta-llama/Llama-2-7b

Ollama's installer didn't ask me for any contact info.

[ Parent | on HN ]
Re:Ask HN: What is the current (Apr. 2024) gold standard of ... by michaelt on Monday April 01, 2024 @12:06PM (#39895678)
Huggingface has many, many fine tunes of Llama from different people, which don't ask that.

The requirement has always been more of a fig leaf than anything else. It allows Facebook to say everyone who downloaded from them agreed to some legal/ethics nonsense. Like all click-through license agreements nobody reads it; it's there so Facebook can pretend to be shocked when misuse of the model comes to light.

[ Parent | on HN ]
Re:Ask HN: What is the current (Apr. 2024) gold standard of ... by brushfoot on Monday April 01, 2024 @12:20PM (#39895838)
I mean Llama itself, not a fine tune. Ollama seemed to download and run Llama 2 with no agreement.
[ Parent | on HN ]