Llama 3.2: Revolutionizing edge AI and vision with open, customizable models

Re:Llama 3.2: Revolutionizing edge AI and vision with open, ... by alanzhuly on Thursday September 26, 2024 @12:41AM (#41654614)

Llama3.2 3B feels a lot better than other models with same size (e.g. Gemma2, Phi3.5-mini models).

For anyone looking for a simple way to test Llama3.2 3B locally with UI, Install nexa-sdk(https://github.com/NexaAI/nexa-sdk) and type in terminal:

nexa run llama3.2 --streamlit

Disclaimer: I am from Nexa AI and nexa-sdk is an open-sourced. We'd love your feedback.

[ Parent | on HN ]

Re:Llama 3.2: Revolutionizing edge AI and vision with open, ... by alfredgg on Thursday September 26, 2024 @02:37AM (#41655185)

It's a great tool. Thanks!

I had to test it with Llama3.1 and was really easy. At a first glance Llama3.2 didn't seem available. The command you provided did not work, raising "An error occurred while pulling the model: not enough values to unpack (expected 2, got 1)".

[ Parent | on HN ]

Re:Llama 3.2: Revolutionizing edge AI and vision with open, ... by alanzhuly on Thursday September 26, 2024 @12:54PM (#41660639)

Thanks for reporting. We are investigating this issue. Could you help submit an issue to our GitHub and provide a screenshot of the terminal (with pip show nexaai)? This could help us reproduce this issue faster. Much appreciated!

[ Parent | on HN ]

Re:Llama 3.2: Revolutionizing edge AI and vision with open, ... by grahamj on Thursday September 26, 2024 @12:55PM (#41660648)

or grab lmstudio

[ Parent | on HN ]

Re:Llama 3.2: Revolutionizing edge AI and vision with open, ... by Zuiii on Saturday September 28, 2024 @02:15AM (#41678270)

For people who really care about open source, this is not.

[ Parent | on HN ]

Re:Llama 3.2: Revolutionizing edge AI and vision with open, ... by mikestaub on Wednesday October 02, 2024 @10:31AM (#41721033)

or https://chat.webllm.ai/

[ Parent | on HN ]