News for hackers. Stuff that matters.
Re:What's new in Llama 2 and how to run it locally by SOLAR_FIELDS on Monday August 07, 2023 @08:51AM (#37033716)
I’ve gotten mine running with FastChat - they have a Metal/MPS option.

Sadly 7b is not very good for SQL tasks. I think even with RAG it would struggle.

There are no comments on this comment yet.