News for hackers. Stuff that matters.
Re:Exponentially Faster Language Modelling by cooper_ganglia on Wednesday November 22, 2023 @04:08PM (#38385131)
Even 65B models approach a level of being almost usable, but still fall short in my personal experience.
Re:Exponentially Faster Language Modelling by cloudking on Wednesday November 22, 2023 @04:16PM (#38385239)
This is why I'm not understanding the excitement around open source models, they pale in comparison to GPT-4 quality, so I have no use for them until we have something comparable.
Re:Exponentially Faster Language Modelling by lettergram on Wednesday November 22, 2023 @10:21PM (#38388833)
We utilize a LLama that frankly competes directly with gpt-4, to the point I can't tell which model we are using (we randomly switch between providers to ensure a robust backend).

I think it likely depends on the use case, but many llama models can be returned and there are quite literally thousands of free versions available.

Re:Exponentially Faster Language Modelling by WhrRTheBaboons on Thursday November 23, 2023 @05:36AM (#38391365)
What is your use case?
Re:Exponentially Faster Language Modelling by lettergram on Thursday November 23, 2023 @09:00PM (#38399973)