News for hackers. Stuff that matters.
Re:Google agrees to invest up to $2B in OpenAI rival Anthropic by quickthrower2 on Saturday October 28, 2023 @06:37AM (#38048698)
Right now GPT4 is useful/powerful and probably anything else sucks. That may change but the mountain has real value at the top only. At least for chat used for either human assist or decision making or code generation. Categorisation, yeah you can use lesser LLMs.
Re:Google agrees to invest up to $2B in OpenAI rival Anthropic by npsomaratna on Saturday October 28, 2023 @07:41AM (#38049044)
Not necessarily true anymore. As a counterexample, consider CodeLlama 33b, which is quite good (and which has replaced GPT-4 for my coding assistant needs).

OpenAI's models are likely to remain the best, but I see open models catching up and becoming "good enough." Why pay for GPT-4 when I can run a model locally for free? (Barring the initial capital cost of a GPU; and not even this if you're, say, using a Macbook)

Re:Google agrees to invest up to $2B in OpenAI rival Anthropic by revoxx3 on Saturday October 28, 2023 @08:23AM (#38049277)
What's CodeLlama 33b? I couldn't find anything regarding it online
Re:Google agrees to invest up to $2B in OpenAI rival Anthropic by jsemrau on Saturday October 28, 2023 @08:42AM (#38049355)
Re:Google agrees to invest up to $2B in OpenAI rival Anthropic by bingemaker on Saturday October 28, 2023 @09:04AM (#38049476)
Off by 1B error
Re:Google agrees to invest up to $2B in OpenAI rival Anthropic by jsemrau on Saturday October 28, 2023 @10:11AM (#38049945)
^-^
Re:Google agrees to invest up to $2B in OpenAI rival Anthropic by quickthrower2 on Sunday October 29, 2023 @05:05AM (#38056871)
Just a 1B mistake
Re:Google agrees to invest up to $2B in OpenAI rival Anthropic by JTon on Saturday October 28, 2023 @08:43AM (#38049363)
Not 100% sure but I believe Llama [1] is a LLM created by meta. Code Llama is probably one tailored as a coding assistant

[1] https://ai.meta.com/llama/

Re:Google agrees to invest up to $2B in OpenAI rival Anthropic by npsomaratna on Saturday October 28, 2023 @11:49AM (#38050745)
Whoops, sorry. 34b :)
Re:Google agrees to invest up to $2B in OpenAI rival Anthropic by hansvm on Saturday October 28, 2023 @11:51AM (#38050767)
CodeLlama spit out some of the wildest garbage when I tested it, even against GPT-3.5. Which tasks have you found it to perform well?
Re:Google agrees to invest up to $2B in OpenAI rival Anthropic by emptysongglass on Saturday October 28, 2023 @07:42AM (#38049052)
Like yes, as long as GPT-4 remains the most useful (and now they have multi-modality in Plus so they've just extended their lead) nobody will adopt anything else.

So grandparent's argument makes even less sense as search should also be fungible but it isn't when Google still provides the best search product and has since it started. If OpenAI can maintain that lead and continue to ship improvements that continue to push their peak higher, most people will not pay for anything less even when that price is free.

Re:Google agrees to invest up to $2B in OpenAI rival Anthropic by HKH2 on Saturday October 28, 2023 @10:23AM (#38050035)
The GP didn't say who the value was meant to be for. There is definitely a lot of value for users, regardless of which model.

I would like LLaMa to be more local, responsive and private rather than more intelligent; it is good enough in that regard.

Re:Google agrees to invest up to $2B in OpenAI rival Anthropic by jokethrowaway on Saturday October 28, 2023 @08:15AM (#38049233)
No way, for creative writing zephyr (based on mistral) is my favourite. Also no stupid limits like chatgpt

For assistance, chatgpt is the best but llama is more than adequate.

For code generation they all suck, chatgpt 4 before they nerfed it was good.

I use codellama phind locally

Re:Google agrees to invest up to $2B in OpenAI rival Anthropic by HKH2 on Saturday October 28, 2023 @09:39AM (#38049699)
I don't work in tech and I use LLaMa. It is great for giving me ideas, writing overviews which I use to make sure I have most of my bases covered (and helping me see which of my ideas are more original), getting more examples, along with other creative tasks.

Could I get my employer to pay for it if all free options disappeared? Probably, but I don't have to while they exist.