News for hackers. Stuff that matters.
Re:2023: The Year of AI by dmezzetti on Monday December 25, 2023 @02:56PM (#38765571)
Going to call BS on this. I've delivered multiple projects this year using open models.
Re:2023: The Year of AI by apwell23 on Monday December 25, 2023 @03:05PM (#38765651)
> delivered multiple projects

Very curious about the type of projects you've delivered.

Re:2023: The Year of AI by benrow on Monday December 25, 2023 @03:22PM (#38765769)
Also curious.

I'm a sample of 1 and also relatively inexperienced. But I felt I quickly reached the limits of what was possible when I tried doing sentence classification with OSS sentence embedding models. The issue was with negation. I'd attributed too much magic to embedding models - they don't really understand language.

Not to say there isn't very capable tech out there. Just to add a datapoint that "sentiment analysis"-like approaches in blogs don't always scale to your particular use-case.

Edit: conscious I've drifted from the topic of chatbot type models, but felt relevant somehow.

Re:2023: The Year of AI by dmezzetti on Monday December 25, 2023 @03:11PM (#38765689)
You can look at https://github.com/neuml/txtai. Biggest thing of 2023 was RAG with models like Mistral.
Re:2023: The Year of AI by apwell23 on Tuesday December 26, 2023 @09:57AM (#38772261)
Got it. Thank you. I thought you had delivered consumer facing applications when i read that comment.
Re:2023: The Year of AI by dmezzetti on Tuesday December 26, 2023 @10:19AM (#38772444)
I've delivered consulting projects using RAG and Mistral 7B. Not saying it's easy to get the prompts right but I've been able to build systems that work well. Just trying to counter the myth that paid APIs are the only way to do this.