News for hackers. Stuff that matters.
Re:IBM Granite: A Family of Open Foundation Models for Code ... by acheong08 on Tuesday May 07, 2024 @11:08PM (#40293969)
Llama and Mistral are already local & fulfill these requirements
Re:IBM Granite: A Family of Open Foundation Models for Code ... by jazzyjackson on Wednesday May 08, 2024 @12:10AM (#40294245)
but who can you pay to run these models and fulfill these requirements /for you/ ;)
Re:IBM Granite: A Family of Open Foundation Models for Code ... by worthless-trash on Wednesday May 08, 2024 @09:17AM (#40297785)
I could be wrong, but I think thats what the RHEL AI, topic was all about 24 hours ago ?
Re:IBM Granite: A Family of Open Foundation Models for Code ... by rolisz on Tuesday May 07, 2024 @11:15PM (#40294003)
Yes, but nobody got fired for buying IBM
Re:IBM Granite: A Family of Open Foundation Models for Code ... by morgante on Tuesday May 07, 2024 @11:47PM (#40294138)
That's a pretty outdated phrase, even in enterprise.
Re:IBM Granite: A Family of Open Foundation Models for Code ... by kubami on Wednesday May 08, 2024 @03:33AM (#40295308)
By no means it is an outdated phrase. Ask any startup sales person!
Re:IBM Granite: A Family of Open Foundation Models for Code ... by morgante on Wednesday May 08, 2024 @04:12AM (#40295550)
I personally know a VP who was fired for buying "IBM Cloud." You can absolutely get flak for choosing IBM these days, even at a stodgy enterprise.

The gist is still current, but you need to fill in AWS as the current uncontroversial choice.

Re:IBM Granite: A Family of Open Foundation Models for Code ... by dubcanada on Wednesday May 08, 2024 @08:37AM (#40297370)
Must be a very terrible company to work for if they are firing people solely on them picking X over Y.
Re:IBM Granite: A Family of Open Foundation Models for Code ... by antod on Tuesday May 07, 2024 @11:31PM (#40294067)
Yeah if something you install doesn't work, you get the blame. If IBM supplies something that doesn't work (likely), you get to blame them instead.
Re:IBM Granite: A Family of Open Foundation Models for Code ... by szszrk on Wednesday May 08, 2024 @12:12AM (#40294257)
Between "works" and "doesn't work" there is a full rainbow of possible answers, KPIs, yearly reviews in a network of matrix reporting.

There will be market for their services. Maybe a different one, but there will be.

Re:IBM Granite: A Family of Open Foundation Models for Code ... by abdullin on Wednesday May 08, 2024 @01:34AM (#40294685)
IBM goes at great lengths to train models on clean data that has lower risk of copyright or legal issues attached. Just take a look at the model description.

That data issue is important enough for some companies to pick mediocre model over llama or mistral.

Re:IBM Granite: A Family of Open Foundation Models for Code ... by doctorpangloss on Wednesday May 08, 2024 @03:34AM (#40295314)
What if I told you that a lot of freely licensed code on GitHub is not clean? That the authors may have read something and rewritten it in a way that wasn’t transformative? So it basically has the same problems.
Re:IBM Granite: A Family of Open Foundation Models for Code ... by bayindirh on Wednesday May 08, 2024 @08:18AM (#40297162)
What if I told you the supposedly clean "The Stack" dataset contains at least one GPL repository inside, just because their license detection tool bugged out?

IBM and other big players are vigilant about these things, and this is what companies pay for.

Their software may not be better in some metrics, but they're cleaner in some and their support contracts allows people to sleep tight at night.

This is what money buys. Peace of mind and continuity.

Re:IBM Granite: A Family of Open Foundation Models for Code ... by maccard on Wednesday May 08, 2024 @09:32AM (#40297929)
> IBM and other big players are vigilant about these things, and this is what companies pay for.

And more importantly, IBM will guarantee it in the case that they're wrong. _That's_ what companies pay for.

Re:IBM Granite: A Family of Open Foundation Models for Code ... by bayindirh on Wednesday May 08, 2024 @09:45AM (#40298060)
Yes. I tucked it under "support contract" part mentally, actually.
Re:IBM Granite: A Family of Open Foundation Models for Code ... by maccard on Thursday May 09, 2024 @06:54AM (#40306901)
That's fair, but until I actually read one of those contracts myself I didn't really understand what people meant by "support"
Re:IBM Granite: A Family of Open Foundation Models for Code ... by bayindirh on Thursday May 09, 2024 @06:57AM (#40306911)
It depends per job and per requirements, and has a direct affect on the cost of the contract in general.
Re:IBM Granite: A Family of Open Foundation Models for Code ... by CamperBob2 on Wednesday May 08, 2024 @01:57PM (#40301072)
And more importantly, IBM will guarantee it in the case that they're wrong.

So will OpenAI, according to Sam Altman. Can they be trusted?

Re:IBM Granite: A Family of Open Foundation Models for Code ... by bayindirh on Wednesday May 08, 2024 @02:33PM (#40301461)
IBM has a track record going back to automatically price calculating cheese cutters [0], but Sam does not.

IBM has proven itself in various ways over the years, OpenAI hasn't.

While IBM is a behemoth of a money making machine, they put money where their mouth is. OpenAI does not.

So I'll trust IBM, but not OpenAI.

[0]: https://youtu.be/z8VhNF_0I5c

Re:IBM Granite: A Family of Open Foundation Models for Code ... by doctorpangloss on Wednesday May 08, 2024 @03:49PM (#40302147)
Indemnity is moving the goal posts, no? So you’re conceding that their data isn’t clean. But they say it’s clean.

This support contract stuff: what are you talking about? You download these models, you use them. What would you pay for? It’s not clean data, they say it’s clean: why would I pay liars? Let’s game out the indemnity idea. I pay $10k/mo for 12 months. Then OpenAI loses v. NYTimes, ruled LLM training is not fair use, need express permission. IBM pulls the models. What the hell did I pay $120k for? And by the way, you can pay a law student 1 beer to tell you OpenAI is going to lose because of Warhol v Goldsmith. You can do whatever you want with your money, but I personally would not waste it on worthless indemnity.

Re:IBM Granite: A Family of Open Foundation Models for Code ... by bayindirh on Wednesday May 08, 2024 @04:22PM (#40302423)
First of all, "The Stack" is the dataset that models like StarCoder is trained upon. I don't know what's the data source for IBM Granite family.

I know the Stack is not clean, because they included my fork of GDM's greeter, which is GPL licensed.

My words about IBM was in general. I can't tell anything about their models, because I didn't see mention of "The Stack", and I don't know what their models are based on.

On the other hand, IBM doesn't like risks from my experience, so they would play it way safer than other companies.

If their data is not clean to begin with, then shame on them, and hope their AI efforts burn to the ground.

BTW, LLM training is not fair use. For start, Fair Use's definition automatically excludes "for profit" usage. Just because OpenAI has a non-profit part and training done here doesn't make them immune to consequences of for profit operations.

Re:IBM Granite: A Family of Open Foundation Models for Code ... by keefle on Wednesday May 08, 2024 @04:07AM (#40295524)
Can I sue Lamma and Mistral if things go wrong?
Re:IBM Granite: A Family of Open Foundation Models for Code ... by dartos on Wednesday May 08, 2024 @08:32AM (#40297298)
Llama is owned by Meta, so you’d be suing meta

But I’m pretty sure both models have “we’re not responsible” clauses.

Re:IBM Granite: A Family of Open Foundation Models for Code ... by keefle on Thursday May 09, 2024 @12:08AM (#40305227)
That was my point. Whereas if you are using a service from IBM as an enterprise, you would be able to sue them