News for hackers. Stuff that matters.

tsltrad

Re:I Run LLMs Locally on Monday December 30, 2024 @12:53PM (#42551693)
I understand your concerns.

For me though, this would be all upside because I have largely explored technical topics with language models that would only be impressive to an employer.

At this point, it is like asking what does someone use a computer for? The use cases are so varied.

I can see how it would be interesting for myself to setup a local model just for the fun of setting it up. When it comes down to it for me though it is just so much easier to pay $20 a month for Sonnet that it isn't even close or really a decision point.

Re:What is your bet in 2025? on Monday December 30, 2024 @08:24AM (#42549034)
At least in the US, a nurse has personal liability for a mistake.

A hallucination could not just be career/license ending but land the nurse in jail.

Even with 100% accuracy, is not entirely obvious to me how a nurse could leverage a language model to make their job that much easier.

A language model is not going to bath or dress someone.