News for hackers. Stuff that matters.
Re:Things we learned about LLMs in 2024 by simonw on Tuesday December 31, 2024 @04:44PM (#42562086)
One of the things I find most frustrating about LLMs is how resistant they are to teaching other people how to use them!

I'd love to figure this out. I've written more about them than most people at this point, and my goal has always been to help people learn what they can and cannot do - but distilling that down to a concise set of lessons continues to defeat me.

The only way to really get to grips with them is to use them, a lot. You need to try things that fail, and other things that work, and build up an intuition about their strengths and weaknesses.

The problem with intuition is it's really hard to download that into someone else's head.

I share a ton of chat conversations to show how I use them - https://simonwillison.net/tags/tools/ and https://simonwillison.net/tags/ai-assisted-programming/ have a bunch of links to my exported Claude transcripts.

Re:Things we learned about LLMs in 2024 by bjt on Tuesday December 31, 2024 @05:29PM (#42562333)
Thank you for doing this work, though.

My first stab at trying ChatGPT last year was asking it to write some Rust code to do audio processing. It was not a happy experience. I stepped back and didn't play with LLMs at all for a while after that. Reading your posts has helped me keep tabs on the state of the art and decide to jump back in (though with different/easier problems this time).

Re:Things we learned about LLMs in 2024 by djhn on Wednesday January 01, 2025 @02:55AM (#42564617)
To be fair I think that is a hard task even for a human expert, in the sense that there isn’t much prior art.