News for hackers. Stuff that matters.
Re:Measuring AI Ability to Complete Long Tasks: Opus 4.5 has... by simonw on Sunday December 21, 2025 @12:06PM (#46346264)
I genuinely do think you can learn 90% of what that is to learn about integrating with a vector database from having an LLM do the work for you and then carefully reviewing what it did.

Turns out there's science that backs me up here: https://en.wikipedia.org/wiki/Worked-example_effect - showing people "worked examples" can be more effective than making them solve the problem themselves.

That Wikipedia article is a little weak, this MIT page is better: https://tll.mit.edu/teaching-resources/how-people-learn/work...

Re:Measuring AI Ability to Complete Long Tasks: Opus 4.5 has... by throwaway613745 on Sunday December 21, 2025 @01:06PM (#46346772)
> Worked examples are step-by-step illustrations of the process required to complete a task or solve a problem.

That’s not what having a bot generate your integration is and reading it post-facto is. The bot isn’t guiding you through the process so you can go do it yourself. At best you would use this as a reference to go do another integration yourself - but at this point why even bother when you can just get the bot to do it again?

The only thing people learn using AI is how to do things with AI.

Re:Measuring AI Ability to Complete Long Tasks: Opus 4.5 has... by simonw on Sunday December 21, 2025 @03:04PM (#46347905)
> The bot isn’t guiding you through the process so you can go do it yourself.

It is if you ask it to. Learning well with LLMs requires a lot of self-discipline - you have to be actively aware of the threat that you won't actually learn effectively and take steps to counter that.

I keep meticulous notes of everything these things do for me, which adds up to a valuable set of notes over time. I gave up on remembering things without notes a long time ago!

Re:Measuring AI Ability to Complete Long Tasks: Opus 4.5 has... by jfreds on Sunday December 21, 2025 @01:09PM (#46346793)
Having gone though exactly this exercise recently comparing a homegrown vector db against Qdrant, I’m wholeheartedly in agreement that getting a working solution FAST, and then spending a decent amount of time interrogating it (with help of LLM), is my favorite learning pattern