News for hackers. Stuff that matters.
Re:I made my AI think harder by making it argue with itself by jsight on Tuesday April 29, 2025 @06:01PM (#43838522)
This reminds me a lot of the YT video that went over using Monte Carlo Tree Search with LLMs to maximize result quality. Link: https://www.youtube.com/watch?v=mfAV_bigdRA&ab_channel=Treli...

It seemed like a pretty good idea, though I'd guess that it would greatly increase token usage. I'd also be concerned that the LLM as a judge might struggle to grade things accurately if it wasn't also able to generate good enough answers to begin with.

Re:I made my AI think harder by making it argue with itself by looofooo0 on Wednesday April 30, 2025 @02:11AM (#43841775)
If you think about marginal cost, such experiments can be run almost at only the cost of extra electricity used for that computation, which in Europe is often zero, at least by the ones who own the compute.