News for hackers. Stuff that matters.

sebnado

Show HN: WorldBuild Bench repo: testing LLM world coherence with 3D games

https://github.com/sebnado/worldbuild-bench

I built WorldBuild Bench because, as we all know, llm bench scores often say something very different from what models actually feel like to use. It's really dependent on the type of tasks.I personally want to test spatial, temporal, and causal coherence in an interactive 3D world. Does the model understand where things are, world stays consistent over time and do the consequences make...

( Read More... | no comments | 2 points | on HN )
I think it would benefit from having a upvote type of feature to surface opinions/comments that people agree with. if you have many people with the same insight in your thread, there is no point in restating the same point over and over to show you agree
love it I can think of many projects that could use that
We’ve been running an AI-first dev loop in production for ~2 years (disclaimer: I help build Ze1 and Sandscape, they are both Ai driven products). A few things we’ve learned:

Instead of cranking boilerplate, they spend Day 1 reviewing AI diffs. We pair them with a senior for a “why did the agent choose this?” teardown.

What matters is mean-time-to-rollback. If the agent + test harnesses catch breakage faster than a human pair can, 2 × better is already good economics. Reliability engineering beats perfection thresholds.

Syntax, style and most unit-level bugs are now linted or auto-fixed. Humans zoom out to architecture, data contracts, threat models, perf budgets, and “does this change make sense for the product?”. So even juniors are now a lot more involved on the sujective elements of development

So I think that as the easy bugs vanish, new failure modes show up: latency cliffs, subtle privacy leaks, energy use, fairness. The goal posts moves

Fascinating read. I see the same tension: today’s models are masters of interpolation, but they still lack intentionality. If we push them toward “cognitive exoskeletons” (handling the combinatorial grunt work while humans dictate the why) we get amplification instead of flattening.
Re:AI Is Learning to Escape Human Control on Monday June 02, 2025 @01:57PM (#44161385)
Thing whole thing is a bit dumb tbh. You send conflicting requests to the LLM and it fails at doing both. It's nothing new, we all know it. Every article's headline make it sound like the AI is somehow consciously refusing the request to shutdown, while the only thing it demonstrate is that we are over fitting for specific outcomes. We are still a long way from human level general intelligence.
Re:Claude Code: An Agentic cleanroom analysis on Sunday June 01, 2025 @07:40PM (#44154608)
By saying that's its gold mine, I think OP meant that's it's funny, not that it brings valuable insight. ie: THEY KNOW -> that made me laugh

and as the article said "an LLM who just spent thousands of words explaining why they're not allowed to use thousands of words", its just funny to read.

Re:Making maps with noise functions (2022) on Sunday June 01, 2025 @07:35PM (#44154581)
It's a really good approach for procedural maps, but if you want to achieve realism, you'll likely need something like Gaea