Interestingly, I’m pretty sure they mean they hit the limit with tokens on Claude.

There’s a daily 2.5 million token limit that you can use up fairly quickly with 100K context

So they may very well have completed the whole program with Claude. It’s just the machine literally stopped and the human had to do the final grunt work.

We’ve been hitting this in our work and in experimentation, and I can confirm that Claude sonnet 3.5 has gotten 100% of the way there, including working through errors and tricky problems as we tested the apps it built.

exactly right.

POCs and demos are easy to build by anyone these days. The last 10% is what separates student projects from real products.

any engineer who has spent time in the trenches understands that fixing corner cases in code produced by inexperienced engineers consumes a lot of time.

in fact, poor overall design and lack of diligence tanks entire projects.

Sometimes it's not even inexperienced coders -- it's our own dang selves ;-)

Well, in my mind, the SketchySeaBeast of last week is inexperienced compared to the SketchySeaBeast of this one.

>> The problem is that you must understand that 95% in order to complete the last 5%.

What stops you from using AI to explain the code base?