lukethorham

There’s a METR audit document which apparently describes various unreleased models. This is discussed in a YT video by Wes Roth. I have no firsthand knowledge about it.

I wonder if something like this is the undisclosed new approach from Anthropic that presumably has massive improvements by combining multiple models. Leveraging decision models as much as possible seems logical for extra speed and token efficiency.