News for hackers. Stuff that matters.
Re:Claude Opus 4.7 by claytongulick on Thursday April 16, 2026 @11:29AM (#47794710)
I don't understand how this would work without a huge loss in resolution or "cognitive" ability.

Prediction works based on the attention mechanism, and current humans don't speak like cavemen - so how could you expect a useful token chain from data that isn't trained on speech like that?

I get the concept of transformers, but this isn't doing a 1:1 transform from english to french or whatever, you're fundamentally unable to represent certain concepts effectively in caveman etc... or am I missing something?

Re:Claude Opus 4.7 by egorfine on Thursday April 16, 2026 @01:00PM (#47796294)
Good catch actually.

Okay maybe not exactly caveman dialect, but text compression using LLM is definitely possible to save on tokens in deep research.