News for hackers. Stuff that matters.
Re:g1: Using Llama-3.1 70B on Groq to create o1-like reasoni... by quantadev on Monday September 16, 2024 @04:03PM (#41560102)
I haven't even added Strawberry support to my app yet, and so haven't checked what it's context length is, but you're right that additional context length is a scaling factor that's totally independent of whether CoT is used or not.

I'm just saying whatever hey did in their model, I think they also added CoT on top of it all, as the outer layer of the onion so to speak.

There are no comments on this comment yet.