g1: Using Llama-3.1 70B on Groq to create o1-like reasoning chains

Re:g1: Using Llama-3.1 70B on Groq to create o1-like reasoni... by Oras on Monday September 16, 2024 @07:52AM (#41555100)

Well, with Tree Of Thought (ToT) and fine-tuned models, I'm sure you can achieve the same performance with margin to improve as you identify the bottlenecks.

I'm not convinced OpenAI is using one model. Look at the thinking process (UI), which takes time, and then suddenly, you have the output streamed out at high speed.

But even so, people are after results, not really the underlying technology. There is no difference of doing it with one model vs multiple models.

[ Parent | on HN ]

Re:g1: Using Llama-3.1 70B on Groq to create o1-like reasoni... by alach11 on Monday September 16, 2024 @09:19AM (#41555777)

> I'm not convinced OpenAI is using one model. Look at the thinking process (UI), which takes time, and then suddenly, you have the output streamed out at high speed.

According to OpenAI, the model does it's thinking behind the scenes, then at the end summarizes that thinking for the user. We don't get to see the original chain-of-thought reasoning, just the AI's own summary of that reasoning. That explains the output timing.

[ Parent | on HN ]