News for hackers. Stuff that matters.

A comment on Llama.cpp Now Supports Qwen2-VL (Vision Language Model). Parent comment

Re:Llama.cpp Now Supports Qwen2-VL (Vision Language Model) by MaxLeiter on Sunday December 15, 2024 @04:37AM (#42422535)
We don’t know o1 thinks in English. What we see is a summary of the thinking process.

My guess is it “thinks” in non-eligible tokens

[ Parent | on HN ]
Re:Llama.cpp Now Supports Qwen2-VL (Vision Language Model) by disqard on Sunday December 15, 2024 @05:34AM (#42422726)
Did you mean to write "non-legible" ?
[ Parent | on HN ]
Re:Llama.cpp Now Supports Qwen2-VL (Vision Language Model) by letmevoteplease on Sunday December 15, 2024 @09:47AM (#42423669)
The o1 release blog post contains 8 full examples of o1 chains of thought (not the summarized versions visible to users). They're English.

https://openai.com/index/learning-to-reason-with-llms/#chain...

I have seen the summaries dip into completely random languages like Thai, so it might switch between languages occasionally.

[ Parent | on HN ]