News for hackers. Stuff that matters.
Re:QwQ: Alibaba's O1 Like Reasoning LLM by nemothekid on Wednesday November 27, 2024 @08:58PM (#42261680)
>Conveniently, the U.S. has been supplying infinite tokens to China through Tiktok

How is this not FUD? What competitive advantage is China seeing in LLM training through dancing videos on TikTok?

Re:QwQ: Alibaba's O1 Like Reasoning LLM by nextworddev on Wednesday November 27, 2024 @08:59PM (#42261687)
you get video tokens through those seemingly dumb tiktok shorts
Re:QwQ: Alibaba's O1 Like Reasoning LLM by nl on Wednesday November 27, 2024 @10:15PM (#42262099)
Of all the types of tokens in the world video is not the one that comes to mind as having a shortage.

By setting a a few thousand security cameras in various high traffic places you can get almost infinite footage.

Instagram, Youtube and Snapchat have no shortage of data too.

Re:QwQ: Alibaba's O1 Like Reasoning LLM by nextworddev on Wednesday November 27, 2024 @10:20PM (#42262123)
except 1) tiktok is video stream data many orders of magnitude larger than any security cam data, that's attached to real identity 2) china doesn't have direct access to Instagram reels and shorts, so yeah
Re:QwQ: Alibaba's O1 Like Reasoning LLM by nl on Wednesday November 27, 2024 @10:27PM (#42262156)
Why does tying it to identity help LLM training?

It's pretty unclear that having orders of magnitude more video data of dancing is useful. Diverse data is much useful!