News for hackers. Stuff that matters.
Re:QwQ: Alibaba's O1 Like Reasoning LLM by exact_string on Thursday November 28, 2024 @06:32PM (#42269417)
These tests always make me wonder: What qualifies as a valid pattern rule?

For example, why wouldn't "0" be a correct answer here (rule being "every other number on the right should be 0, other numbers do not have a pattern")?

Re:QwQ: Alibaba's O1 Like Reasoning LLM by apocadam on Thursday November 28, 2024 @08:44PM (#42270082)
Exactly, it's completely arbitrary. I like to frame it in terms of fitting n points (the existing data in the problem) to a polynomial of degree n+1, where there's an infinite number of ways to pick a solution and still satisfy the initial data.
Re:QwQ: Alibaba's O1 Like Reasoning LLM by kaba0 on Friday November 29, 2024 @02:27PM (#42276363)
Maybe the "solution with the lowest Kolmogorov complexity".

In a sibling comment, I replied that usually a repeating pattern can also be applied, but that one usually requires storing the n-sequence, rarely making it the shortest encodable rule.

Re:QwQ: Alibaba's O1 Like Reasoning LLM by snarkconjecture on Friday November 29, 2024 @12:48AM (#42271195)
I think it's better phrased as "find the best rule", with a tacit understanding that people mostly agree on what makes a rule decent vs. terrible (maybe not on what makes one great) and a tacit promise that the sequence presented has at least one decent rule and does not have multiple.

A rule being "good" is largely about simplicity, which is also essentially the trick that deep learning uses to escape no-free-lunch theorems.

Re:QwQ: Alibaba's O1 Like Reasoning LLM by kaba0 on Friday November 29, 2024 @02:24PM (#42276331)
This is exactly what I hated about these kind of questions!!

Or just, the pattern simply repeats for the n next number.. like come on, there is no objective metric for which rule is "better".