The scaling laws say deminishing returns. 10x scale is not a 10x improvement, maybe more like 1.05x at this point.

I have a gut feeling this is the last juice because for 2 years now they have been "beating benchmarks" yet relatively simple tasks they still can't do sometimes