italodev

Very useful, thanks

fitness evaluation can be massively parallel and scales easily..

Would love to see a model trained on wikipedias only

Is the question even that relevant? I would say the best models already have better than human culture. Maybe not skills, but culture for sure.