It'd be nice if they underwent tests and developed fine-tuning data that was proven to work rather than using fine-tuning data made to cater to human preferences.

When I would look at Copilot's searches, it was as juvenile as what my grandma would type right after I taught her what a search engine was.