News for hackers. Stuff that matters.
Re:GPT-4o by ShakataGaNai on Monday May 13, 2024 @02:49PM (#40346810)
If you read into the details on openai's site, a lot of this stuff is clearly marked as english-first. For some written languages...noted as anything using non-roman characters, so most of asia, it basically doesn't work.

This really isn't surprising. Look at Google Home and Alexa. When they first came out, if you weren't a white male from the west coast... the accuracy of translating commands dropped DRAMATICALLY. Because it was programmed, designed and tested by majority of white tech bros in SF/Seattle. They've gotten a lot better over the last 5+ years. But I think you'll see OpenAI take this route.

But that's ok. They have to start somewhere. Once they get the model working really well for one language they can expand into similar ones with relatively little work. The more different the language, the more hard work and "local input" (ex: natives of the language) will be required for adaptation. But the basic text translations are still already way better than they used to be.

Re:GPT-4o by joseda-hg on Monday May 13, 2024 @05:21PM (#40348612)
An interesting point, I tend to have better outcomes by using my heavily accented ESL English, than my native pronunciation of my mother tongue I'm guessing it's part of the tech work force being a bit more multicultural than initially thought, or it just being easier to test with

It's a shame, because that means I can use stuff that I can't recommend to people around me

Multilingual UX is an interesting painpoint, I had to change the language of my account to English so I could use some early Bard version, even though It was perfectly able to understand and answer in Spanish

Re:GPT-4o by zenlikethat on Monday May 13, 2024 @05:54PM (#40348958)
You also get the synchronicity / four minute mile effect egging on other people to excel with specialized models, like Falcon or Qwen did in the wake of the original ChatGPT/Llama excitement.
Re:GPT-4o by greatpostman on Monday May 13, 2024 @06:35PM (#40349368)
Racist post
Re:GPT-4o by kolinko on Monday May 13, 2024 @06:36PM (#40349381)
What? Did it seriously work worse for women? Spurce?

(accents sure)

Re:GPT-4o by astrange on Monday May 13, 2024 @07:32PM (#40349822)
In my experience, when someone says a project was programmed by "white men from the west coast", it was actually made by Chinese or Indian immigrants.

(Siri's original speech recognition was a combination of Swiss-Germans and people from Boston.)

And it certainly wouldn't be tested by them either way. Companies know how to hire QA contractors.

Re:GPT-4o by marcellus23 on Monday May 13, 2024 @07:44PM (#40349921)
People always say tech workers are all white guys -- it's such a bizarre delusion, because if you've ever actually seen software engineers at most companies, a majority of them are not white. Not to mention that product/project managers, designers, and QA are all intimately involved in these projects, and in my experience those departments tend to have a much higher ratio of women.

Even beside that though -- it's patently ridiculous to suggest that these devices would perform worse with an Asian man who speaks fluent English and was born in California. Or a white woman from the Bay Area. Or a white man from Massachusetts.

You kind of have a point about tech being the product of the culture in which it was produced, but the needless exaggerated references to gender and race undermine it.