News for hackers. Stuff that matters.
Re:AI is becoming 'yes-men on servers' by berkes on Monday March 10, 2025 @09:39AM (#43320487)
That hardly works. Though from my limited experiments, claude's models are better at this than OpenAIs. OpenAI will, quite often, come with suggestions that are literal translations of "anglicist" phrases.

Such as "Ik hoop dat deze email u gezond vindt" (I hope this email finds you well), which is so wrong that not even "simple" translation tools would suggest this.

Seeing that OpenAIs models can (could? This is from a large test we did months ago) not even use proper localized phrases but uses American ones, I highly doubt it can or will respond by refusing answers when it has none based on the training data.

Re:AI is becoming 'yes-men on servers' by berkes on Tuesday March 11, 2025 @04:15AM (#43330299)
Some of the examples are still wrong. Nuanced, but a Dutch native will still frown at it.

But more importantly is that you limited the context a lot. As in: the scope, the prompt, is very narrow.

In our case, we were generating emails. Lines like greetings are but one of 20+ details in that mail and not even the most important ones. The prompts ever larger, the multishot examples ever more tuned. And then, one in a few hundred will turn up with these "horrible" translations.

We've now moved to a chain of models, where we generate emails in American (the creative part) and then use another model to translate them to Dutch (the non-creative but culturally aware part). This works much better as we can pick models that are good at one thing or tuned to do this one thing better (either by the LLMAAS provider, or by parameters such as temperature).

Re:AI is becoming 'yes-men on servers' by eru on Wednesday March 12, 2025 @08:55AM (#43342711)
> Some of the examples are still wrong. Nuanced, but a Dutch native will still frown at it.

Thanks, that why I posted the links here: I couldn't judge by myself how good these creations were.

> But more importantly is that you limited the context a lot. As in: the scope, the prompt, is very narrow.

Yes, I just did a very crude experiment.