[jameson]

> struggles with Japanese

It doesn't mention mistranslating, so it's difficult to know the root of the problem is AI "struggling".

> It doesn't follow our translation guidelines. > It doesn't respect current localization for Japanese users, so they were lost.

I believe this is the root of the problem. There are define processes and guidelines, and LLM isn't following it. Whether these guidelines were prompted or not is unclear but regardless it should've been verified by the community leaders before it's GA'ed

[numpad0]

That's not the root of the problem. The root of the problem is that LLMs just can't constitute a punctually Japanese understanding of text like that guideline and speak in Japanese with native fluency no matter what. I just know this from knowing both sides of English-Japanese language pair. And I find that somewhat fascinating in a sense.

[MountainTheme12]

I'm surprised by that. I use ChatGPT for communication with Japanese clients and I was mistaken for a native speaker more than once. I make almost no corrections other than changing the punctuation from western to fullwidth, although to be fair it's mostly simple and technical language.

[ChadNauseam]

Wow. That's crazy. I would be very interested in a blog post on this subject if you ever wrote one. I wonder how this affects the perception of LLMs in Japan

[mminer237]

I took this to mean it's not translating things consistently. Like, a button in Firefox might say "Show all downloads" or "Open previous windows and tabs". These were localized a certain way, but an AI has no ability to check that. It will just translate them anew, which might be the same or it might translate it to something synonymous, but which then confuses users searching for the "Display all downloads" button or whatever.