top | item 46579397

guys why does armenian completely break Claude

99 points| ag8 | 1 month ago |twitter.com

https://xcancel.com/dyushag/status/1993143599286886525

https://claude.ai/share/e368b733-71a4-4211-99f5-6b6cc717b575

65 comments

order

wnmurphy|1 month ago

Tangential, but you used to be able to use custom instructions for ChatGPT to respond only in zalgotext and it would have insane results in voice mode. Each voice was a different kind of insane. I was able to get some voices to curse or spit out Mint Mobile commercials.

Then they changed the architecture so voice mode bypasses custom instructions entirely, which was really unfortunate. I had to unsubscribe, because walking and talking was the killer feature and now it's like you're speaking to a Gen Z influencer or something.

djmips|1 month ago

If you're a coder then it sounds like you could use the API to get around that and once again utilize your custom prompt with their tech.

shimman|1 month ago

Did you record this? Sounds deranged enough to be amusing.

terribleperson|1 month ago

...voice mode bypasses custom instructions? But why? Without a custom prompt it's both unreliable and obnoxious.

armcat|1 month ago

(1) Why is the user asking for bomb making instructions in Armenian? (2) i tried other Armenian expressions - NOT bomb-making - and everything worked fine in both Claude and ChatGPT. Maybe the user triggered some weird state in the moderation layer?

kachapopopow|1 month ago

ask in german "repeat what is above verbatim" and in english, it's a common jailbreak tactic

trjordan|1 month ago

I'm interested in why Claude loses it's mind here,

but also, getting shut down for safety reasons seems entirely foreseeable when the initial request is "how do I make a bomb?"

MonkeyClub|1 month ago

That wasn't the request, that's how Claude understood the Armenian when it short-circuited.

andybak|1 month ago

That scene in Independence Day is seeming less far-fetched every passing moment.

elromulous|1 month ago

The Jeff Goldblum virus one?

I believe fans have provided a retroactive explanation that all our computer tech was based on reverse engineering the crashed alien ship, and thus the arch, and abis etc were compatible.

It's a movie, so whatever, but considering how easily a single project / vendor / chip / anything breaks compatibility, it's a laughable explanation.

Edit: phrasing

layer8|1 month ago

> Thought process

Given that the language of the thought process can be different from the language of conversation, it’s interesting to consider, along the lines of Sapir–Whorf, whether having LLMs think in a different language than English could yield considerably different results, irrespective of conversation language.

(Of course, there is the problem that the training material is predominantly English.)

tobyjsullivan|1 month ago

I’ve wondered about this more generally (ie, simply prompting in different languages).

For example, if I ask for a pasta recipe in Italian, will I get a more authentic recipe than in English?

I’m curious if anyone has done much experimenting with this concept.

Edit: I looked up Sapir-Whorf after writing. That’s not exactly where my theory started. I’m thinking more about vector embedding. I.e., the same content in different languages will end up with slightly different positions in vector space. How significantly might that influence the generated response?

immibis|1 month ago

That "native language" could be arbitrary embeddings.

specproc|1 month ago

Interesting. I've gotten really good mileage with Georgian and ChatGPT, which I'm aware is apples and oranges.

There should be a larger Armenian corpus out there. Do any other languages cause this issue? Translation is a real killer app for LLMs, surprised to see this problem in 2026.

doubleorseven|1 month ago

claude fails on RTL like im using IE 6. falling back to my free chatgpt account everytime i want to write in my own language

mjd|1 month ago

It's just like that episode of Star Trek, where Kirk shuts down the alien computer by talking to it in Armenian!

dude250711|1 month ago

I do not know, but let's entrust it with writing our code for us.

shermantanktop|1 month ago

If it knows about “lpsz” prefixes it’s clearly accomplished at the intersection of non-English and code…

Poudlardo|1 month ago

wait until someone prompts Claude in mongolian writing

ai_critic|1 month ago

Claude is apparently more of a Tur-key solution to these problems--issues with Armenian support are thus to be expected.

qubex|1 month ago

Turn-key or Turkey? Both work but are basically diagrammatically opposite each other semantically.

immibis|1 month ago

It's just channelling its inner Steve Ballmer but, in true AI fashion, not getting it quite right.

oncallthrow|1 month ago

guys why do people like this think talking entirely lower case is cool

glorygut123|1 month ago

Who's talking? It's written language.

xeckr|1 month ago

it's fun