[talos]

I don't think OP's idea would work, but if it did you could just ask for a translation.

[privatelypublic]

In what language? The model wouldn't speak english.

[tinco]

In English. The decoder translates from the Dhofari to tokens the LLM understands. So you present the LLM with the decoded Dhofari, and a question in English, like "Please express the following in modern English" and the LLM would answer in English. There's also a chance the decoded Dhofari would be intelligible to humans directly, though I don't know how large that chance is.