top | item 45860048

(no title)

reyqn | 3 months ago

And is also not using an LLM. It's neural machine translation.

discuss

order

superkuh|3 months ago

NMT is a category containing both transformers and deep RNN. The Mozilla translation models are transformer LLM NMTs trained via Marian https://marian-nmt.github.io/ (ref: https://github.com/mozilla/translations/blob/main/docs/READM...)

reyqn|3 months ago

NMT doesn't "contain" tranformers and deep RNNs, it can use them. LLMs use a transformer architecture, not everything using a transformer architecture is an LLM. NMT can actually use an LLM, but that's not the case according to the documentation you linked, they use a parallel dataset to train their models.