[danielhanchen]

Unsure but yes most likely they use YaRN, and maybe trained a bit more on long context maybe (or not)