[archermarks]

Really nice article! This clarified a lot to me about how positional embeddings work and how other useful context might be embedded in other models.