top | item 45534315

(no title)

natnat | 4 months ago

I think this has a lot to do with the mechanism of RoPE attention, where physical closeness in the code is a signal of relevance.

discuss

order

No comments yet.