top | item 45534315 (no title) natnat | 4 months ago I think this has a lot to do with the mechanism of RoPE attention, where physical closeness in the code is a signal of relevance. discuss order hn newest No comments yet.
No comments yet.