[ex3ndr]

I am wondering why flash attention is like 5x slower with variable masking than without it? Lack of good masking support almost zeros out the optimizations

[chillee]

Where are you seeing these benchmarks?