[trextrex]

I'm not clear on what advantage this architecture has over mamba/Griffin. They also have the linear scaling, better sequence parallelism and are competitive in performance with transformers.

[lalaland1125]

The whole field seems to be having issues with comparisons right now.

We really don't even know how Mamba vs Griffin compare.

[wave_1]

state tracking...