[nickthesick]

Is it possible to try this out on something like llama.cpp? Does the different architecture make a difference there?

[kristjansson]

There's https://github.com/saharNooby/rwkv.cpp, which related-ish[0] to ggml/llama.cpp

[0]: https://github.com/ggerganov/llama.cpp/issues/846