Eagle and Finch.

RWKV with Matrix-Valued States and Dynamic Recurrence.

We present Eagle (RWKV-5) and Finch (RWKV-6), sequence models improving upon the RWKV (RWKV-4) architecture.

---

Join the discussion on this paper page.