Mar 16, 2024
KaistAI/Semiparametric_Token-Sequence_Co-Supervision
Posted by Cecile G. Tamura in category: space
“Semiparametric Token-Sequence Co-Supervision”
We introduce semiparametric token-sequence co-supervision, which trains LM by simultaneously leveraging supervision from a parametric token and a nonparametric sequence embedding space.
✅ Paper: https://arxiv.org/abs/2403.09024 ✅ Code: https://avatars.githubusercontent.com/u/44370759?s=64&v=4
Continue reading “KaistAI/Semiparametric_Token-Sequence_Co-Supervision” »