Conv-basis: A new paradigm for efficient attention inference and gradient computation in transformers (arXiv 2024)

Jiuxiang Gu, Yingyu Liang, Heshan Liu, Zhenmei Shi, Zhao Song, Junze Yin

January 2024