https://arxiv.org/abs/2103.06255
Involution: Inverting the Inherence of Convolution for Visual Recognition (Duo Li, Jie Hu, Changhu Wang, Xiangtai Li, Qi She, Lei Zhu, Tong Zhang, Qifeng Chen)
We additionally demystify the recent popular self-attention operator and subsume it into our involution family as an over-complicated instantiation. 앱스트랙이 아주 공격적이네요.
#backbone #convolution #attention