200404 Neural Architecture Search for Lightweight Non-Local Networks.md

https://arxiv.org/abs/2004.01961

Neural Architecture Search for Lightweight Non-Local Networks (Yingwei Li, Xiaojie Jin, Jieru Mei, Xiaochen Lian, Linjie Yang, Cihang Xie, Qihang Yu, Yuyin Zhou, Song Bai, Alan Yuille)

nonlocal block을 경량화하고(depthwise conv 사용 등) 서치하기. empirical attention(https://arxiv.org/abs/1904.05873)이나 gcnet(https://arxiv.org/abs/1904.11492)의 결과를 결합하는 것도 재미있을지도.

#attention