📖 On Scalar Embedding of Relative Positions in Attention Models

Environment Setting

The python environment is as follows:

python3.6, tensorflow-gpu==1.15

pip install:

pip install -r requirements.txt

Tasks

Question Answering

cd question_answering

Artificial Task & Text Classification

cd text_classification

Machine Translation

cd machine_translation

Acknowledgement

If you find this project helpful, consider citing our paper:

Junshuang Wu, Richong Zhang, Yongyi Mao, and Junfan Chen. On Scalar Embedding of Relative Positions in Attention Models. In Proceedings of AAAI 2021.