transformer-rec

Transformer-based Recommenders

Concepts

• Language modeling approaches
• Attention mechanism
• Transformers
• Stochastic shared embeddings
• GeLU activation

Baselines

• GRU4Rec
• Caser
• NARM

Models

• SASRec
• BERT4Rec
• BST
• SSE-PT
• DMT
• MATN
• GC-SAN
• SR-SAN

Case studies

• Santander
• Taobao
• Scribd
• 1mg

Tutorials

• Language Modeling with nn.Transformer and TorchText
• Transformer from scratch in PyTorch
• BERT4Rec on ML-1m in PyTorch
• BERT4Rec on ML-25m in PyTorch Lightning
• BST on ML-1m in PyTorch
• BST in PyTorch
• BST in MXNet
• BST on ML-1m in Keras
• BST in Deepctr
• SSE-PT on ML-1m in Tensorflow
• SASRec on ML-1m in PaddlePaddle
• SASRec in PyTorch
• SR-SAN on Yoochoose and Diginetica in PyTorch
• GC-SAN in PyTorch
• MATN on Yelp in Tensorflow
• Transformers4Rec Session-based Recommender on Yoochoose
• Transformers4Rec XLNet on Synthetic data
• Transformers4Rec session-based recommender on REES46