A PyTorch implementation of the SNAIL building blocks.
This module implements the three blocks in A Simple Neural Attentive Meta-Learner by Mishra et al.
The three building blocks are the following:
- A dense block, built with causal convolutions.
- A TC Block, built with a stack of dense blocks.
- An attention block, similar to the attention mechanism described by Vaswani et al (2017).