Transformer
===========

Implement a basic transformer architecture based on the original paper by `Vaswani et al. (2017) <https://proceedings.neurips.cc/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf>`_.
The implementation of the positional encodings adapted from corresponding `PyTorch tutorial <https://pytorch.org/tutorials/beginner/transformer_tutorial.html>`_.

Transformer Module Documentation
================================

.. automodule:: nlp_uncertainty_zoo.models.transformer
   :members:
   :show-inheritance:
   :undoc-members: