attention-is-all-you-need-from-scratch

Building attention from scratch in PyTorch and jax from https://arxiv.org/pdf/1706.03762

Name		Name	Last commit message	Last commit date
Latest commit History 2 Commits
Feedforward.py		Feedforward.py
README.md		README.md
__init__.py		__init__.py
attention mechanism.py		attention mechanism.py
decoder.py		decoder.py
encoder.py		encoder.py
tokenizer.py		tokenizer.py
transformer.py		transformer.py
utils.py		utils.py

Navigation Menu