#deep-learning
4 posts
Elements of Neural Nets: Building Blocks of AI
An essential guide to the foundational components of modern neural networks — activations, cost functions, optimizers, and regularization.
Self-Attention Mechanism
Visual walkthrough of single-headed and multi-headed self-attention — understanding the matrix dimensions and operations.
Building the Transformer from Scratch
An object-oriented implementation of the complete Transformer architecture in PyTorch — from input embeddings to the full encoder-decoder model.
Implementing Transformers
A practical guide to coding the Transformer architecture from scratch — turning the 'Attention is All You Need' paper into working code.