Transformers & LLMs
Attention mechanisms, large language models, and the architectures behind modern AI.
3 articles / papers
The building blocks of modern language and multimodal models — self-attention, positional encoding, and the encoder-decoder stack.
Covered in
article · July 2026
Notes on Scaling Laws
Quick notes on how model performance scales with parameters, data, and compute.
paper · July 2026Attention Is All You Need
Review of the seminal transformer paper that introduced self-attention as the sole mechanism for sequence transduction.
article · July 2026Hello World: First Article
A test article to verify the MDX pipeline works end-to-end.