Ganesh Epili
Search
⌘
K
Blog
Projects
Newsletter
About Me
← Blog
Transformers From Scratch, Part 3: The 2017 Architecture, Assembled
July 25, 2026
·
20 min read
SERIES
/
Transformers From Scratch
·
Part 3 of 6
‹ Part 2
Attention Is the Whole Game
Part 4›
The Family Tree (BERT, GPT & T5)
Transformers From Scratch — all 6 parts
01
Why Attention Exists
02
Attention Is the Whole Game
03
The 2017 Architecture, Assembled
You are here
04
The Family Tree (BERT, GPT & T5)
05
What Changed Since 2017
06
From Architecture to ChatGPT