WebGL Visualization of Transformer Model (Experimental)
Transformer Model 3D Visualization
Click and drag to rotate
Scroll to zoom
Click and drag to rotate
Scroll to zoom
The Blue block is the Input Embeddings, the Red Blocks are Attention Heads, The Large Green Block is the Hidden Feed Forward Network and the Little Green Block is the Feed Forward Network Output.