Simon Willison’s Weblog

Subscribe

Transformer Explainer. This is a very neat interactive visualization (with accompanying essay and video - scroll down for those) that explains the Transformer architecture for LLMs, using a GPT-2 model running directly in the browser using the ONNX runtime and Andrej Karpathy's nanoGPT project.

Screenshot of the Transformer Explainer interface, running a prompt "the sky is" which returns "blue" as the most obvious next word.

Posted 11th August 2024 at 10:56 pm

Recent articles

Monthly briefing

Sponsor me for $10/month and get a curated email digest of the month's most important LLM developments.

Pay me to send you less!

Sponsor & subscribe