Show HN: Every number in a tiny GPT, from one forward pass to one step of RLHF

Category: ai-ml

Tags: llm, visualization, education, transformer, interactive

Score: 6.7/10 (Innovation: 6, Technical: 7, Documentation: 5, Utility: 7)

An interactive web-based visualization that walks through every numerical computation in a tiny GPT model, from tokenization and forward pass to a training step and a PPO iteration for RLHF. It aims to demystify the internals of transformer models by showing live calculations and hovering details, making it a valuable educational tool for understanding LLMs.

Target audience: machine learning students and educators, AI engineers

Repository: https://llm.manogya.dev

View on Hacker News