Backpropagation Visualizer
Walk through forward and backward propagation in a 2→2→1 neural network. See exactly how gradients flow through each weight using the chain rule.
Network
Input x₁
Input x₂
Target y
Intermediate Values
Click "Forward Pass" to compute forward propagation.
Weight Gradients
∂L/∂w₁₁
—
∂L/∂w₁₂
—
∂L/∂w₂₁
—
∂L/∂w₂₂
—
∂L/∂wₕ₁
—
∂L/∂wₕ₂
—
Chain rule in action: Backpropagation
computes gradients by applying the chain rule from the
output backward. Each gradient tells us how much a small
change in that weight would affect the loss. The network
then updates weights in the direction that
reduces the loss.
What's happening here? Think of the
network as a team of coworkers passing a message down a
chain. Forward pass: the message starts
at the inputs (x₁, x₂), each person multiplies it by
their own importance factor (weight), adds their
personal bias, and passes it to the next person. At the
end, the output comes out — and we compare it to what we
WANTED (the target). The difference is the
loss (the mistake).
Backward pass: now each person asks:
"How much of this mistake was MY fault?" They figure it
out by looking backward at who passed them the message
and how much they amplified it. That's the
chain rule — like figuring out who in
the chain dropped the ball. The redder a connection, the
more that weight contributed to the error. The greener
it is, the more it helped. Click "Forward Pass" first to
see the numbers flow, then "Backward Pass" to see who
gets blamed.
Premium · From the makers of ReLU.chat
On-Device Chatbot Builder Toolkit
Interactive demos teach one concept at a time. The
On-Device Chatbot Builder Toolkit gives you the full
system: frameworks, templates, and evaluation guides for
building your own privacy-first chatbot that runs
entirely on-device.
Get the Toolkit · $29