What a neural layer actually does
A matrix multiply is a layer; it rotates / scales the vector.
1This row of weights multiplies the input. Will its output land up, near zero, or down?your turn
One weight row times the input vector. Predict the output.
→ continue← backR replay
Stack many layers and the signal gets lost…
3.7 Keeping the signal aliveBuilds on1.3Measuring meaning with one number
Common questions
What is "What a neural layer actually does" about?
A matrix multiply is a layer; it rotates / scales the vector.
What problem does it solve?
What is the 'feed-forward' block actually doing?
What will I be able to do after this lesson?
You can explain that a neural layer is a matrix that reshapes a vector.
What comes next?
Stack many layers and the signal gets lost…