Possible Error in Answer Key of Chapter 1
JinalShah2002 opened this issue · 1 comments
JinalShah2002 commented
For question number 6 in Chapter 1 (How does the weight update of all the weights across layers happen during back-propagation?), the answer key states the answer to be "It happens using the formula dW = W - alpha * (dW/dL)" (Appendix Pg 1). However, from my understanding, I believe the answer should be W = W - alpha * (dL/dW). This is because each weight is being adjusted by a small amount (alpha * dL/dW). Furthermore, each weight is being adjusted via its effects of its change on the loss (dL/dW).