I am studying once again NN and back-propagation. Any paper out of there that compares standard grandient descend update rule (delta rule), with the one where you add a momentum?
Any other suggestions for different update rules?
Backed Or Whacked: Reading And Writing Through Crowdfunding - [image: Backed or Whacked logo]*Editor’s note: **Ross Rubin is principal analyst at Reticle Research and blogs at Techspressive.* An ancient and once-sacre...
4 hours ago