原书出处
Foundations of Computer Vision (Antonio Torralba, Phillip Isola etc.)
SGD can jump over small bumps in the loss landscape, as long those bumps disappear for some randomly sampled batches. Another important property is that SGD can implicitly regularize the learning problem. For example, for linear problems (i.e., fθ is linear), then if there are multiple parameter settings that minimize the loss, SGD will often converge to the solution with minimum parameter norm [517].
原书定位详情
来源:a19c7933-4eda-4176-aebd-30fe7e1ad292
正文位置:extracted/Foundations of Computer Vision (Antonio Torralba, Phillip Isola etc.)/_epub-src/OPS/xhtml/c010.xhtml
EPUB SHA-256:60a7eebc43f5d9a675d776fed3736fbdaa791e55877023f2f8cba016a9b384f8