原书出处
Introduction to Algorithms, Fourth Edition
33 第33章 机器学习算法
properties of the function, to the initial point, and to the step size of the algorithm.
The procedure GRADIENT-DESCENT on the facing page takes as input a function f, an initial point x(0) ∈ ℝn, a fixed step-size multiplier γ > 0, and a number T > 0 of steps to take. Each iteration of the for loop of lines 2–4 performs a step by computing the n-dimensional gradient at point x(t) and then moving distance γ in the opposite direction in the n-dimensional space. The complexity of computing the gradient depends on the function f and can sometimes be expensive. Line 3 sums the points visited. After the loop terminates, line 6 returns x-avg, the average of all the points visited except for the last one, x(T). It might seem more natural to return x(T), and in fact, in many circumstances, you might prefer to have the function return x(T). For the version we will analyze, however, we use x-avg. G
RADIENT-DESCENT(f, x(0), γ, T) 1 sum = 0 // n-dimensional vector, initially all 0 2 for t
原书定位详情
来源:a19c7933-4eda-4176-aebd-30fe7e1ad292
正文位置:extracted/Introduction to Algorithms, Fourth Edition/_epub-src/OEBPS/chapter033.xhtml
EPUB SHA-256:ec7ced04bb875b93983816aef7a667855a4b71c5cf53b63406b9439c74e27aea