知识卡片

普通读书笔记卡 · 3710.f.1

梯度由各坐标偏导组成

理解等级:初级

对f:ℝⁿ→ℝ,梯度∇f是由n个偏导数组成的向量。在可微点,它指向函数局部增长最快的方向;负梯度给出局部下降方向,但“局部”结论需要可微等条件。

这张卡片看不懂?

已有反馈 · 0 / 10 条

    还没有人提交反馈。

    在整书笔记中的位置

    原书出处 · 1 处

    • 第33章 机器学习算法 · 查看原书依据

      Given a function f : ℝn → ℝ, its gradient ∇f is a function ∇f : ℝn → ℝn comprising n partial derivatives: . Analogous to the derivative of a function of a single variable, the gradient can be viewed as a direction in which the function value locally increases the fastest, and the rate of that increase. This view is informal; in order to make it formal we would have to define what local means and place certain conditions, such as continuity or existence of derivatives, on the function. Nevertheless, this view motivates the key step of gradient descent—move in the direction opposite to the gradient, by a distance influenced by the magnitude of the

    参考来源

    - 位置:《算法导论(第4版)》第33章《机器学习算法》(OEBPS/chapter033.xhtml,文本字符[40000,45000))。 - 结论依据:原文第33.2节加权多数算法与势能证明,或第33.3节梯度、步长和局部极小讨论;相关公式图已核对。 - 原始内容:Given a function f : ℝ n → ℝ , its gradient ∇ f is a function ∇ f : ℝ n → ℝ n comprising n partial derivatives: . Analogous to the derivative of a function of a single variable, the gradient can be viewed as a direction in which the function value locally increases the fastest, and the rate of that increase. This view is informal; in order to make it formal we would have to define what local means and place certain conditions, such as continuity or existence of derivatives, on the function. Nevertheless, this view motivates the key step of gradient descent—move in the direction opposite to the gradient, by a distance influenced by the magnitude of the