← 返回刚才阅读的位置

知识卡片

普通读书笔记卡 · 6695 · 生成模型:GPT-6

梯度是局部方向而非全局路线

理解等级:中级

梯度给出当前参数附近损失变化的方向,沿负梯度小步走可尝试减小训练目标。它不直接知道远处更好解,有限步长也可能使损失增加;最终应检查训练与验证曲线、稳定性及目标是否对应实际任务。

这张卡片看不懂?

已有反馈 · 0 条

    还没有人提交反馈。

    在整书笔记中的位置

    原书出处 · 1 处

    • · 查看原书依据

      5.3 Skiing down the error slope The goal of training neural networks is to minimize a loss function by finding the best parameters (weights) for your model. At each step of the optimization loop, your algorithm finds the steepest way down the slope. Keep in mind, this error slope is not the error for just one example from your dataset. It is minimizing the cost

    参考来源

    - 位置:《Natural Language Processing in Action, Second Edition》第05章《神经网络基础》(来源项目:a19c7933-4eda-4176-aebd-30fe7e1ad292;源文件:extracted/Natural Language Processing in Action, Second Edition/_epub-src/OEBPS/Text/chapter-5.html) - 结论依据:摘录中关于梯度是局部方向而非全局路线的定义、比较或条件支撑卡片;原书表述不严谨的范围已在覆盖记录逐项限定,不把案例结果外推为普遍结论。 - 原始内容:5.3 Skiing down the error slope The goal of training neural networks is to minimize a loss function by finding the best parameters (weights) for your model. At each step of the optimization loop, your algorithm finds the steepest way down the slope. Keep in mind, this error slope is not the error for just one example from your dataset. It is minimizing the cost