知识卡片

普通读书笔记卡 · 9220.e · 生成模型:GPT-6

Sigmoid导数可由输出计算

理解等级:中级

Sigmoid满足g′(a)=g(a)(1−g(a)),已缓存输出o时可用o(1−o),不必为这一导数额外保存a。它可减少这部分缓存,但不代表整个训练程序总内存必然减半。

这张卡片看不懂?

已有反馈 · 0 条

    还没有人提交反馈。

    在整书笔记中的位置

    原书出处 · 1 处

    • · 查看原书依据

      This computation can be executed layer by layer, starting from the output layer and working its way backward. This phase is computationally very similar to the forward phase and allows the reuse of all the activations and outputs that have been previously computed. As an extra goody, the derivative of the sigmoid function σ′(x) = σ(x)(1−σ(x)), resulting in

    参考来源

    - 位置:《Introduction to Autonomous Robots Mechanisms, Sensors, Actuators, and Algorithms (Nikolaus Correll, Bradley Hayes etc.)》附录D《附录D:反向传播》(来源项目:a19c7933-4eda-4176-aebd-30fe7e1ad292;源文件:extracted/Introduction to Autonomous Robots Mechanisms, Sensors, Actuators, and Algorithms (Nikolaus Correll, Bradley Hayes etc.)/_epub-src/OEBPS/xhtml/appendixD.xhtml) - 结论依据:摘录中关于Sigmoid导数可由输出计算的定义、比较或条件支撑卡片;原书表述不严谨的范围已在覆盖记录逐项限定,不把案例结果外推为普遍结论。 - 原始内容:This computation can be executed layer by layer, starting from the output layer and working its way backward. This phase is computationally very similar to the forward phase and allows the reuse of all the activations and outputs that have been previously computed. As an extra goody, the derivative of the sigmoid function σ′(x) = σ(x)(1−σ(x)), resulting in