知识卡片
教师知识可来自不同位置
教师学习可让学生匹配教师输出,也可以匹配中间激活。迁移的对象于是从已有参数扩展为行为或表示。教师与学生架构可以不同,但需要定义可比较的目标与损失;教师预测是训练信号,不自动等同真实答案。
这张卡片看不懂?
这张卡片已通过人工审查,不再接受失败反馈。
已有反馈 · 0 条
还没有人提交反馈。
在整书笔记中的位置
- · 迁移学习与适配
原书出处 · 1 处
- · 查看原书依据
One way of formalizing this setting is to consider the teacher as a well-trained model t : X → Y that maps input queries to output answers. The student (the learner) observes both data and has access to the teacher model t. The student can learn to imitate the teacher's outputs or can learn to match how the teacher processes the queries, matching intermediate activations
参考来源
- 位置:《Foundations of Computer Vision (Antonio Torralba, Phillip Isola etc.)》第37章《迁移学习与适配》(来源项目:a19c7933-4eda-4176-aebd-30fe7e1ad292;源文件:extracted/Foundations of Computer Vision (Antonio Torralba, Phillip Isola etc.)/_epub-src/OPS/xhtml/c037.xhtml)
- 结论依据:摘录中关于教师知识可来自不同位置的定义、比较或条件支撑卡片;原书表述不严谨的范围已在覆盖记录逐项限定,不把案例结果外推为普遍结论。
- 原始内容:One way of formalizing this setting is to consider the teacher as a well-trained model t : X → Y that maps input queries to output answers. The student (the learner) observes both data and has access to the teacher model t. The student can learn to imitate the teacher's outputs or can learn to match how the teacher processes the queries, matching intermediate activations