知识卡片
生产标签回流要保留样本对应
设计时就保存预测、特征与后续真实结果的关联,才能持续评价和再训练。自然标签到达可能有延迟且只覆盖部分样本;回流需要质量和偏差检查,不能把所有反馈自动当无误真值。
这张卡片看不懂?
这张卡片已通过人工审查,不再接受失败反馈。
已有反馈 · 0 条
还没有人提交反馈。
在整书笔记中的位置
原书出处 · 1 处
- · 查看原书依据
Closing the data collection loop As we train and deploy models, our ML system design should also take into consideration how we will collect and curate the model’s predictions in production, so that we can label them and grow high-quality ground truth for evaluating and retraining models. Labeling can be a tedious activity and is often the bottleneck. If so, we can also consider how
参考来源
- 位置:《Effective Machine Learning Teams (David Tan, Ada Leung, David Colls)》第01章《机器学习交付的挑战与路径》(来源项目:a19c7933-4eda-4176-aebd-30fe7e1ad292;源文件:extracted/Effective Machine Learning Teams (David Tan, Ada Leung, David Colls)/_epub-src/OEBPS/ch01.html)
- 结论依据:摘录中关于生产标签回流要保留样本对应的定义、比较或条件支撑卡片;原书表述不严谨的范围已在覆盖记录逐项限定,不把案例结果外推为普遍结论。
- 原始内容:Closing the data collection loop As we train and deploy models, our ML system design should also take into consideration how we will collect and curate the model’s predictions in production, so that we can label them and grow high-quality ground truth for evaluating and retraining models. Labeling can be a tedious activity and is often the bottleneck. If so, we can also consider how