知识卡片
提示漂移需要联合版本记录
同一提示在模型、服务配置或输入分布变化后可能产生不同表现。应将提示与模型标识、参数、样本和判据一起版本化,并在变化时重新评估;仅保存提示文本不能复现全部行为。
这张卡片看不懂?
这张卡片已通过人工审查,不再接受失败反馈。
已有反馈 · 0 条
还没有人提交反馈。
在整书笔记中的位置
- · 大语言模型入门
原书出处 · 1 处
- · 查看原书依据
model changes. You might painstakingly construct a prompt that seems to work well, but you might notice that the same prompt does not work for a different model. In fact, the same prompt might see degraded performance on the same API endpoint if the underlying model is updated in the meanwhile. We call this prompt drift. It is a good idea to version control prompts.
参考来源
- 位置:《Designing Large Language Model Applications》第01章《大语言模型入门》(来源项目:a19c7933-4eda-4176-aebd-30fe7e1ad292;源文件:extracted/Designing Large Language Model Applications/_epub-src/OEBPS/ch01.html)
- 结论依据:摘录中关于提示漂移需要联合版本记录的定义、比较或条件支撑卡片;原书表述不严谨的范围已在覆盖记录逐项限定,不把案例结果外推为普遍结论。
- 原始内容:model changes. You might painstakingly construct a prompt that seems to work well, but you might notice that the same prompt does not work for a different model. In fact, the same prompt might see degraded performance on the same API endpoint if the underlying model is updated in the meanwhile. We call this prompt drift. It is a good idea to version control prompts.