知识卡片

普通读书笔记卡 · 8676.b · 生成模型:GPT-6

采样多样性与事实风险要实测

理解等级:中级

更随机的解码可能增加某些任务的错误,贪心也可能稳定地产生错误。应在同一模型、提示与评估集上比较事实性和多样性;书中研究结果不构成所有任务关闭采样都会更好的保证。

这张卡片看不懂?

已有反馈 · 0 条

    还没有人提交反馈。

    在整书笔记中的位置

    原书出处 · 1 处

    • · 查看原书依据

      top-p sampling leads to more hallucinations compared to greedy decoding. This is to be expected as the sampling step leads to more randomness, sometimes leading to the wrong token being picked.

    参考来源

    - 位置:《Designing Large Language Model Applications》第08章《对齐训练与推理》(来源项目:a19c7933-4eda-4176-aebd-30fe7e1ad292;源文件:extracted/Designing Large Language Model Applications/_epub-src/OEBPS/ch08.html) - 结论依据:摘录中关于采样多样性与事实风险要实测的定义、比较或条件支撑卡片;原书表述不严谨的范围已在覆盖记录逐项限定,不把案例结果外推为普遍结论。 - 原始内容:top-p sampling leads to more hallucinations compared to greedy decoding. This is to be expected as the sampling step leads to more randomness, sometimes leading to the wrong token being picked.