知识卡片
红队授权范围与修复回归相连
授权的对抗测试可由不同于开发者的人员构造边界输入,记录成功条件、版本和复现,再交给维护者修复与回归。它用于发现防线缺口,不是一次测试后保证以后安全;公开错例失效也不表示整个攻击类别消失。
这张卡片看不懂?
这张卡片已通过人工审查,不再接受失败反馈。
已有反馈 · 0 条
还没有人提交反馈。
在整书笔记中的位置
原书出处 · 1 处
- · 查看原书依据
Relying on filters and your users to find bugs is not an option if your bot could potentially endanger the welfare of people or businesses. To prevent some of the most harmful things an LLM might say, you will likely need a red team to attempt to bypass or disable these guardrails. A red team is an engineer or team you have authorized to interact
参考来源
- 位置:《Natural Language Processing in Action, Second Edition》第10章《真实世界中的大语言模型》(来源项目:a19c7933-4eda-4176-aebd-30fe7e1ad292;源文件:extracted/Natural Language Processing in Action, Second Edition/_epub-src/OEBPS/Text/chapter-10.html)
- 结论依据:摘录中关于红队授权范围与修复回归相连的定义、比较或条件支撑卡片;原书表述不严谨的范围已在覆盖记录逐项限定,不把案例结果外推为普遍结论。
- 原始内容:Relying on filters and your users to find bugs is not an option if your bot could potentially endanger the welfare of people or businesses. To prevent some of the most harmful things an LLM might say, you will likely need a red team to attempt to bypass or disable these guardrails. A red team is an engineer or team you have authorized to interact