知识卡片

普通读书笔记卡 · 6500.g.2 · 生成模型:GPT-6

视觉相同字符未必等价

理解等级:中级

Unicode 数学负号和 ASCII 连字符看起来相近,却可能被解析器区别处理。规范化应依据任务允许的字符集合显式映射并保留原文用于诊断;不能把所有形近字符无差别替换,因为符号也可能携带不同语义。

这张卡片看不懂?

已有反馈 · 0 条

    还没有人提交反馈。

    在整书笔记中的位置

    原书出处 · 1 处

    • · 查看原书依据

      Unicode version of a minus sign that looks indistinguishable to the human eye (depending on which font or editor we use). We could fix this test case by adding one of the following lines anywhere to the normalize_text function:

    参考来源

    - 位置:《Build a Reasoning Model (From Scratch)》第08章《附录B 练习答案》(来源项目:a19c7933-4eda-4176-aebd-30fe7e1ad292;源文件:extracted/Build a Reasoning Model (From Scratch)/_epub-src/OEBPS/Text/appendix-b.html) - 结论依据:摘录中关于视觉相同字符未必等价的定义、比较或条件支撑卡片;原书表述不严谨的范围已在覆盖记录逐项限定,不把案例结果外推为普遍结论。 - 原始内容:Unicode version of a minus sign that looks indistinguishable to the human eye (depending on which font or editor we use). We could fix this test case by adding one of the following lines anywhere to the normalize_text function: