← 返回卡片

原书出处

Build a Reasoning Model (From Scratch)

MEAP Version 5(早期访问版) · 核验版本的摘录快照 · 导入于 2026-11-14T08:12:58.965Z

#A Match HF behavior: chat model: <|im_end|>, base model: <|endoftext|> #B insert no <think> tag, just a new line Note that my Qwen3Tokenizer reimplementation in listing C.9 may appear somewhat complicated, as it aims to replicate the behavior of the official tokenizer released by the Qwen3 team in the Hugging Face Transformers library. At first glance, it appears to have a few quirks. For example,

此预览只包含定位所需的摘录和上下文。

原书定位详情

来源:a19c7933-4eda-4176-aebd-30fe7e1ad292

正文位置:extracted/Build a Reasoning Model (From Scratch)/_epub-src/OEBPS/Text/appendix-c.html

EPUB SHA-256:52d4d07986020be70f5aac21762dfcf60fcba08db0ba29d4f63957caf12aa377