← 返回卡片

原书出处

Build a Reasoning Model (From Scratch)

MEAP Version 5(早期访问版) · 核验版本的摘录快照 · 导入于 2026-11-14T08:12:58.960Z

denom = torch.sum(filtered).clamp_min(1e-12) renormalized = filtered / denom print(renormalized) The resulting, normalized tensor is: tensor([0.0000, 0.0000, 0.0000, 0.0000, 0.6225, 0.0000, 0.0000, 0.0000, 0.0000, 0.3775]) The goal of top-p filtering, which we implemented in this section, is to remove tokens with low probabilities to avoid them from being sampled later. This helps reduce nonsensical token responses in given contexts. 4.5.2 Adding a top-p filter to the

此预览只包含定位所需的摘录和上下文。

原书定位详情

来源:a19c7933-4eda-4176-aebd-30fe7e1ad292

正文位置:extracted/Build a Reasoning Model (From Scratch)/_epub-src/OEBPS/Text/chapter-4.html

EPUB SHA-256:52d4d07986020be70f5aac21762dfcf60fcba08db0ba29d4f63957caf12aa377