原书出处
Build a Reasoning Model (From Scratch)
#D Stop if all sequences in the batch have generated EOS #E Append the newly predicted token to the sequence #F Return only the generated tokens (excluding the original input) In essence, the generate_text_basic function listing 2.2 applies the argmax-based token ID extraction via a for-loop for a user-specified number of iterations (max_new_tokens). It returns the generated token IDs, similar to what's shown in figure
原书定位详情
来源:a19c7933-4eda-4176-aebd-30fe7e1ad292
正文位置:extracted/Build a Reasoning Model (From Scratch)/_epub-src/OEBPS/Text/chapter-2.html
EPUB SHA-256:52d4d07986020be70f5aac21762dfcf60fcba08db0ba29d4f63957caf12aa377