原书出处
Build a Reasoning Model (From Scratch)
start = len(prompt_ids) - 1 #C end = full_ids.shape[0] - 1 #C #D t_idx = torch.arange(start, end, device=device) next_tokens = full_ids[start + 1 : end + 1] next_token_logps = logprobs[t_idx, next_tokens] #E return torch.mean(next_token_logps).item() #A Encode prompt and answer tokens separately to get the prompt length later #B Same as in calc_next_token_logprobas before #C Index range for positions corresponding to answer tokens #D Same as
原书定位详情
来源:a19c7933-4eda-4176-aebd-30fe7e1ad292
正文位置:extracted/Build a Reasoning Model (From Scratch)/_epub-src/OEBPS/Text/chapter-5.html
EPUB SHA-256:52d4d07986020be70f5aac21762dfcf60fcba08db0ba29d4f63957caf12aa377