← 返回卡片

原书出处

Designing Large Language Model Applications

First Edition · 核验版本的摘录快照 · 导入于 2026-11-14T13:54:13.943Z

Reduce compute Techniques like caching, knowledge distillation, and early exit, each of them employing distinct strategies to reduce computation. Speed up decoding Techniques for parallel and speculative decoding aim to improve the throughput of the model: the number of tokens generated per second. Reduce storage needs Quantization techniques aim to reduce the amount of storage needed for weights and activations of the model, by reducing

此预览只包含定位所需的摘录和上下文。

原书定位详情

来源:a19c7933-4eda-4176-aebd-30fe7e1ad292

正文位置:extracted/Designing Large Language Model Applications/_epub-src/OEBPS/ch09.html

EPUB SHA-256:1b4d2347fec2f949fcddfbaf4fad597a1ae20887a096cfae64c59a619b4781bf