原书出处
Designing Large Language Model Applications
nonfunctional requirements, including minimizing latency (the time the user needs to wait for the model response) and cost. In Chapter 9, we will discuss techniques for inference optimization, including caching, distillation, and quantization.
原书定位详情
来源:a19c7933-4eda-4176-aebd-30fe7e1ad292
正文位置:extracted/Designing Large Language Model Applications/_epub-src/OEBPS/ch01.html
EPUB SHA-256:1b4d2347fec2f949fcddfbaf4fad597a1ae20887a096cfae64c59a619b4781bf