原书出处
Designing Large Language Model Applications
A very effective form of saving memory is through quantization, as introduced in Chapter 5. We will go through quantization techniques in more detail in Chapter 9. For our use case, we will use bf16 as it represents a sound tradeoff between memory savings and performance.
原书定位详情
来源:a19c7933-4eda-4176-aebd-30fe7e1ad292
正文位置:extracted/Designing Large Language Model Applications/_epub-src/OEBPS/ch06.html
EPUB SHA-256:1b4d2347fec2f949fcddfbaf4fad597a1ae20887a096cfae64c59a619b4781bf