原书出处
Designing Large Language Model Applications
CPU RAM if the GPU RAM is filled, and then loading parts of the model into disk if the CPU RAM is also filled. “Accelerate Big Model Inference: How Does it Work?” shows how the accelerate library operates under the hood. This whole process is abstracted from the user, so all you need to load a large model is to run this code:
原书定位详情
来源:a19c7933-4eda-4176-aebd-30fe7e1ad292
正文位置:extracted/Designing Large Language Model Applications/_epub-src/OEBPS/ch05.html
EPUB SHA-256:1b4d2347fec2f949fcddfbaf4fad597a1ae20887a096cfae64c59a619b4781bf