← 返回卡片

原书出处

Designing Distributed Systems, 2nd Edition

15 Chapter 15. AI Inference and Serving

Second Edition · 核验版本的摘录快照 · 导入于 2026-11-14T02:48:46.784Z

cache the model locally, either within a shared filesystem or an in-memory key-value store. Once you cache your model, all of your instances for inference can load from the same cached model. When you restart your application because of failures or new software releases, you don’t have to

此预览只包含定位所需的摘录和上下文。

原书定位详情

来源:a19c7933-4eda-4176-aebd-30fe7e1ad292

正文位置:extracted/Designing Distributed Systems, 2nd Edition/_epub-src/OEBPS/ch15.html

EPUB SHA-256:d6092c05a28fa00f75eb7c89905415def203cd92f0373323020ba665a9969602