原书出处
Designing Distributed Systems, 2nd Edition
15 Chapter 15. AI Inference and Serving
cache the model locally, either within a shared filesystem or an in-memory key-value store. Once you cache your model, all of your instances for inference can load from the same cached model. When you restart your application because of failures or new software releases, you don’t have to
原书定位详情
来源:a19c7933-4eda-4176-aebd-30fe7e1ad292
正文位置:extracted/Designing Distributed Systems, 2nd Edition/_epub-src/OEBPS/ch15.html
EPUB SHA-256:d6092c05a28fa00f75eb7c89905415def203cd92f0373323020ba665a9969602