原书出处
Designing Distributed Systems, 2nd Edition
15 Chapter 15. AI Inference and Serving
inference is the process of evaluating the model on user inputs where the output is unknown. Inference is typically implemented as a RESTful API, which you can call with the user’s input. Many cloud providers provide inference as a service. Such solutions can make it significantly easier to
原书定位详情
来源:a19c7933-4eda-4176-aebd-30fe7e1ad292
正文位置:extracted/Designing Distributed Systems, 2nd Edition/_epub-src/OEBPS/ch15.html
EPUB SHA-256:d6092c05a28fa00f75eb7c89905415def203cd92f0373323020ba665a9969602