原书出处
Designing Distributed Systems, 2nd Edition
15 Chapter 15. AI Inference and Serving
the first thing to consider is the computational requirements of the model and your application. If your application is going to be used interactively by a user, the latency of the responses is critical to the quality of the application. Generally, users begin to notice latency at 250
原书定位详情
来源:a19c7933-4eda-4176-aebd-30fe7e1ad292
正文位置:extracted/Designing Distributed Systems, 2nd Edition/_epub-src/OEBPS/ch15.html
EPUB SHA-256:d6092c05a28fa00f75eb7c89905415def203cd92f0373323020ba665a9969602