原书出处
Reliable Machine Learning
08 Serving
However, it is important to note that parallelization by creating a larger number of model replicas is usually not a solution to prediction latency, as the end-to-end time it takes to send a single example through the model isn’t affected by simply having more versions of the model available. Real systems often produce a distribution of latency values, due to network effects and overall system load.
原书定位详情
来源:a19c7933-4eda-4176-aebd-30fe7e1ad292
正文位置:extracted/Reliable Machine Learning/_epub-src/OEBPS/ch08.xhtml
EPUB SHA-256:1201425671b4d9d06d56459bced6f75ec74a7aac380ea24f5b573c80fee7be65