原书出处
System Design Interview – An insiders guide, Second Edition
09 网络爬虫
Web crawler workflow To better explain the workflow step-by-step, sequence numbers are added in the design diagram as shown in Figure 9-4. Step 1: Add seed URLs to the URL Frontier Step 2: HTML Downloader fetches a list of URLs from URL Frontier. Step 3: HTML Downloader gets IP addresses of URLs from DNS resolver and starts downloading. Step 4: Content Parser parses HTML pages
原书定位详情
来源:a19c7933-4eda-4176-aebd-30fe7e1ad292
正文位置:extracted/System Design Interview – An insiders guide, Second Edition/_epub-src/text/part0023_split_002.html
EPUB SHA-256:ffc3a97753094acb30719f26589af322724b6c17c10371f0626e61687734b345