scrapy-engine_process_堆栈
2020-04-26 16:49:53 0 举报
Scrapy 的 engine 在 process 过程中的堆栈细节
作者其他创作
大纲/内容
Scrape
scraper.crawler.engine:crawl
engine:_download
engine:schedule
scraper:_process_spidermw_output
scraper:_scrap2
engine:_next_request(engine.slot.nextcall:sechdule)
Spider
Schedule
engine:_handle_downloader_output
engine:crawl
spider:parser
Download
scraper:_scrape_next
engine.scraper:enqueue_scrape
engine:_next_request_from_schedule
scraper:call_spider
Scrapy Engine process 堆栈
scraper:handle_spider_output
engine.slot.scheduler.next_request()
scraper:_scrap
engine.slot.scheduler:enqueue_request(request)
Engine
Pipeline
职业：软件工程师
0 条评论
回复 删除
下一页
