当我尝试运行它时,发生以下错误:

问题描述 投票:1回答:1
2020-02-20 16:10:30 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023 2020-02-20 16:10:32 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET http://www.quotes.toscrape.com/robots.txt> (failed 1 times): [<twisted.python.failure.Failure twisted.internet.error.ConnectionDone: Connection was closed cleanly.>] 2020-02-20 16:10:32 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET http://www.quotes.toscrape.com/robots.txt> (failed 2 times): [<twisted.python.failure.Failure twisted.internet.error.ConnectionDone: Connection was closed cleanly.>] 2020-02-20 16:10:33 [scrapy.downloadermiddlewares.retry] DEBUG: Gave up retrying <GET http://www.quotes.toscrape.com/robots.txt> (failed 3 times): [<twisted.python.failure.Failure twisted.internet.error.ConnectionDone: Connection was closed cleanly.>] 2020-02-20 16:10:33 [scrapy.downloadermiddlewares.robotstxt] ERROR: Error downloading <GET http://www.quotes.toscrape.com/robots.txt>: [<twisted.python.failure.Failure twisted.internet.error.ConnectionDone: Connection was closed cleanly.>] Traceback (most recent call last): File "c:\users\adi\appdata\local\programs\python\python37-32\lib\site-packages\scrapy\core\downloader\middleware.py", line 44, in process_request defer.returnValue((yield download_func(request=request, spider=spider))) twisted.web._newclient.ResponseNeverReceived: [<twisted.python.failure.Failure twisted.internet.error.ConnectionDone: Connection was closed cleanly.>] 2020-02-20 16:10:34 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET http://www.quotes.toscrape.com/> (failed 1 times): [<twisted.python.failure.Failure twisted.internet.error.ConnectionDone: Connection was closed cleanly.>] 2020-02-20 16:10:35 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET http://www.quotes.toscrape.com/> (failed 2 times): [<twisted.python.failure.Failure twisted.internet.error.ConnectionDone: Connection was closed cleanly.>] 2020-02-20 16:10:36 [scrapy.downloadermiddlewares.retry] DEBUG: Gave up retrying <GET http://www.quotes.toscrape.com/> (failed 3 times): [<twisted.python.failure.Failure twisted.internet.error.ConnectionDone: Connection was closed cleanly.>] 2020-02-20 16:10:36 [scrapy.core.scraper] ERROR: Error downloading <GET http://www.quotes.toscrape.com/> Traceback (most recent call last): File "c:\users\adi\appdata\local\programs\python\python37-32\lib\site-packages\scrapy\core\downloader\middleware.py", line 44, in process_request defer.returnValue((yield download_func(request=request, spider=spider))) twisted.web._newclient.ResponseNeverReceived: [<twisted.python.failure.Failure twisted.internet.error.ConnectionDone: Connection was closed cleanly.>]

我已尝试更改用户代理并尝试应用代理,但没有,它不能解决我的问题。

我正在尝试使用scrapy构建网络爬虫。我的搜寻器的代码如下:导入scrapy类SpiSpider(scrapy.Spider):name ='spi'start_urls = ['http://www.quotes.toscrape.com/'] ...
python-3.x scrapy web-crawler twisted
1个回答
0
投票
© www.soinside.com 2019 - 2024. All rights reserved.