15874103329's recent timeline updates 15874103329's recent timeline updates |
15874103329V2EX member #360504, joined on 2018-11-02 18:31:40 +08:00 |
| [新人求助] 关于 scrapy 项目中 scrapy.Request 没有回调的问题 Python • 15874103329 • Jan 10, 2019 • Lastly replied by 15874103329 | 10 |
| [求助] 为何 pycharm 中无法使用 pyQuery 问与答 • 15874103329 • Jan 7, 2019 • Lastly replied by WhiteComplex | 4 |
| [新人求助] 如何解决淘宝滑动验证的问题 问与答 • 15874103329 • Mar 15, 2020 • Lastly replied by lxk11153 | 3 |
| [新人求助] 为何在爬取网站图片时，其他链接正常输出，但是爬取到其中一个链接时就会报错 Python • 15874103329 • Dec 28, 2018 • Lastly replied by 15874103329 | 4 |
| [求助] 为何微博网页代码有 1500 多行，而我只能提取 10%左右 Python • 15874103329 • Dec 24, 2018 • Lastly replied by locoz | 6 |
| [求助] 如何提取出网页标签内所有的属性值 问与答 • 15874103329 • Dec 22, 2018 • Lastly replied by dreambig183 | 4 |
| [求助] 如何提取出网页标签内所有的属性值
1 问与答 • 15874103329 • Dec 22, 2018
|
| [新人求助] 如何用正则提取出 gallery: JSON.parse 中的内容，不要头部的（和尾部的）， 就是把 json.loads 拿出来 Python • 15874103329 • Dec 19, 2018 • Lastly replied by 15874103329 | 7 |
| [小白求助] 爬取猫眼 top100，打印显示为空 Python • 15874103329 • Dec 6, 2018 • Lastly replied by zh584728 | 6 |
| [新人求教] 无法创建 pipenv 虚拟环境 Python • 15874103329 • Nov 25, 2018 • Lastly replied by Eds1995 | 7 |
15874103329's recent replies
Jan 10, 2019 Replied to a topic by 15874103329 › Python › [新人求助] 关于 scrapy 项目中 scrapy.Request 没有回调的问题 |
已解决，修改代码为 yield scrapy.http.Request(url, callback=self.parse, dont_filter=True)
Jan 10, 2019 Replied to a topic by 15874103329 › Python › [新人求助] 关于 scrapy 项目中 scrapy.Request 没有回调的问题 |
@Leigg
2019-01-10 11:35:18 [scrapy.spidermiddlewares.offsite] DEBUG: Filtered offsite request to 'http': <GET http://http//quotes.toscrape.com/page/2>
2019-01-10 11:35:18 [scrapy.core.engine] INFO: Closing spider (finished)
2019-01-10 11:35:18 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 446,
'downloader/request_count': 2,
'downloader/request_method_count/GET': 2,
'downloader/response_bytes': 2701,
'downloader/response_count': 2,
'downloader/response_status_count/200': 1,
'downloader/response_status_count/404': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2019, 1, 10, 3, 35, 18, 314550),
'item_scraped_count': 10,
'log_count/DEBUG': 14,
'log_count/INFO': 7,
'offsite/domains': 1,
'offsite/filtered': 9,
'request_depth_max': 1,
'response_received_count': 2,
'scheduler/dequeued': 1,
'scheduler/dequeued/memory': 1,
'scheduler/enqueued': 1,
'scheduler/enqueued/memory': 1,
'start_time': datetime.datetime(2019, 1, 10, 3, 35, 14, 371325)}
2019-01-10 11:35:18 [scrapy.core.engine] INFO: Spider closed (finished)
2019-01-10 11:35:18 [scrapy.spidermiddlewares.offsite] DEBUG: Filtered offsite request to 'http': <GET http://http//quotes.toscrape.com/page/2>
2019-01-10 11:35:18 [scrapy.core.engine] INFO: Closing spider (finished)
2019-01-10 11:35:18 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 446,
'downloader/request_count': 2,
'downloader/request_method_count/GET': 2,
'downloader/response_bytes': 2701,
'downloader/response_count': 2,
'downloader/response_status_count/200': 1,
'downloader/response_status_count/404': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2019, 1, 10, 3, 35, 18, 314550),
'item_scraped_count': 10,
'log_count/DEBUG': 14,
'log_count/INFO': 7,
'offsite/domains': 1,
'offsite/filtered': 9,
'request_depth_max': 1,
'response_received_count': 2,
'scheduler/dequeued': 1,
'scheduler/dequeued/memory': 1,
'scheduler/enqueued': 1,
'scheduler/enqueued/memory': 1,
'start_time': datetime.datetime(2019, 1, 10, 3, 35, 14, 371325)}
2019-01-10 11:35:18 [scrapy.core.engine] INFO: Spider closed (finished)
Jan 10, 2019 Replied to a topic by 15874103329 › Python › [新人求助] 关于 scrapy 项目中 scrapy.Request 没有回调的问题 |
@carry110
我这还是只打印了一页，不知啥情况
我这还是只打印了一页，不知啥情况
Jan 10, 2019 Replied to a topic by 15874103329 › Python › [新人求助] 关于 scrapy 项目中 scrapy.Request 没有回调的问题 |
Jan 9, 2019 Replied to a topic by 15874103329 › Python › [新人求助] 关于 scrapy 项目中 scrapy.Request 没有回调的问题 |
求助啊
Jan 9, 2019 Replied to a topic by 15874103329 › Python › [新人求助] 关于 scrapy 项目中 scrapy.Request 没有回调的问题 |
按照教程里写的，但是我这代码只爬取了一页就结束了，求大佬帮忙看看
Jan 6, 2019 Replied to a topic by 15874103329 › 问与答 › [求助] 为何 pycharm 中无法使用 pyQuery |
@weqopy
不行啊，其他的所有库、模块都可以，唯独这个 pyqurey
不行啊，其他的所有库、模块都可以，唯独这个 pyqurey
Jan 6, 2019 Replied to a topic by 15874103329 › 问与答 › [求助] 为何 pycharm 中无法使用 pyQuery |
求助啊
Jan 4, 2019 Replied to a topic by 15874103329 › 问与答 › [新人求助] 如何解决淘宝滑动验证的问题 |
大佬们帮帮忙啊，这里卡一天了
Dec 28, 2018 Replied to a topic by 15874103329 › Python › [新人求助] 为何在爬取网站图片时，其他链接正常输出，但是爬取到其中一个链接时就会报错 |
@careofzm 感谢大佬
Select Language