我正在尝试将我刮过的数据放在云上的firebase帐户上,但是当我运行这个蜘蛛时,我会得到这个ImportError。我试着创建新项目,甚至在特定版本的firebase和shub上重新安装Python,但没有帮助。
蜘蛛在我的机器上运行得很好,没有显示任何ImportErrors。这是错误日志。
Traceback (most recent call last):
File "/usr/local/lib/python2.7/site-packages/scrapy/utils/defer.py", line 102, in iter_errback
yield next(it)
File "/usr/local/lib/python2.7/site-packages/sh_scrapy/middlewares.py", line 30, in process_spider_output
for x in result:
File "/usr/local/lib/python2.7/site-packages/scrapy/spidermiddlewares/offsite.py", line 29, in process_spider_output
for x in result:
File "/usr/local/lib/python2.7/site-packages/scrapy/spidermiddlewares/referer.py", line 339, in <genexpr>
return (_set_referer(r) for r in result or ())
File "/usr/local/lib/python2.7/site-packages/scrapy/spidermiddlewares/urllength.py", line 37, in <genexpr>
return (r for r in result or () if _filter(r))
File "/usr/local/lib/python2.7/site-packages/scrapy/spidermiddlewares/depth.py", line 58, in <genexpr>
return (r for r in result or () if _filter(r))
File "/app/__main__.egg/Terminator/spiders/IcyTermination.py", line 18, in parse
from firebase import firebase
ImportError: No module named firebase有什么帮助吗?
发布于 2017-07-03 20:00:57
由于名誉原因,我无法发表评论。但是你创造了你的requirements.txt吗?
这里,您将发现如何将自己的依赖项部署到scrapinghub。
基本上,您可以在项目的根目录创建一个requirements.txt文件,每一行只有一个依赖项,然后添加
requirements_file: requirements.txt
到您的scrapinghub.yml文件
https://stackoverflow.com/questions/44891147
复制相似问题