aispider
aispider,神一样的爬虫
pip install fabric3
解析
pip install requests BeautifulSoup4 lxml
lxml安装失败可尝试使用非官方whl
https://www.lfd.uci.edu/~gohlke/pythonlibs/#lxml
数据存储
pip install happybase pymongo
加密
pip install pyDes
aispider,神一样的爬虫
pip install fabric3
pip install requests BeautifulSoup4 lxml
https://www.lfd.uci.edu/~gohlke/pythonlibs/#lxml
pip install happybase pymongo
pip install pyDes