1.安装Python
sudo apt-get install python2.7 python2.7-dev
2.安装pip
下载get-pip.py
选中该文件所在路径,执行下面的命令
sudo python get-pip.py
3.安装Scrapy
安装lxml:sudo pip install lxml
验证openssl 直接输入openssl
sudo pip install Scrapy
安装完毕之后,输入scrapy来验证是否成功
Scrapy 1.0. - no active project Usage:
scrapy <command> [options] [args] Available commands:
bench Run quick benchmark test
commands
fetch Fetch a URL using the Scrapy downloader
runspider Run a self-contained spider (without creating a project)
settings Get settings values
shell Interactive scraping console
startproject Create new project
version Print Scrapy version
view Open URL in browser, as seen by Scrapy [ more ] More commands available when run from project directory Use "scrapy <command> -h" to see more info about a command