Ubuntu / Debian Linux
1. 更新软件列表
代码语言:javascript复制sudo apt-get update
2. 安装依赖库
代码语言:javascript复制sudo apt-get install python-pip python-lxml python-crypto python-cssselect python-openssl python-w3lib python-twisted python-dev libxml2-dev libxslt1-dev zlib1g-dev libffi-dev libssl-dev
3. 安装Scrapy
代码语言:javascript复制sudo pip install scrapy
Red Hat / Cent OS Linux
1. 更新软件列表
代码语言:javascript复制sudo yum update
2. 安装依赖库
代码语言:javascript复制sudo yum -y install libxslt-devel pyOpenSSL python-lxml python-devel gccbssl-dev
3. 安装Scrapy
代码语言:javascript复制sudo easy_install scrapy
windows
windows下搭建爬虫框架scrapy