博客
关于我
强烈建议你试试无所不能的chatGPT,快点击我
全网最全的Windows下Anaconda2 / Anaconda3里正确下载安装爬虫框架Scrapy(离线方式和在线方式)(图文详解)...
阅读量:5923 次
发布时间:2019-06-19

本文共 5333 字,大约阅读时间需要 17 分钟。

 

 

 

 

      不多说,直接上干货!

 

  参考博客

 

 

 

 

    第一步:首先,提示升级下pip

 

 

 

 

 

 

    第二步:下载安装wheel

 

     也可以去网站里先下载好,离线安装。也可以如上在线安装。

 

     

 

     

     第三步:  安装lxml

    因为,我的是

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

  成功!

 

 

  验证下

 

 

 

 

 

 

 

 

    第四步:安装Twisted

 

 

 

 

 

 

 

PS C:\Anaconda3\Lib\site-packages> pip install Twisted-17.9.0-cp35-cp35m-win_amd64.whlProcessing c:\anaconda3\lib\site-packages\twisted-17.9.0-cp35-cp35m-win_amd64.whlCollecting hyperlink>=17.1.1 (from Twisted==17.9.0)  Downloading hyperlink-17.3.1-py2.py3-none-any.whl (73kB)    100% |████████████████████████████████| 81kB 7.1kB/sCollecting incremental>=16.10.1 (from Twisted==17.9.0)  Downloading incremental-17.5.0-py2.py3-none-any.whlCollecting constantly>=15.1 (from Twisted==17.9.0)  Downloading constantly-15.1.0-py2.py3-none-any.whlCollecting zope.interface>=4.0.2 (from Twisted==17.9.0)  Downloading zope.interface-4.4.3-cp35-cp35m-win_amd64.whl (139kB)    100% |████████████████████████████████| 143kB 13kB/sCollecting Automat>=0.3.0 (from Twisted==17.9.0)  Downloading Automat-0.6.0-py2.py3-none-any.whlRequirement already satisfied: setuptools in c:\anaconda3\lib\site-packages\setuptools-27.2.0-py3.5.egg (from zope.interface>=4.0.2->Twisted==17.9.0)Requirement already satisfied: six in c:\anaconda3\lib\site-packages (from Automat>=0.3.0->Twisted==17.9.0)Collecting attrs (from Automat>=0.3.0->Twisted==17.9.0)  Downloading attrs-17.4.0-py2.py3-none-any.whlInstalling collected packages: hyperlink, incremental, constantly, zope.interface, attrs, Automat, TwistedSuccessfully installed Automat-0.6.0 Twisted-17.9.0 attrs-17.4.0 constantly-15.1.0 hyperlink-17.3.1 incremental-17.5.0 zope.interface-4.4.3PS C:\Anaconda3\Lib\site-packages>

 

 

 

 

 

 

 

 

    第五步:安装scrapy

 

PS C:\Anaconda3\Lib\site-packages> pip install scrapyCollecting scrapy  Downloading Scrapy-1.5.0-py2.py3-none-any.whl (251kB)    100% |████████████████████████████████| 256kB 82kB/sRequirement already satisfied: Twisted>=13.1.0 in c:\anaconda3\lib\site-packages (from scrapy)Requirement already satisfied: lxml in c:\anaconda3\lib\site-packages (from scrapy)Collecting parsel>=1.1 (from scrapy)  Downloading parsel-1.3.1-py2.py3-none-any.whlCollecting service-identity (from scrapy)  Downloading service_identity-17.0.0-py2.py3-none-any.whlRequirement already satisfied: pyOpenSSL in c:\anaconda3\lib\site-packages (from scrapy)Requirement already satisfied: six>=1.5.2 in c:\anaconda3\lib\site-packages (from scrapy)Collecting queuelib (from scrapy)  Downloading queuelib-1.4.2-py2.py3-none-any.whlCollecting PyDispatcher>=2.0.5 (from scrapy)  Downloading PyDispatcher-2.0.5.tar.gzCollecting w3lib>=1.17.0 (from scrapy)  Downloading w3lib-1.18.0-py2.py3-none-any.whlCollecting cssselect>=0.9 (from scrapy)  Downloading cssselect-1.0.3-py2.py3-none-any.whlRequirement already satisfied: incremental>=16.10.1 in c:\anaconda3\lib\site-packages (from Twisted>=13.1.0->scrapy)Requirement already satisfied: Automat>=0.3.0 in c:\anaconda3\lib\site-packages (from Twisted>=13.1.0->scrapy)Requirement already satisfied: hyperlink>=17.1.1 in c:\anaconda3\lib\site-packages (from Twisted>=13.1.0->scrapy)Requirement already satisfied: zope.interface>=4.0.2 in c:\anaconda3\lib\site-packages (from Twisted>=13.1.0->scrapy)Requirement already satisfied: constantly>=15.1 in c:\anaconda3\lib\site-packages (from Twisted>=13.1.0->scrapy)Requirement already satisfied: attrs in c:\anaconda3\lib\site-packages (from service-identity->scrapy)Collecting pyasn1-modules (from service-identity->scrapy)  Downloading pyasn1_modules-0.2.1-py2.py3-none-any.whl (60kB)    100% |████████████████████████████████| 61kB 51kB/sRequirement already satisfied: pyasn1 in c:\anaconda3\lib\site-packages (from service-identity->scrapy)Requirement already satisfied: cryptography>=1.3.4 in c:\anaconda3\lib\site-packages (from pyOpenSSL->scrapy)Requirement already satisfied: setuptools in c:\anaconda3\lib\site-packages\setuptools-27.2.0-py3.5.egg (from zope.interface>=4.0.2->Twisted>=13.1.0->scrapy)Requirement already satisfied: idna>=2.0 in c:\anaconda3\lib\site-packages (from cryptography>=1.3.4->pyOpenSSL->scrapy)Requirement already satisfied: cffi>=1.4.1 in c:\anaconda3\lib\site-packages (from cryptography>=1.3.4->pyOpenSSL->scrapy)Requirement already satisfied: pycparser in c:\anaconda3\lib\site-packages (from cffi>=1.4.1->cryptography>=1.3.4->pyOpenSSL->scrapy)Building wheels for collected packages: PyDispatcher  Running setup.py bdist_wheel for PyDispatcher ... done  Stored in directory: C:\Users\lenovo\AppData\Local\pip\Cache\wheels\86\02\a1\5857c77600a28813aaf0f66d4e4568f50c9f133277a4122411Successfully built PyDispatcherInstalling collected packages: w3lib, cssselect, parsel, pyasn1-modules, service-identity, queuelib, PyDispatcher, scrapySuccessfully installed PyDispatcher-2.0.5 cssselect-1.0.3 parsel-1.3.1 pyasn1-modules-0.2.1 queuelib-1.4.2 scrapy-1.5.0 service-identity-17.0.0 w3lib-1.18.0PS C:\Anaconda3\Lib\site-packages>

 

 

 

 

 

 

    验证下

 

 

 

 

 

 

 

 

    当然,你也可以直接在这里安装

 

 

 

 

 

 

 

 

 

 

 

 

欢迎大家,加入我的微信公众号:大数据躺过的坑        人工智能躺过的坑

 

 

 

 

 

 

 

同时,大家可以关注我的个人博客

   http://www.cnblogs.com/zlslch/   和     http://www.cnblogs.com/lchzls/      http://www.cnblogs.com/sunnyDream/   

   详情请见:http://www.cnblogs.com/zlslch/p/7473861.html

 

  人生苦短,我愿分享。本公众号将秉持活到老学到老学习无休止的交流分享开源精神,汇聚于互联网和个人学习工作的精华干货知识,一切来于互联网,反馈回互联网。

  目前研究领域:大数据、机器学习、深度学习、人工智能、数据挖掘、数据分析。 语言涉及:Java、Scala、Python、Shell、Linux等 。同时还涉及平常所使用的手机、电脑和互联网上的使用技巧、问题和实用软件。 只要你一直关注和呆在群里,每天必须有收获

 

      对应本平台的讨论和答疑QQ群:大数据和人工智能躺过的坑(总群)(161156071) 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 
你可能感兴趣的文章
vim的使用方法
查看>>
使用snmpwalk采集设备的OID信息
查看>>
创业故事和创业思路文档汇总
查看>>
解决centos7 yum安装MySQL rpm包出现conflict problem
查看>>
Python-字典
查看>>
PL/SQL Virtual Machine Memory Usage
查看>>
The certificate used to sign "" has either expired or has been revoked.
查看>>
Linux目录结构
查看>>
CSS浮动
查看>>
Script:Logfile Switch Frequency Map
查看>>
linux系统学习第四天
查看>>
Lnmp+Wordpress出现控制台页面No Input File Specified
查看>>
mongoDB数据库安装与配置
查看>>
system()命令注入
查看>>
Linux上文件的特殊权限SUID,SGID,SBIT详解
查看>>
Linux用户和组的命令之groupdel
查看>>
Facebook的AR战略背后,有哪些人工智能技术加持?
查看>>
12c 关于DMON你应该知道的!
查看>>
打开haproxy的日志
查看>>
python语法部分
查看>>