파이썬, Scarpy 스크래피 설치 오류
글. 수알치 오상문
pip install Scrapy
pip3 install Scrapy
등으로 설치해도 아래 오류가 발생할 수 있다.
ERROR: Could not find a version that satisfies the requirement scarpy (from versions: none)
ERROR: No matching distribution found for scarpy
이 경우에 아래 명령으로 다시 해보자.
python -m pip install Scrapy
[실행 결과]
Collecting Scrapy
Downloading Scrapy-2.6.2-py2.py3-none-any.whl (264 kB)
---------------------------------------- 264.5/264.5 kB 7.9 MB/s eta 0:00:00
Collecting cssselect>=0.9.1
Downloading cssselect-1.1.0-py2.py3-none-any.whl (16 kB)
Collecting lxml>=3.5.0
Downloading lxml-4.9.1-cp39-cp39-win_amd64.whl (3.6 MB)
---------------------------------------- 3.6/3.6 MB 8.2 MB/s eta 0:00:00
중략 ...
Running setup.py install for PyDispatcher ... done
Successfully installed Automat-20.2.0 PyDispatcher-2.0.5 Scrapy-2.6.2 Twisted-22.4.0 constantly-15.1.0 cssselect-1.1.0 filelock-3.7.1 hyperlink-21.0.0 incremental-21.3.0 itemadapter-0.6.0 itemloaders-1.0.4 jmespath-1.0.1 lxml-4.9.1 parsel-1.6.0 protego-0.2.1 pyasn1-0.4.8 pyasn1-modules-0.2.8 queuelib-1.6.2 requests-2.28.1 requests-file-1.5.1 service-identity-21.1.0 tldextract-3.3.1 twisted-iocpsupport-1.0.2 w3lib-1.22.0 zope.interface-5.4.0
[테스트] 콘솔 화면(터미널, 커맨드창)에서 scrapy <엔터>를 입력하면 다음 내용이 나타난다.
Scrapy 2.6.2 - no active project
Usage:
scrapy <command> [options] [args]
Available commands:
bench Run quick benchmark test
commands
fetch Fetch a URL using the Scrapy downloader
genspider Generate new spider using pre-defined templates
runspider Run a self-contained spider (without creating a project)
settings Get settings values
shell Interactive scraping console
startproject Create new project
version Print Scrapy version
view Open URL in browser, as seen by Scrapy
[ more ] More commands available when run from project directory
Use "scrapy <command> -h" to see more info about a command
'웹 크롤링, 스크래핑' 카테고리의 다른 글
파이썬, Scrapy 스크래피 공식 레퍼런스 (0) | 2022.08.01 |
---|---|
파이썬, Scrapy 크롤링 예제 (0) | 2022.08.01 |
파이썬, 셀레니움 옵션 최적화 스크롤링 예제 (0) | 2022.08.01 |
셀레니움, 크롤링 안전한 예외처리 예제 (0) | 2022.08.01 |
셀레니움, NameError: name 'StaleElementReferenceException' is not defined (0) | 2022.08.01 |