scrawler

View on PyPIReverse Dependencies (0)

0.3.1 scrawler-0.3.1-py3-none-any.whl

Wheel Details

Project: scrawler
Version: 0.3.1
Filename: scrawler-0.3.1-py3-none-any.whl
Download: [link]
Size: 40218
MD5: 9d5625c675df3b55abeb962bdd907fc1
SHA256: 86a0abf1db0f1dc43babc00c62592fb964745ba6797f9791045729b76fe3c34d
Uploaded: 2021-07-06 09:32:30 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: scrawler
Version: 0.3.1
Summary: Tool for General Purpose Web Scraping and Crawling
Author: Daniel Glatter
Author-Email: d.glatter[at]outlook.com
Home-Page: https://github.com/dglttr/scrawler
Project-Url: Bug Tracker, https://github.com/dglttr/scrawler/issues
Project-Url: Documentation, https://scrawler.readthedocs.io/
Project-Url: Source Code, https://github.com/dglttr/scrawler
License: MIT
Keywords: Web Scraping,Crawling,asyncio,multithreading
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Requires-Python: >=3.6
Requires-Dist: beautifulsoup4 (>=4.9.1)
Requires-Dist: requests (>=2.24.0)
Requires-Dist: tld (>=0.12.5)
Requires-Dist: pandas (>=1.0.5)
Requires-Dist: python-dateutil (>=2.8.1)
Requires-Dist: setuptools (>=28.8.0)
Requires-Dist: aiohttp (>=3.7.3)
Requires-Dist: readability-lxml (>=0.8.1)
License-File: LICENSE
[Description omitted; length: 1159 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.36.2)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
scrawler/__init__.py sha256=GhUZqAdtQG_opj7iunk-cWvGgPKLF1iou6cKOJP7Ygg 288
scrawler/attributes.py sha256=xIqTGHpAx6qU2HjqlNcy6dkvs04y68CbY2M4XCXAtQg 10106
scrawler/crawling.py sha256=sFFkqAwLX5en9-2r2hnqEptc-aeBhFul9XvcdjMpsEY 9378
scrawler/data_extractors.py sha256=Wv5jR4NXZREJak939uvD1EU7NJUq_J512uv2dhpQLig 28744
scrawler/defaults.py sha256=ufYgyC8yiRqF9kbjRSxX18HLaSotl0X05z__KJUWzYo 767
scrawler/scraping.py sha256=_jRzeJyW6KcMoiXxZCM63VHVUTIHhQTdcQf-tEWOSg4 7928
scrawler/website.py sha256=huVfRis0KSF_A7f8D5eMeKfTq-_Ee8JTCLAkZZNjmvM 4048
scrawler/backends/__init__.py sha256=JDi6j2LQea13YUci5fBNC8SuvcEA6rVrDBQKwR7d1FI 56
scrawler/backends/asyncio_backend.py sha256=g4Bbay0MJR0ykW8vHg9IHMUzYYZnFH1Zlh5yKaWtqbs 13109
scrawler/backends/multithreading_backend.py sha256=ACQ2ufQf6N0lJG2VYamQNdimbJktJ3_LxOWrkxrKm4k 12048
scrawler/utils/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
scrawler/utils/file_io_utils.py sha256=EmyBacnm-9ErErcBtyLDBzug4rWmBw0RGaE-Lij1guI 4605
scrawler/utils/general_utils.py sha256=wxiuZg-TOaYP5vBtrrLaFUKJKdGzmRKC2PPV6adSZZ0 3518
scrawler/utils/validation_utils.py sha256=QjimnIWPYsxUy5LvqgfKa0u7IbcR2llBxplB2WyQQ0U 2813
scrawler/utils/web_utils.py sha256=2wRUjqctqAfI0-p6IcUSfAqxBLQvK3k45qG25tgh_pk 29397
scrawler-0.3.1.dist-info/LICENSE sha256=cOtjE0AxZee1MAseCQYp4q6kW8Grjo6D2cknqrBOb8Y 1176
scrawler-0.3.1.dist-info/METADATA sha256=KLzk2mkME6woRsZkvOFvBCqn7bV14cdhHa-J17MdOYc 2134
scrawler-0.3.1.dist-info/WHEEL sha256=OqRkF0eY5GHssMorFjlbTIq072vpHpF60fIQA6lS9xA 92
scrawler-0.3.1.dist-info/top_level.txt sha256=-xXb0TwGDN9be-JZ4P9JUyWMdWGySGGk9x00yrYIN4Y 9
scrawler-0.3.1.dist-info/RECORD

top_level.txt

scrawler