Wheelodex » Projects » CrawlSpider

CrawlSpider

View on PyPI — Reverse Dependencies (0)

2.0.8 CrawlSpider-2.0.8-py3-none-any.whl

Wheel Details

Project: CrawlSpider
Version: 2.0.8
Filename: CrawlSpider-2.0.8-py3-none-any.whl
Download: [link]
Size: 70809
MD5: febf5d8c12757ace377753bd22256b13
SHA256: 758b378a789bd55552b2a036b78610203062a964d445066a9fcd2a8aa97d1462
Uploaded: 2022-11-16 06:59:15 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt · entry_points.txt

METADATA

Metadata-Version: 2.1
Name: CrawlSpider
Version: 2.0.8
Summary: Python Common Spider for Humans.
Author: Ricky Wang
Author-Email: ricky.wbjian[at]gmail.com
Home-Page: https://gitee.com/dreamricky/crawl-spider
Project-Url: Author Website, https://blog.csdn.net/qq_36154755
License: Apache 2.0
Keywords: spider scrapy beatifulsoup xpath 正则
Requires-Python: >=3.6
Requires-Dist: pyperclip (==1.8.2)
Requires-Dist: PySide2 (==5.15.2)
Requires-Dist: PySocks (==1.7.1)
Requires-Dist: PyYAML (==5.4.1)
Requires-Dist: PyExecJS (==1.5.1)
Requires-Dist: protobuf (==3.14.0)
Requires-Dist: pkginfo (==1.8.3)
Requires-Dist: cos-python-sdk-v5 (==1.9.15)
Requires-Dist: requests (==2.26.0)
Requires-Dist: beautifulsoup4 (==4.10.0)
Requires-Dist: lxml (==4.6.3)
Requires-Dist: DBUtils (==3.0.2)
Requires-Dist: PyMySQL (==0.9.3)
Requires-Dist: selenium (==4.0.0)
Requires-Dist: aiofiles (==0.8.0)
Requires-Dist: aiohttp (==3.8.1)
Requires-Dist: aiohttp-requests (==0.1.3)
Requires-Dist: fake-useragent (==0.1.11)
Requires-Dist: retrying (==1.3.3)
Requires-Dist: redis (==4.3.3)
Requires-Dist: aiomysql (==0.0.22)
Requires-Dist: fire (==0.4.0)
Requires-Dist: psutil (==5.9.1)
Requires-Dist: urllib3 (==1.26.6)
Requires-Dist: boto3 (==1.24.24)
Requires-Dist: botocore (==1.27.24)
Requires-Dist: aliyun-python-sdk-core-v3 (==2.13.33)
Requires-Dist: aliyun-python-sdk-green (==3.6.5)
Requires-Dist: aliyun-python-sdk-kms (==2.15.0)
Requires-Dist: tenacity (==8.0.1)
Requires-Dist: psycopg2-binary
Requires-Dist: psycopg
Requires-Dist: pytz
Requires-Dist: pyyaml (==5.4.1)
Requires-Dist: pyexcel-xlsx (==0.6.0)
Requires-Dist: loguru (==0.6.0)
Requires-Dist: uvloop; extra == "asyncloop"
Requires-Dist: twine; extra == "build"
Provides-Extra: asyncloop
Provides-Extra: build
Description-Content-Type: text/markdown
[Description omitted; length: 1341 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.37.1)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
CrawlSpider/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
CrawlSpider/ETL/BaseETL.py sha256=W-rbmWO8yHOS6Al5sLXorPRxkMV6uGKy2_t6JMuGb6Q 1487
CrawlSpider/ETL/__init__.py sha256=WF7zg_AtAkdo3Arhv1qSbkDRo-NpJJbL9-1u8VkomvI 149
CrawlSpider/Utils/AliSDK.py sha256=QH8vpXOgF9yscqfU5yHDJzc78nyQU_99ckj_uu8CpHY 2747
CrawlSpider/Utils/AwsSDK.py sha256=0NaE9mpNkW2ZfkvLEsWfDL9HRl_qRp3Zm0k9UVfx4yk 2416
CrawlSpider/Utils/BodyParser.py sha256=JN3pCrRkcAceMtSgk0yF_vrLhZtFtst02-9SGI8X8-U 1182
CrawlSpider/Utils/DateUtils.py sha256=lep2aKCnVXeSNbuD9OYy-LTJFq6zQAMnJ_Sv2a1eSVE 9332
CrawlSpider/Utils/FileUpload.py sha256=-LmCw_qQD4A29qoPfzlBwnBfuBOpmHOPD7S26yjoNCY 2951
CrawlSpider/Utils/FileUtils.py sha256=PYTiPLXU8hYmynO39YZhTFD8jN0Cm4LlIxcwTPUKPCM 1580
CrawlSpider/Utils/FindGrep.py sha256=gM9oWwcp1GxdKIxL4NpPmou59_x1tD6fT0UDkA3Fm4A 7091
CrawlSpider/Utils/Helper.py sha256=_5t7tyV2gf7Lqv4za9Fs00gmB6_WjjFf32LGTtF1kFk 9461
CrawlSpider/Utils/MySQLDb.py sha256=QNGv-R4DmcEQLNjsrUPZxELb8TqX574metPANGpvqOs 7766
CrawlSpider/Utils/MySQLDbSync.py sha256=z5RnNWhisrPLsZvyyzSVTKp1NQpvDavj4qrhpThBmTc 6535
CrawlSpider/Utils/OfficeUtils.py sha256=BuGSRdMrUSkpaSnzdmui87McTIJV732UdADYNIjuWfU 926
CrawlSpider/Utils/PgDb.py sha256=3priM6F1zeSl1XPDax6jTcKwxIBIwXWz6n4TJJhFX7M 13239
CrawlSpider/Utils/PgDbAsync.py sha256=hI6dFV1lB2Jgyia45b5p7BznDAYOSoKkhD8oXCSOI3Y 11985
CrawlSpider/Utils/RedisDB.py sha256=ryFUMD-grzxKTFh99s7DX4qn-_6pKY9vfnSvAIUu_Dw 2951
CrawlSpider/Utils/ResHandler.py sha256=TxoDEI7qzgNigcnVsJHsVsiHp3Z-XwfSguBC2Z6LJ70 5523
CrawlSpider/Utils/RetrieveProxy.py sha256=G0MH4_lrXqbTlcgu9DMZfIgpPYBRqx7Wuoz9B3BwpiE 3117
CrawlSpider/Utils/RetrieveUA.py sha256=xUjaO4Uc9dpY_hzFMe4yDC4fif-pGAt5pYb0ABEAST8 465
CrawlSpider/Utils/SQLib.py sha256=Sfs1-lhKLHIN8zB5irPUfyECLvIsaPzE7_fqKOzHR0o 5251
CrawlSpider/Utils/SQLibs.py sha256=Sfs1-lhKLHIN8zB5irPUfyECLvIsaPzE7_fqKOzHR0o 5251
CrawlSpider/Utils/Settings.py sha256=a3osBL11U8ORikVIHG8l1N8EVuBfNCK3UvgoUff_1LI 2047
CrawlSpider/Utils/SpiderRequest.py sha256=b7HmLpW8pLK_Xz_9-hfue157ScjnONhmYcR8iJi93Ho 13752
CrawlSpider/Utils/SpiderRequestSync.py sha256=sajqdQ_areKHfhjyn6QuQqWJbBZHT7wY4_P9T0LsrbQ 6764
CrawlSpider/Utils/SplashHandler.py sha256=CwjtKYgbgURWrcNMwA8Vy-OBRYoZtQsc4wqm_CGN0dA 6039
CrawlSpider/Utils/ThreadClosable.py sha256=SsioS033StkdHDIEn7AxURgUyepI-exX8V4jNVU21KM 959
CrawlSpider/Utils/__init__.py sha256=WF7zg_AtAkdo3Arhv1qSbkDRo-NpJJbL9-1u8VkomvI 149
CrawlSpider/Utils/__main__.py sha256=_MdyHHvmvtnp-jwFpU8VBUBegnKuRnXOeVOGGeunV-g 3197
CrawlSpider/Utils/monitor.py sha256=eHS_gGMF9Ntik6gf4T96lUSeZvNeuIfCYhp9EcRReWg 1765
CrawlSpider/Utils/taskUtils.py sha256=uW0smunznvcJy3QgDmqBQFdH_P309Ytx7g28M8ocd54 739
CrawlSpider/Utils/twineUtils.py sha256=OoCQFq_UMPHLeMzF7Y_F1MFpvpb0R1wuEnFqwKryTd0 2509
CrawlSpider/conf/__init__.py sha256=F7o8eSmtP11v5zFBhnjRj5SmAjbtoiSXdBvQf5KrWz8 149
CrawlSpider/conf/settings.py sha256=Wc6Tx9K1HBNnblkVgs26c1OMVcGyPdgeHkcZJqWNG3Y 43319
CrawlSpider/cos_sdk/__init__.py sha256=WF7zg_AtAkdo3Arhv1qSbkDRo-NpJJbL9-1u8VkomvI 149
CrawlSpider/cos_sdk/TencentCloud/CosOp.py sha256=lFZodHJ673jFR-Iw8a0F_LEwN3n1U1eEx1JEaSmcjZU 4856
CrawlSpider/cos_sdk/TencentCloud/MyCosS3Client.py sha256=ptfz4z7-OVoGu66knrWBz8hM3Rkx3nf2LeV3Z9aaKvY 85
CrawlSpider/cos_sdk/TencentCloud/MyFileStream.py sha256=NPYK81hvquIX3Hiwm9XPc4TOX_VlZjIwqlBZ5HPqYJA 397
CrawlSpider/cos_sdk/TencentCloud/__init__.py sha256=WF7zg_AtAkdo3Arhv1qSbkDRo-NpJJbL9-1u8VkomvI 149
CrawlSpider/date_infer/__init__.py sha256=Rn6ZuBJN1QSH7EI1iLnMlSLz8oPu9dpAZwoccjeyQu4 49
CrawlSpider/date_infer/date_elements.py sha256=_qI3-eJVdDpgGWThCD0lZr-08Br1hd_3leGxt42xayk 6165
CrawlSpider/date_infer/infer.py sha256=BxaMRkeoV1xBQORmqSrS-oB5STqkp81RvxqvtI6HuZo 11330
CrawlSpider/date_infer/ruleproc.py sha256=fOsaiiNNsstPWRLIFgrjhBVklGYMwoG5XDU-anx6o4w 7278
CrawlSpider/dun_sdk/TextBatchCheck.py sha256=XGRpAkoLdRkd5EobcIduvIBu8qbGIYMcP2kvyT5MuxE 4418
CrawlSpider/dun_sdk/__init__.py sha256=EpOQm7-zUl9QToVv4dsu0v5ziw4Ebg17ukaQfDFcYek 152
CrawlSpider/spiders/BaseNewsSpider.py sha256=L_HjjgcYax_bsaGRSFIQJiAwxkFEJdhw3OwnZpZc738 10501
CrawlSpider/spiders/NewsSpider.py sha256=kuB-0sfPXnnliT-xOLGii76OgrK5zDHrruE4JAX4iyQ 1182
CrawlSpider/spiders/__init__.py sha256=WF7zg_AtAkdo3Arhv1qSbkDRo-NpJJbL9-1u8VkomvI 149
test/__init__.py sha256=e5QQ0zvb7Ka4Ii0WCQiKFIfV2NqY3NUDS6NtRFCBsJg 149
test/config.py sha256=J7Q3qDK-DvvcWAkj4VzLeAs8EzGowh6YRCPln-zSvKg 160
test/dateInfer.py sha256=U4e3OMba-wkVwJkbx1G3p8Gy6H5z0VyIqYHnKADSV68 311
test/splash.py sha256=NQH_Ih3ZqEty0H0YljrKA7T0OcVi8yyNisrhc7SGOGQ 718
CrawlSpider-2.0.8.dist-info/METADATA sha256=AtSFEOMVjf0g2eENQ9PdnjeZC5j_NrAL3uNIJXEPz7w 3148
CrawlSpider-2.0.8.dist-info/WHEEL sha256=G16H4A3IeoQmnOrYV4ueZGKSjhipXx8zc8nu9FGlvMA 92
CrawlSpider-2.0.8.dist-info/entry_points.txt sha256=DAVHVajOsAQn9K78NeJO8K4iDQtgv7HSS3KWUsTVBhM 69
CrawlSpider-2.0.8.dist-info/top_level.txt sha256=XqzAZdMqlPcBRjSnFdwlXfj3be_R5B6HTXqEZFYKDTQ 17
CrawlSpider-2.0.8.dist-info/RECORD — —

top_level.txt

CrawlSpider
test

entry_points.txt

[console_scripts]
CrawlSpiderUtils = CrawlSpider.Utils.__main__:main