Wheelodex » Projects » boris-spider

boris-spider

View on PyPI — Reverse Dependencies (0)

1.1.3 boris_spider-1.1.3-py3-none-any.whl

Wheel Details

Project: boris-spider
Version: 1.1.3
Filename: boris_spider-1.1.3-py3-none-any.whl
Download: [link]
Size: 115103
MD5: 495af6c1ed96566aa7a342d2f037451c
SHA256: b9093daf0ceabda7922bb336a3d003f7a40710569ffaad8c38c11533f324f507
Uploaded: 2020-12-30 08:55:40 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt · entry_points.txt

METADATA

Metadata-Version: 2.1
Name: boris-spider
Version: 1.1.3
Summary: A high-level Web Crawling and Web Scraping framework
Author: Boris
Author-Email: boris[at]bzkj.tech
Home-Page: https://github.com/Boris-code/boris-spider.git
License: MIT
Classifier: Programming Language :: Python :: 3
Requires-Dist: better-exceptions (==0.2.2)
Requires-Dist: DBUtils (==1.3)
Requires-Dist: parsel (==1.5.2)
Requires-Dist: PyExecJS (==1.5.1)
Requires-Dist: PyMySQL (==0.9.3)
Requires-Dist: redis (==2.10.6)
Requires-Dist: requests (>=2.22.0)
Requires-Dist: bs4 (==0.0.1)
Requires-Dist: ipython (==7.14.0)
Requires-Dist: bitarray (==1.5.3)
Requires-Dist: redis-py-cluster (==1.3.4)
Description-Content-Type: text/markdown
[Description omitted; length: 3957 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.35.1)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
spider/VERSION sha256=Xa4MCl7Tzap4cE4luzjXLDEBgxHpMyg9Bu1PkzYL_Gw 6
spider/__init__.py sha256=fFwjCMM1aFB3duV4PSBPo4Y3YbE9odfJjUa4oXAdm5g 739
spider/requirements.txt sha256=E7LoUc02zrz7MGAJVnGl-dlcj7MbU3godTi0fmh9YAY 180
spider/setting.py sha256=Qq_2AOhW7sU0MssrE9oNF8kxhmRI1QbWdF5K0v-lsxE 3577
spider/buffer/__init__.py sha256=X6bwWLtrL14gGKGnPikisHxtcWCG3dRwtAEmkcQubgE 130
spider/buffer/item_buffer.py sha256=SgSmApL-kOR5xnd3fjZUPXJIMZOI8vboCxzOCvvmh3c 11362
spider/buffer/request_buffer.py sha256=t7Brg09SVIk-1GQ6pLd5dNDAyzwAR32-HBVAW2c-5rM 5078
spider/commands/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
spider/commands/cmdline.py sha256=1eiAvBawYUcoYnXV_kLhcVZG2Z1vjP3jB9ugi4syWfc 1085
spider/commands/create_builder.py sha256=8nA_COhQ6xxZ8msiGOQSf8G9QyCrRD4agaQdefFUgss 17899
spider/commands/shell.py sha256=vuXakp_MJkm6HyzzpJ84LtBd6p0GL3mo5nHMeRVj95o 1775
spider/core/__init__.py sha256=X6bwWLtrL14gGKGnPikisHxtcWCG3dRwtAEmkcQubgE 130
spider/core/base_parser.py sha256=WSbZDfhJQkPmS7NgLQvy140kIg71LMD-h6eEmhExO1s 6121
spider/core/collector.py sha256=_g_fkT3P62NoPDnVhozp9RMCwQHM3uLW9Hcd6fo1yus 4970
spider/core/handle_failed_requests.py sha256=F6VXJa_w147SqsWiJmu4-pVkWqFSyFbDZb0CFEGqQ0I 1656
spider/core/parser_control.py sha256=8uLLYXJT2RCIqzIgtVChhTSez6dp2zq0EsHhtUYuq8k 29332
spider/core/scheduler.py sha256=QwcAmydnASMHNTGtBv0DuaJT1U3ubCoOXBWtFa6eiPc 21192
spider/core/spiders/__init__.py sha256=8o7x28JLCKeawI_kPGdWzTv6KBABjmgWfHwldY32anw 347
spider/core/spiders/batch_spider.py sha256=jFqrAljX4CKLrJOFKg3uO1OdIK773bIJrX9i0-dqw7w 49137
spider/core/spiders/single_spider.py sha256=Apq0ONuD95Lnbgpo9cvW0Xt2YvME_mx8vwhKBS6Q5cE 2745
spider/core/spiders/spider.py sha256=LvgxrnZnMbEiQ5IBxyCwMbTXXcb_ZcdQIvVQu0RzK_M 15214
spider/db/__init__.py sha256=xtBj-lH8lVhRzHh9KAf5F-7l9GXXDF4qpjwIjkIC9xE 130
spider/db/memory_db.py sha256=CgWi-f5-dK_a80p7L7cCNQRfVmPOaPic8fYT-TkhSCE 769
spider/db/mysqldb.py sha256=SOhMFWg1MV6wQ4pm0lpMaDC_ZSDqxj5viYIF7efwgKE 9957
spider/db/redisdb.py sha256=PF2Bks10GPcKLfoVsneApxrJ4IHsp1JKabh3bJJN6Bs 26251
spider/dedup/__init__.py sha256=3S1U4ajx0NqckHfw-9HPxh78PMSWBuDc_dly_vRKBLE 5822
spider/dedup/bitarray.py sha256=D2oEhXSgM219uV_h8kxMwzBze2uVG0PfZNhNN7ahpn0 3777
spider/dedup/bloomfilter.py sha256=Kcc_XaNbUqPDyN-sir6RLghWp6Ov1ghc7jZUo_K0MCU 12089
spider/dedup/expirefilter.py sha256=oJsJlD27Kxjw0ASKNLmLo3s9lAPvxEXrclRtIwtVrek 1672
spider/dedup/test.py sha256=MTDrIoMQa7YsqITelkZLfU3wPcOrKtGS8xsSYUNlOak 653
spider/network/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
spider/network/item.py sha256=IkpBIgngKM65yYhSwaxZ183a7XsvQFwWks1BN1CyYp4 4093
spider/network/proxy_pool.py sha256=QjTyckYKFvNsDHYyMNj5jjSE3ZmENqyG9M4PfVkWpx8 23654
spider/network/request.py sha256=UqaYaMtaZEu1LvDKeiRBSuPW7wmD25dmU19ZqjN7pl0 14164
spider/network/response.py sha256=vIydc1DUAj7Ib0ZW78P6O6pzt7B52vYcAAs-f0aZVrM 11091
spider/network/selector.py sha256=cs4ZYURM_HJiqBJOXFsvlhlnls1_43AxzaQQ-13Yxcc 5658
spider/network/user_agent.py sha256=dPEp1LrsFkiCupkdp6U3ftC2Y84KAEp8NG1NwXDiHYs 6194
spider/templates/item_template.tmpl sha256=X1anliCGdMW6lCkHXpgMSLWeiND5USp-67dELUhke3Y 216
spider/templates/parser_template.tmpl sha256=E09BAteJ_uswAuzzl4JtjqZNsOvO8QGG0y7ZRcp3IEM 464
spider/templates/spider/main.py sha256=ll8KESMmNM1c6i6RjgIpDolFUwCjTViaP29v7NCXYpk 1420
spider/templates/spider/setting.py sha256=ysXNF9ZbFuBUt_awTuh5Oc1ZWQcKWdRd1-rW3Hq1qjI 2529
spider/templates/spider/items/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
spider/templates/spider/parsers/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
spider/utils/__init__.py sha256=uDBrzeYwgifKq54ign57GRSzvpT-pp-g_I9pVFf7rlo 129
spider/utils/custom_argparse.py sha256=zXzY-7ss-1nCwMRkQTLRed8Mm3MtIdB94-DOZZKEWns 1959
spider/utils/export_data.py sha256=lbjZfyLqB6IndDbkHDTh_lrrOGT0MxKYfyM71xSJ1YA 5222
spider/utils/log.py sha256=hkVlUBYKzd0Oj5v--BmDFc9PONPndV-rGcTRpXBLSO4 5921
spider/utils/redis_lock.py sha256=5l3fMcY9T7XMCj5lfvApZhlA49NCxMK5MSR8SO9g9jQ 3962
spider/utils/tools.py sha256=TY1WXq_y8wZYmyXa_dCMvcN6ojW-YJIpFMgA_nPxETE 58039
boris_spider-1.1.3.dist-info/LICENSE sha256=CUVjBcX86XgYQUjaYy2a9eaTKB6CC385AStAFBoBZuw 1096
boris_spider-1.1.3.dist-info/METADATA sha256=7hc8JVO1BbXpvipTUgkDxVwpVy2rIJWRUML1geV3vng 6488
boris_spider-1.1.3.dist-info/WHEEL sha256=EVRjI69F5qVjm_YgqcTXPnTAv3BfSUr0WVAHuSP3Xoo 92
boris_spider-1.1.3.dist-info/entry_points.txt sha256=tJUvrm3Iw6ZQ1bWXSBuwP-D6mqScCg0sgrTO_2eNXTA 60
boris_spider-1.1.3.dist-info/top_level.txt sha256=-omgKN_8Zv_sz8Nh9RKvMeKEgG6ssFAFraIRpgIn8zA 7
boris_spider-1.1.3.dist-info/RECORD — —

top_level.txt

spider

entry_points.txt

[console_scripts]
spider = spider.commands.cmdline:execute