Wheelodex » Projects » gzSpiderTools

gzSpiderTools

View on PyPI — Reverse Dependencies (0)

0.0.18 gzspidertools-0.0.18-py3-none-any.whl

Wheel Details

Project: gzSpiderTools
Version: 0.0.18
Filename: gzspidertools-0.0.18-py3-none-any.whl
Download: [link]
Size: 119422
MD5: 0fb36516e905d3dda1da9d2e21f7850b
SHA256: ab5da024c2218bf5bb1a926e4703f8d7dd4421f6ff90545d93d9c3effbac2428
Uploaded: 2024-04-09 06:56:21 +0000

dist-info

METADATA · WHEEL · RECORD · entry_points.txt

METADATA

Metadata-Version: 2.1
Name: gzspidertools
Version: 0.0.18
Summary: 魔改使用工具库
Author: George
Author-Email: persistencehoo[at]gmail.com
Maintainer: George
Maintainer-Email: persistencehoo[at]gmail.com
Home-Page: https://github.com/georgeJzzz/gzspidertools
Project-Url: Repository, https://github.com/georgeJzzz/gzspidertools
Keywords: crawler,scraping,aiohttp,asyncio,scrapy
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Requires-Python: >=3.8.1,<4.0.0
Requires-Dist: DBUtils (<4.0.0,>=3.0.2)
Requires-Dist: Pillow (<10.0.0,>=9.2.0); extra == "all"
Requires-Dist: PyMySQL (<2.0.0,>=1.0.2)
Requires-Dist: SQLAlchemy (<3.0.0,>=2.0.23)
Requires-Dist: Scrapy (==2.11.1)
Requires-Dist: aiohttp (<3.10.0,>=3.9.3)
Requires-Dist: aiomysql (<0.2.0,>=0.1.1)
Requires-Dist: drissionpage (==4.0.4.5)
Requires-Dist: elasticsearch-dsl (<9.0.0,>=8.11.0); extra == "all" or extra == "database"
Requires-Dist: itemadapter (<0.8.0,>=0.7.0)
Requires-Dist: kafka-python (==2.0.2)
Requires-Dist: loguru (<0.8.0,>=0.7.0)
Requires-Dist: mmh3 (<4.0.0,>=3.0.0); extra == "all"
Requires-Dist: motor (==2.5.1); python_version < "3.11"
Requires-Dist: motor (==3.3.0); python_version >= "3.11"
Requires-Dist: numpy (<1.25.0,>=1.24.3); python_version < "3.9" and extra == "all"
Requires-Dist: numpy (<1.27.0,>=1.26.0); (python_version >= "3.9" and python_version < "3.13") and extra == "all"
Requires-Dist: opencv-python (<4.9.0.0,>=4.8.0.74); extra == "all"
Requires-Dist: oracledb (<2.0.0,>=1.4.2); extra == "all" or extra == "database"
Requires-Dist: oss2 (<3.0.0,>=2.18.4); extra == "all"
Requires-Dist: pika (<1.4.0,>=1.3.2)
Requires-Dist: psycopg (<4.0.0,>=3.1.13); extra == "all" or extra == "database"
Requires-Dist: psycopg-binary (<4.0.0,>=3.1.13); extra == "all" or extra == "database"
Requires-Dist: psycopg-pool (<4.0.0,>=3.2.0); extra == "all" or extra == "database"
Requires-Dist: pycryptodome (<4.0.0,>=3.15.0); extra == "all"
Requires-Dist: pymongo (<4.0.0,>=3.12.3); python_version < "3.11"
Requires-Dist: pymongo (<5.0.0,>=4.5.0); python_version >= "3.11"
Requires-Dist: python-hcl2 (<5.0.0,>=4.3.0); extra == "all"
Requires-Dist: pyyaml (<6.1,>=6.0); extra == "all"
Requires-Dist: redis (<5.0.0,>=4.0.0)
Requires-Dist: requests (<3.0.0,>=2.28.1)
Requires-Dist: retrying (<2.0.0,>=1.3.3)
Requires-Dist: scrapy-redis (==0.7.3)
Provides-Extra: all
Provides-Extra: database
Description-Content-Type: text/markdown
[Description omitted; length: 1886 characters]

WHEEL

Wheel-Version: 1.0
Generator: poetry-core 1.8.1
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
gzspidertools/__init__.py sha256=Rv2m-iCrlfNzlaleIaH03W0tOVhU1xTll2pOoV8sZak 464
gzspidertools/commands/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
gzspidertools/commands/crawl.py sha256=_GR__0ES6-AEqw20hl2VdzxMRKmdAPJg3OrRM5Uu37Q 84
gzspidertools/commands/genspider.py sha256=IFf5s6zHqA4_zOqEHGcPDPQP2tOwkrTO7R9Fabme_IA 340
gzspidertools/commands/startproject.py sha256=GsFFcokWX7Hf5CNEVC1ArM39aJ5zXqIiIz9cfQTv6pU 3868
gzspidertools/commands/version.py sha256=-8Qskol8dC4DFv5KtoJYD-ifD1tpVSS2gh1RLLuSmtg 272
gzspidertools/common/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
gzspidertools/common/encryption.py sha256=oLVQ0NJAyrYpPDPav6QhACF-jdGq5XH14vVUTCC5Sbw 2502
gzspidertools/common/expend.py sha256=0dJfZh3PML82hFZRjUOOJcUsH7_72pAXW2GCWQUQliA 10541
gzspidertools/common/mongodbpipe.py sha256=Ww75lwN1pgpAyuZST_B00-7XR3p8V6r4Tyy55T3Ohm8 6031
gzspidertools/common/multiplexing.py sha256=JzsVr9vtvIKSHnNNWcTj4ctbAavwmgesfViSE4WS0cc 20470
gzspidertools/common/mysqlerrhandle.py sha256=6-EK1Hspb4EDnWFgZ0ts2vwmk5qfN9_o_iMPPn5pqho 10538
gzspidertools/common/params.py sha256=gYuOd1h18veib1EohYOvoAkB34fsq-ufd0K8CvTNGv8 30778
gzspidertools/common/postgreserrhandle.py sha256=uGigTGFJtStoYgybNArLQ5X7xlKFg3rjR_tyON7KbPQ 4806
gzspidertools/common/spiderconf.py sha256=aunepBC8hLMPXjw9BHIKRsZGZ6zq_VmkQhQF1TkZYcg 13530
gzspidertools/common/sqlformat.py sha256=bBOkvbCutcWNR7kX8fc5kezKoIvAShUmEZeqD1vjy94 3710
gzspidertools/common/typevars.py sha256=93iv3wWmfgUdsAnrtqMU17GInP2CFPWgc5AOJzAy6L4 5366
gzspidertools/common/utils.py sha256=pOUCoQ5WCaR-YeWJRI6kGrLkMyqWSbXcE09tj5AfxLk 12159
gzspidertools/config.py sha256=lzmfMAjkA_raIA4t6kHxvQklkjTc4Yw5eqKoQRT7PMU 376
gzspidertools/extras/__init__.py sha256=4MSTKbOCdIJhBqZqibjKE3hnEE1rNcFeA8Q0B0ix1YM 69
gzspidertools/extras/cvnpil.py sha256=qV_DR5mcvygLlHV62G5xSw043YSGbuD_Y-h6C29x5Yg 17713
gzspidertools/extras/ext.py sha256=-TKaWd3M6VA0zEsnwPmSU977cCgQ1QKfCXYjBkz4L_k 2005
gzspidertools/extras/oss.py sha256=TS2lCRIty1pNhP3qRdzBTu4k8YQYP0gI3yYUKoTK9cw 2216
gzspidertools/formatdata.py sha256=wisIakPpsyDaORSbFq-vp4MLfgE6nwDS6pXlrU5lU-8 7242
gzspidertools/items.py sha256=ed-MQRqoDH8368Xm4_cqhunkotcc3TDL58xxHJ38zrg 5590
gzspidertools/middlewares.py sha256=GQk4-7zRXf5CNlSVmF0O0zt7lkV0PCwfd4RzrE8XBy4 802
gzspidertools/mongoclient.py sha256=dKJvaiRNcv71O3WjQ78nYP69FdlY5njXkAHGw5lEX60 4028
gzspidertools/mysqlclient.py sha256=Yba5XPcD4N6ktv-YNPKPGraN1aTgy8c62q89gNLRbn8 1132
gzspidertools/pipelines.py sha256=_MElza6HTHij1fFlITcWT4hM3tGQW-SRdJp8AYXKztM 2130
gzspidertools/redisclient.py sha256=esgnnSbDOCjk76yhGjvR9Rnj0vSsZ85YS4kYs2U2DuI 28494
gzspidertools/request.py sha256=D0ND7rp2bFlL_RCghVqgpg2ZgnfjiVl0tRNlmVRba-0 203
gzspidertools/scraper/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
gzspidertools/scraper/http/__init__.py sha256=D0ND7rp2bFlL_RCghVqgpg2ZgnfjiVl0tRNlmVRba-0 203
gzspidertools/scraper/http/request/__init__.py sha256=4NVf2V58OL4W9KdndzuxtOFKubBMcKOEHPMXaUT7qxU 1556
gzspidertools/scraper/http/request/form.py sha256=bb31QArqDfdPAmgt9lHzJnOcVplqQsybfbwykmiYgq0 1137
gzspidertools/scraper/middlewares/__init__.py sha256=7gWetZ5MIILYJWQJjNeOOX2_QqEoIPD6Vc-qQ-WWWMg 950
gzspidertools/scraper/middlewares/drissionpage/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
gzspidertools/scraper/middlewares/drissionpage/drissionpage_mid.py sha256=-Oc8ZMW7oXD9xCOG5AUvXdhZhI4GAANwaLt3tSjj2bg 1961
gzspidertools/scraper/middlewares/headers/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
gzspidertools/scraper/middlewares/headers/ua.py sha256=FJJTq6c_RA7m7M52wz34f7Ji7n71KgPdozdQ4Ox-gXQ 1678
gzspidertools/scraper/middlewares/netlib/__init__.py sha256=b6oohyYnt64DQZhf8RKriRMYGA2nb1agi98VBe1d4yA 158
gzspidertools/scraper/middlewares/netlib/aiohttplib.py sha256=Qrr4rdGdgvUk593m6rAasmmPt6b2-te1gjngDesGrD4 10137
gzspidertools/scraper/middlewares/proxy/__init__.py sha256=GoPdkZKtRoekIjwY8Glt4TdClt0nIXNKp9C-FupsENc 402
gzspidertools/scraper/middlewares/proxy/dynamic.py sha256=fvVbrfsY6vAQpIs90RkCRTeH_D6Vo1LeYmayFbWOH9g 3602
gzspidertools/scraper/middlewares/proxy/exclusive.py sha256=-ByisYjGUSg8I6ZsdalpTsXLtP3M4QNBem_uZMc7LbA 2417
gzspidertools/scraper/pipelines/__init__.py sha256=zyew8FDdu7zGr1orkv-0Xx5uPB9KzhBeg5XsFeZOdvU 2288
gzspidertools/scraper/pipelines/download/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
gzspidertools/scraper/pipelines/download/file.py sha256=fhWAWOow7iWffi7piubZUjqPRBZp9FnrhR9cEzWC-3I 2971
gzspidertools/scraper/pipelines/es/__init__.py sha256=vMFd4xJhKuZr-OEZJ4SFDVC3jrGkiHohbcC7TICqLUg 2259
gzspidertools/scraper/pipelines/es/asynced.py sha256=nlFNAunZ6eCeWBg4_sTbPaiuXzd_5pSyvirMH-mNEOs 2927
gzspidertools/scraper/pipelines/es/fantasy.py sha256=N9edV6Tpyn6fXLgsys6tpOx4_6Khc6_59fkQGhh6qA0 149
gzspidertools/scraper/pipelines/mongo/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
gzspidertools/scraper/pipelines/mongo/asynced.py sha256=94Ds1HhJJo72jWU38XK3PyTsoqq50H4At-WpIm1V_2M 1620
gzspidertools/scraper/pipelines/mongo/fantasy.py sha256=f2NZyRb3e51Mh9tV4_JqXAudIGsh6Qx2tcfvtiugsO4 1498
gzspidertools/scraper/pipelines/mongo/twisted.py sha256=pIHaYi7KGlKyAx0hgIqF5CRldM35YJ80-CvYFyQ5VG0 910
gzspidertools/scraper/pipelines/msgproducer/__init__.py sha256=EYSHuuwqY5GqnXPCPv00E2L4tHMRSFLe3m41dNfy3Zc 150
gzspidertools/scraper/pipelines/msgproducer/kafkapub.py sha256=MDWsZ1jm28OvyzFBxpWoxf3Rfpxvwunolx9Yddz2eko 3130
gzspidertools/scraper/pipelines/msgproducer/mqpub.py sha256=xqYvZ9CVOmZMpj2s2PxrLWfE3dlGhj_yc2Z1RmA5HgE 2092
gzspidertools/scraper/pipelines/mysql/__init__.py sha256=R3-nm4skd4Q6xgOM4D6RF33A9RkT9gtIqvXOL4BHm9g 2645
gzspidertools/scraper/pipelines/mysql/asynced.py sha256=sgqvHx-95tCxwia2FeD2_EKDWrsxs2FaUPBTig-S7ek 2319
gzspidertools/scraper/pipelines/mysql/fantasy.py sha256=KlIHgrCoj7vVvjO8gM9BF1NkfwGuPipxZe0JvxmsW_o 164
gzspidertools/scraper/pipelines/mysql/stats.py sha256=HCuB2A0tIMcihrevYcqzIATJ3Z8lx_vwlaGvifyGil0 7055
gzspidertools/scraper/pipelines/mysql/turbo.py sha256=VTGBn3htFs7bfSzZofnU9gx3R7WIahS9i8xGeLNIqUw 2376
gzspidertools/scraper/pipelines/mysql/twisted.py sha256=vxjoT7MfndD2rgoiJI-MAYVx0uS-9zEXMhL75MtPAF8 3096
gzspidertools/scraper/pipelines/oracle/__init__.py sha256=f0APLt73fb6w7m-JQE2HpWEniey1nq_gltd_WcSvl_Q 1402
gzspidertools/scraper/pipelines/oracle/fantasy.py sha256=ehmRF1v7RC6-4B7GlDBMGR-vm0p4lx8G59KeIpdrGXI 169
gzspidertools/scraper/pipelines/oracle/twisted.py sha256=VFK-TR4yFJetD9va7VXiztCj5KqcKPfrIGr3riksgfE 2229
gzspidertools/scraper/pipelines/oss/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
gzspidertools/scraper/pipelines/oss/ali.py sha256=gqNrg_w_KD061bFl-Xaf18X1-rAllDI_l7U5aT7Rdb8 2760
gzspidertools/scraper/pipelines/postgres/__init__.py sha256=Fhhq6h-FpGTY-JkxgNvcZaZzWL9COaqfdRzO_YeSUYg 2140
gzspidertools/scraper/pipelines/postgres/asynced.py sha256=8LB9uBlaoAHFYCmMpBUFqvF9qsKR7bWLaDqnqWA_wP0 1995
gzspidertools/scraper/pipelines/postgres/fantasy.py sha256=GCbckhs-DES0XCLWugHZvRAhDSm--ucpX4Z_56x8X98 179
gzspidertools/scraper/pipelines/postgres/twisted.py sha256=SBO-Rep_QALXn0b6G4-qbO9hb_aM-IrNCskIFUu5XrU 2874
gzspidertools/scraper/spiders/__init__.py sha256=fHGn9qmgOlBUa8HMAIrQutooUmY2VrKKz3OCnG47--w 6164
gzspidertools/scraper/spiders/crawl.py sha256=ykT0BFqLOE-NIYQz8gkC8MsQURoHKn8Uce7OnYgMHSU 333
gzspidertools/spiders.py sha256=7wc2QED5b9BZC5pHrbbs0P5NfQvi98GWPY8O7zEO0YM 176
gzspidertools/templates/project/module/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
gzspidertools/templates/project/module/items.py.tmpl sha256=yh9B711-0HpTwOEcnjs0jq0_bq3YJeHp55a5bMNI78E 282
gzspidertools/templates/project/module/middlewares.py.tmpl sha256=7-TmGsS37zZLxBAp6PpjSoLfk9WOX8if6iwzxSW4CZk 3765
gzspidertools/templates/project/module/pipelines.py.tmpl sha256=9hvuACa2qDUo25_aqF9SeSD__N7v8lkWTTCrDspFp-8 381
gzspidertools/templates/project/module/run.py.tmpl sha256=Sf0E1-EqSv6v0vV4ynshrB4yWANwGPuLf93Zc95eaPM 87
gzspidertools/templates/project/module/run.sh.tmpl sha256=DFyOk8tCT9NK3PZONKL09Q5XqV3GLsKmdxcZhUePCs4 164
gzspidertools/templates/project/module/settings.py.tmpl sha256=3Hw_iH7zEQ76eFWj90v9JTEAScI7_uvETUcwvmt2QA8 1366
gzspidertools/templates/project/module/spiders/__init__.py sha256=a-Jax6MTMZC2HOw3mUBcNu-T44dOUHDsb22Oly4HTnM 165
gzspidertools/templates/project/module/VIT/.conf sha256=ICASAZgLQGHG8t6V0Jg3Ye-N3c_71ImTWMJhCXunuqU 5654
gzspidertools/templates/project/pyproject.toml sha256=Ei-jOdTs9Bmmq75mHuhwNwt_XAIbQ2LFCluVnPbz54g 67
gzspidertools/templates/project/README.md sha256=7zB0VlYPtocHZ_Q_qVnZtzY5PqqqMuDJzdxKQ2lZ540 38
gzspidertools/templates/project/requirements.txt sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
gzspidertools/templates/project/scrapy.cfg sha256=nzoegs3cbSNoMTrdHiPZBfA6As6QoDzH9M8PuwYJ6nY 284
gzspidertools/templates/spiders/async.tmpl sha256=A9VcK8fNcL-THA4C6ZM2VO69dMbt9jNMQJ8zIQR8mS4 1391
gzspidertools/templates/spiders/basic.tmpl sha256=SlJL5vtA85SHq_zIc4Vj9tcmAnE7XOiNZJ4AJzGLRAs 4370
gzspidertools/templates/spiders/crawl.tmpl sha256=Vd4RWCWcJ05M6wQvx6d_NmiR3UmkuzVvokfbKNl5yJ0 1255
gzspidertools/templates/spiders/csvfeed.tmpl sha256=lMIa9JX4Rv-h3nmeDI85QuAmtAXiAco0yUECkYFtE9s 565
gzspidertools/templates/spiders/dp.tmpl sha256=3UjFuAS1L-v02tTPvmruR1etiWROHS7w5kP4UiCUHRg 4496
gzspidertools/templates/spiders/sr.tmpl sha256=XsavKugu-oWgpd3GIpGDC_G8akyfoylUsPLY64EmQt8 5457
gzspidertools/templates/spiders/xmlfeed.tmpl sha256=n3ORdlT0ktyOuz2ku4-2_2LkPkVfh_QO9aKt2pBQQMQ 559
gzspidertools/utils/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
gzspidertools/utils/cmdline.py sha256=bEZrAamFA0F9eg2Cjj5-Pttv-137bLRKv9FN7vB-qhA 6024
gzspidertools/utils/do_cmd.py sha256=1FS4S88P5XTr95F_dEvBTZjfVfJ6EBtcD4LcMXa_fY4 1129
gzspidertools/utils/text_verification.py sha256=G81zD6HJQ-x9WXjX8IkaYdX7B8LAXK9sM8KDlnVmnuM 3077
gzspidertools-0.0.18.dist-info/entry_points.txt sha256=-A6AlGpokAMeMxN6ysltpOB5J6Y9rOdmCm96-pcPtTI 61
gzspidertools-0.0.18.dist-info/LICENSE sha256=tbweTWGNiQ0cDAs6_VBc0ZY8CvNxgIso7jUA1QkubSo 1091
gzspidertools-0.0.18.dist-info/METADATA sha256=S5NLpZRdzbTGwjGUsbWZBtBpHKWSx5fvpWCRAHm09o4 5124
gzspidertools-0.0.18.dist-info/WHEEL sha256=FMvqSimYX_P7y0a7UY-_Mc83r5zkBZsCYPm7Lr0Bsq4 88
gzspidertools-0.0.18.dist-info/RECORD — —

entry_points.txt

[console_scripts]
gzcmd = gzspidertools.utils.cmdline:execute