PaperCrawlerUtil

View on PyPIReverse Dependencies (0)

0.1.39 PaperCrawlerUtil-0.1.39-py3-none-any.whl

Wheel Details

Project: PaperCrawlerUtil
Version: 0.1.39
Filename: PaperCrawlerUtil-0.1.39-py3-none-any.whl
Download: [link]
Size: 126835
MD5: 01609b27075e9c592883e04196b51200
SHA256: f9f9abd56cee49b5ee9eaf946da6c5e6023ab9a63d7416ecaf654ad0f9663c98
Uploaded: 2024-02-14 17:31:12 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: PaperCrawlerUtil
Version: 0.1.39
Summary: a collection of utils
Author: liwudi@liwudi.fun
Author-Email: a154125960[at]gmail.com
Home-Page: https://github.com/Liwu-di/PaperCrawlerUtil
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Requires-Python: >=3.6
Requires-Dist: aiohttp (==3.8.1)
Requires-Dist: attr (==0.3.1)
Requires-Dist: attrs (==20.3.0)
Requires-Dist: beautifulsoup4 (==4.11.1)
Requires-Dist: environs (==9.5.0)
Requires-Dist: fake-headers (==1.0.2)
Requires-Dist: fake-useragent (==1.1.1)
Requires-Dist: Flask (==1.1.4)
Requires-Dist: gevent (==21.12.0)
Requires-Dist: googletrans (==4.0.0rc1)
Requires-Dist: loguru (==0.6.0)
Requires-Dist: lxml (==4.9.0)
Requires-Dist: pdf2docx (==0.5.4)
Requires-Dist: pdfplumber (==0.7.1)
Requires-Dist: pyquery (==1.4.3)
Requires-Dist: requests (==2.28.1)
Requires-Dist: retrying (==1.3.3)
Requires-Dist: setuptools (==61.2.0)
Requires-Dist: tornado (==6.1)
Requires-Dist: redis (==3.5.3)
Requires-Dist: markupsafe (==2.0.1)
Requires-Dist: PyPDF2 (==2.4.2)
Requires-Dist: tqdm (==4.64.0)
Requires-Dist: PyExecJS2 (==1.6.1)
Requires-Dist: xlrd (==2.0.1)
Requires-Dist: xlwt (==1.3.0)
Requires-Dist: pymysql (==1.0.2)
Requires-Dist: sshtunnel (==0.4.0)
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 19807 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.37.1)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
PaperCrawlerUtil/__init__.py sha256=whyQd3uxIDAWFj16z4ivrVt-EKi3jLO6SJ4Jp17RsEk 508
PaperCrawlerUtil/application.py sha256=gM_48cpbQk4FQWGn4pkxXihV0mKHWRew8p8G7f0ISq0 5137
PaperCrawlerUtil/common_util.py sha256=eWXfO7VOezK1qpxbNwCpqVzC-e4mPBpqPP4DHKqlWHA 57404
PaperCrawlerUtil/constant.py sha256=c6r8kgff1tC09wxYFhX3Zc3dKF0hGb9P4lIlLl6k0gc 13327
PaperCrawlerUtil/crawler_util.py sha256=ypIo7Il-aLt31Y5QUOPiUJCIsIkCsAcQ1huPdjYBy0Y 19491
PaperCrawlerUtil/database_util.py sha256=5_6Lk9d9IYXgKZwFMS1OSX5_ei8OKn8tx2Ps73PhWtc 34043
PaperCrawlerUtil/document_util.py sha256=egJ-Gj8Es3Py8w1vVjO9xoSdOu5Y4zoJdtqSLqMaj0s 49871
PaperCrawlerUtil/global_val.py sha256=wXFSIUInzgf7BA8K9YDYV3D2ewCeIpztkDtXOjunYm4 680
PaperCrawlerUtil/log_util.py sha256=fnxPQ7AGSVg9HxM9TjZD6sfjSwakBORtoryhwxSQRfY 8672
PaperCrawlerUtil/proxypool/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
PaperCrawlerUtil/proxypool/scheduler.py sha256=cXoP0Lel8DGOkmGc_KVRt8Rd0gWal2uvPN8rtQTm_CU 5698
PaperCrawlerUtil/proxypool/setting.py sha256=saTe6yd_o_sjSrJahp9WQquo7SXxiBlxoPVH-gFyT0M 1732
PaperCrawlerUtil/proxypool/crawlers/__init__.py sha256=dQgjmZF3XbijwgnFuqUJwlv1y4t1SlFv5PNmwebghQI 548
PaperCrawlerUtil/proxypool/crawlers/base.py sha256=-X5F9qk0A2f7Gvq-EygR28LfLko3EXfG37ZDh_RBi4U 1896
PaperCrawlerUtil/proxypool/crawlers/__pycache__/__init__.cpython-39.pyc sha256=B3t4gkfc7LzMLspa7SF67Cq5Jp2emOwLjVkzD2Whclo 593
PaperCrawlerUtil/proxypool/crawlers/__pycache__/base.cpython-39.pyc sha256=xKxToupBnGG-04DGrUd-FFp4FLV8GPmM-_7bilVmyPs 2123
PaperCrawlerUtil/proxypool/crawlers/private/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
PaperCrawlerUtil/proxypool/crawlers/private/__pycache__/__init__.cpython-39.pyc sha256=HfTav7y8-0Yq7wgTSGEW6-T0NfRXubokrCXMp7VPhQc 185
PaperCrawlerUtil/proxypool/crawlers/public/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
PaperCrawlerUtil/proxypool/crawlers/public/daili66.py sha256=TCAN1K11bOuFty6xnLxSPHpc4INq6O57uJs0iLlpBpo 902
PaperCrawlerUtil/proxypool/crawlers/public/data5u.py sha256=f28oe2J1N2GxKzVcVjCcoQ7Rq_bnIHzKq5l_ru4OqDA 816
PaperCrawlerUtil/proxypool/crawlers/public/fatezero.py sha256=RLDPUN2SEjPq6En9Dqa_xseQC3QnC-L932n8wOdO0qU 846
PaperCrawlerUtil/proxypool/crawlers/public/goubanjia.py sha256=SpqcYcBP2ZSwlzbGuF-WJxEiX1XEKa10l0qZinlbGwA 1382
PaperCrawlerUtil/proxypool/crawlers/public/ihuan.py sha256=mIqgMmMnuC4eI_t9BIPC4aWJpwCtRWpCIjOTqPlkxuc 1038
PaperCrawlerUtil/proxypool/crawlers/public/ip3366.py sha256=a7y2Hvl6w63ezwlt9v_DZcFcSRk_S0Cys291DJaJXo0 967
PaperCrawlerUtil/proxypool/crawlers/public/ip89.py sha256=6FKPVnvU18q2-2Duxv2XppwzmubV0Tg8i0iBIy7GO9A 948
PaperCrawlerUtil/proxypool/crawlers/public/iphai.py sha256=uXG8QUT_vvjUJh0w3kJFheD2T2oo31Nao5MV5aOrpZ8 1089
PaperCrawlerUtil/proxypool/crawlers/public/jiangxianli.py sha256=60gz5_C-F0q5fgbQdzxaJ47vjrQ2xPk2ctLKv9Hmi5s 1046
PaperCrawlerUtil/proxypool/crawlers/public/kuaidaili.py sha256=tLiU0qAHGjhPmk0oSreLvjHekCza3_FSpA8rT6rlBfc 983
PaperCrawlerUtil/proxypool/crawlers/public/seofangfa.py sha256=bsjqbheRTxJkDe8V66mH7etLzYHD081E5bGZcvffJaw 928
PaperCrawlerUtil/proxypool/crawlers/public/taiyangdaili.py sha256=JDiNwArg7_xi90p8YwFgfINXT8dXEB9aaY8uUJoiCao 902
PaperCrawlerUtil/proxypool/crawlers/public/xiaoshudaili.py sha256=IFRuM0OfffdKY6sRw-xPOh7u99voy5W0vrTOf2XtJp0 1544
PaperCrawlerUtil/proxypool/crawlers/public/xicidaili.py sha256=4Iqja_-C09fSXpMYsFvjpoad0vkNcM0mTY5X7I0BTMU 1007
PaperCrawlerUtil/proxypool/crawlers/public/xiladaili.py sha256=uMaHZiFstzutfGJDaNUIH0AaG8ZdqWCHpgJhWr3RWCw 869
PaperCrawlerUtil/proxypool/crawlers/public/yqie.py sha256=owMYAbSgeQlX7PhKl3_3iQi_9gAQlm_H3MVa-r7Tst4 843
PaperCrawlerUtil/proxypool/crawlers/public/zhandaye.py sha256=X4L2nGBWyAS5jErtX2eCieSY1cmMVJLcxMjhtMAm0bM 1846
PaperCrawlerUtil/proxypool/crawlers/public/__pycache__/__init__.cpython-39.pyc sha256=nNgXn1KFrJjMOrQm6KkMbhHdQ2s2b4WgSP2EyMFED78 184
PaperCrawlerUtil/proxypool/crawlers/public/__pycache__/daili66.cpython-39.pyc sha256=qDRLM3H1K09hEamCrQO6XcAj1gjABioiSDa8Wq1Qb_s 1368
PaperCrawlerUtil/proxypool/crawlers/public/__pycache__/data5u.cpython-39.pyc sha256=6yiyQpRgLjlEItC1cIBG7BZH3OucnT1GENm--gjnH3o 1136
PaperCrawlerUtil/proxypool/crawlers/public/__pycache__/fatezero.cpython-39.pyc sha256=i_VebWPMsyBGg0Bpg0l1RIRDCsi-SMJN_dkPgbWwNTw 1100
PaperCrawlerUtil/proxypool/crawlers/public/__pycache__/goubanjia.cpython-39.pyc sha256=t_MhD_XlXrOYp7oqT5ZLSUS_DTsq2Y8X0bektraBOik 1341
PaperCrawlerUtil/proxypool/crawlers/public/__pycache__/ihuan.cpython-39.pyc sha256=5k-ltkLYdW7_7VhWLIUCfDiIIcoSLbd1r2xNrkMwWSQ 1267
PaperCrawlerUtil/proxypool/crawlers/public/__pycache__/ip3366.cpython-39.pyc sha256=xXbNyYKdUOCqq2WfYvfC_bvOtnCRmc_jH-A45bkrvIg 1383
PaperCrawlerUtil/proxypool/crawlers/public/__pycache__/ip89.cpython-39.pyc sha256=Nde4r8xbnwMKC8zjVqqIF-w9IyVUKkhlkwFMIL8LfOE 1212
PaperCrawlerUtil/proxypool/crawlers/public/__pycache__/iphai.cpython-39.pyc sha256=5of6XCegiMpbvUhxyW9CQk-kGMVOfEVJODdXlJT1obw 1309
PaperCrawlerUtil/proxypool/crawlers/public/__pycache__/jiangxianli.cpython-39.pyc sha256=f71Z2pKkCUtbMYU60okvghbyWJP1nUvzgc7UbiFJkas 1399
PaperCrawlerUtil/proxypool/crawlers/public/__pycache__/kuaidaili.cpython-39.pyc sha256=PQ6fYs61C7TTuqK-nXbkxUTLIJxRPucEdY2znBBsdNE 1419
PaperCrawlerUtil/proxypool/crawlers/public/__pycache__/seofangfa.cpython-39.pyc sha256=tHBEDSXHpnUl3LsL27gtl8KkU9GxdEJfGk513hOkHUY 1255
PaperCrawlerUtil/proxypool/crawlers/public/__pycache__/taiyangdaili.cpython-39.pyc sha256=u0-X_UQL0k3d1MqpLYeKwKaI5yyFwoTKLgDDQxc05mE 1386
PaperCrawlerUtil/proxypool/crawlers/public/__pycache__/xiaoshudaili.cpython-39.pyc sha256=N7NU1cZ99pX-Bd6rU3ROuS_NMX0wWm49PArhBTaE_lM 1897
PaperCrawlerUtil/proxypool/crawlers/public/__pycache__/xicidaili.cpython-39.pyc sha256=TjTBJvGvrjByEnZLk8KdTDLRzXMVP3gsAeyjnBv9wFk 1266
PaperCrawlerUtil/proxypool/crawlers/public/__pycache__/xiladaili.cpython-39.pyc sha256=VN8GYNUskRDgpY9pDBVpJ0-DZdU7KXE65wXHlVCNE_k 1166
PaperCrawlerUtil/proxypool/crawlers/public/__pycache__/yqie.cpython-39.pyc sha256=VYF77ZDIbTCFMRXwprwPTT4O_fpjL1ql8ANIHiOy3bY 1176
PaperCrawlerUtil/proxypool/crawlers/public/__pycache__/zhandaye.cpython-39.pyc sha256=pmd4BglINf9D7F8pI4UqQF6-EHJPaJj2V0KRJDSGFgU 2469
PaperCrawlerUtil/proxypool/exceptions/__init__.py sha256=nKr5fC8iEvOAG66GifLaubpz1Z3uMpnzPm5NiWoqtts 39
PaperCrawlerUtil/proxypool/exceptions/empty.py sha256=c3eLR2FvHcVDJLb0NNPRmd8RGtXeanSwWcr1BEAccv4 183
PaperCrawlerUtil/proxypool/exceptions/__pycache__/__init__.cpython-39.pyc sha256=i4_OJtGptfcif0sIxV2I2Hq7-ckORyDYK_Q8OlbT78U 227
PaperCrawlerUtil/proxypool/exceptions/__pycache__/empty.cpython-39.pyc sha256=G156kEvHXJ28FvcapfKKs30nO2Q0cSACFTCOoAGXM2E 562
PaperCrawlerUtil/proxypool/processors/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
PaperCrawlerUtil/proxypool/processors/getter.py sha256=qQ5W2S3wi0OzI4o4gAmcqK6dR6bNx7jy9zLPK4Ubc9w 1727
PaperCrawlerUtil/proxypool/processors/server.py sha256=O7OziLWuhfrNlbydaw900EbjpqLCY05vVa0yzZ5OJKM 2517
PaperCrawlerUtil/proxypool/processors/tester.py sha256=Jl2YvaOHTLiiD1sas-48_niU-sfNXY6T_pwftkahqTE 4903
PaperCrawlerUtil/proxypool/processors/__pycache__/__init__.cpython-39.pyc sha256=0f_E9BavixAn5cbWSpHPPxlV0vcjf-NKpfnj9D0XHhc 179
PaperCrawlerUtil/proxypool/processors/__pycache__/getter.cpython-39.pyc sha256=-p8oiXHXmKiX4_RAIpojtq-TB24N0KGUEVYipmH6bnY 1980
PaperCrawlerUtil/proxypool/processors/__pycache__/server.cpython-39.pyc sha256=TcUyNrgO8OGO7qCB7VXeaeWRObbjp2TXdIMWimbQdpw 2534
PaperCrawlerUtil/proxypool/processors/__pycache__/tester.cpython-39.pyc sha256=A0rBM3JM9tYoW5OYnmgr4z_dlOnSumxb3ykSgifDN5Q 4066
PaperCrawlerUtil/proxypool/schemas/__init__.py sha256=_O-CmbnGzL2j3YA-iQqlz8xblh2kvI66LsxiFgx3zfk 26
PaperCrawlerUtil/proxypool/schemas/proxy.py sha256=GgmcqR9reumAwFkS90TNPC-o0C8fmN015YNP9IkiSso 599
PaperCrawlerUtil/proxypool/schemas/__pycache__/__init__.cpython-39.pyc sha256=L3qlKOUmAbdNEt5Z4JV7JtCTmf1ZJ7y7zZ-zVJRTBs0 211
PaperCrawlerUtil/proxypool/schemas/__pycache__/proxy.cpython-39.pyc sha256=Yog0BCjo3w9C7zqfA7LsAEikRyu0oVFgOcTQ1Hz7KZE 973
PaperCrawlerUtil/proxypool/storages/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
PaperCrawlerUtil/proxypool/storages/proxy_dict.py sha256=vjhmEMdJwvXoaNWWVBRaY9SH4T9DVm5INO2qP9_Qdys 6748
PaperCrawlerUtil/proxypool/storages/redis.py sha256=WSEbCZPQ6NMxyBvvZExoovJHKYREf1xNJvX9S2Glfiw 5712
PaperCrawlerUtil/proxypool/storages/__pycache__/__init__.cpython-39.pyc sha256=_5ZFzZZzaDuPaA8jW0R4rVReKQ8Ex27iURpCRut9KsQ 177
PaperCrawlerUtil/proxypool/storages/__pycache__/proxy_dict.cpython-39.pyc sha256=Rm8dmloyRzIg3_D-jXywkNiUgLMkjyp6cbZd5zWDkjA 6054
PaperCrawlerUtil/proxypool/storages/__pycache__/redis.cpython-39.pyc sha256=3evAImiyPgN9yBGf9hF-l9W1izaaN6_YcdDChhDTu9Y 5601
PaperCrawlerUtil/proxypool/utils/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
PaperCrawlerUtil/proxypool/utils/proxy.py sha256=_w6uQiNtPdZqqrYt5vLDQzyEApXCo971TrB7S_B34Gc 1398
PaperCrawlerUtil/proxypool/utils/__pycache__/__init__.cpython-39.pyc sha256=N8F5895O1w3OWFU2XWwGa0tsV1xnjZqHxdmLkeyDVOA 174
PaperCrawlerUtil/proxypool/utils/__pycache__/proxy.cpython-39.pyc sha256=eHc2SsiXHtx5Cwkl7Pq0piqwFQ8EfPDkglQrPd47rsU 1407
PaperCrawlerUtil-0.1.39.dist-info/LICENSE sha256=W_AYrBFfiDerQFWWuYOKWGtp6RCBLpxlKlU9X53pzp8 1085
PaperCrawlerUtil-0.1.39.dist-info/METADATA sha256=PdhcuwcZAx1Dj5EAFZykx8goNw9aSIfWjZSTTKR2Cgc 26206
PaperCrawlerUtil-0.1.39.dist-info/WHEEL sha256=G16H4A3IeoQmnOrYV4ueZGKSjhipXx8zc8nu9FGlvMA 92
PaperCrawlerUtil-0.1.39.dist-info/top_level.txt sha256=GcWjI7Hc2U-pO_Mv6Ayg6Vaejw1OVhStaDudAPRFGss 17
PaperCrawlerUtil-0.1.39.dist-info/RECORD

top_level.txt

PaperCrawlerUtil