ai-dataproc

View on PyPIReverse Dependencies (0)

0.1.0 ai_dataproc-0.1.0-py3-none-any.whl

Wheel Details

Project: ai-dataproc
Version: 0.1.0
Filename: ai_dataproc-0.1.0-py3-none-any.whl
Download: [link]
Size: 128609
MD5: 3c33a508dd9768d1d21d9edd9e3f6806
SHA256: 877dfcde3aef9bda3e8836e6731df28bc9ac4979fa16f537b9c52634a389b91f
Uploaded: 2022-07-27 21:26:39 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: ai-dataproc
Version: 0.1.0
Author: nuxion
Author-Email: nuxion[at]gmail.com
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Requires-Python: >=3.8,<3.11
Requires-Dist: Unidecode (<2.0.0,>=1.3.2)
Requires-Dist: annoy (<2.0.0,>=1.17.0); extra == "words"
Requires-Dist: arrow (<2.0.0,>=1.2.0)
Requires-Dist: beautifulsoup4 (<5.0.0,>=4.10.0); extra == "crawl"
Requires-Dist: cityhash (<0.3.0,>=0.2.3)
Requires-Dist: cloudpickle (<3.0.0,>=2.0.0)
Requires-Dist: cytoolz (<0.12.0,>=0.11.0)
Requires-Dist: dateparser (<2.0.0,>=1.1.0)
Requires-Dist: emoji (<2.0.0,>=1.5.0); extra == "words"
Requires-Dist: extruct (<0.14.0,>=0.13.0); extra == "crawl"
Requires-Dist: feedparser (<7.0.0,>=6.0.8); extra == "crawl"
Requires-Dist: gensim (<5.0.0,>=4.1.2); extra == "words"
Requires-Dist: iso3166 (<3.0.0,>=2.0.2)
Requires-Dist: langcodes[data] (<4.0.0,>=3.2.1); extra == "words"
Requires-Dist: langdetect (<2.0.0,>=1.0.9)
Requires-Dist: lxml (<5.0.0,>=4.6.3); extra == "crawl"
Requires-Dist: newspaper3k (<0.3.0,>=0.2.8); extra == "crawl"
Requires-Dist: nltk (<4.0.0,>=3.6.4); extra == "words"
Requires-Dist: pandas (<2.0.0,>=1.3.3)
Requires-Dist: pyarrow (<6.0.0,>=5.0.0); extra == "crawl"
Requires-Dist: pymediawiki (<0.8.0,>=0.7.1); extra == "social"
Requires-Dist: pytextrank (<4.0.0,>=3.2.1); extra == "words"
Requires-Dist: python-Levenshtein (<0.13.0,>=0.12.2)
Requires-Dist: pytrends (<5.0.0,>=4.7.3); extra == "social"
Requires-Dist: pytz (<2022.0,>=2021.1)
Requires-Dist: reppy (<0.5.0,>=0.4.14); extra == "crawl"
Requires-Dist: scikit-learn (<2.0,>=1.0); extra == "words"
Requires-Dist: scikit-network (<0.25.0,>=0.24.0); extra == "words"
Requires-Dist: sentence-transformers (<3.0.0,>=2.1.0); extra == "words"
Requires-Dist: sentencepiece (<0.2.0,>=0.1.96); extra == "words"
Requires-Dist: spacy (<4.0.0,>=3.1.3); extra == "words"
Requires-Dist: tokenizers (<0.11.0,>=0.10.3); extra == "words"
Requires-Dist: transformers[torch] (<5.0.0,>=4.13.0); extra == "words"
Requires-Dist: tweepy (<5.0.0,>=4.0.0); extra == "social"
Requires-Dist: ujson (<5.0.0,>=4.2.0); extra == "crawl"
Requires-Dist: xxhash (<3.0.0,>=2.0.2)
Provides-Extra: crawl
Provides-Extra: social
Provides-Extra: words
[No description]

WHEEL

Wheel-Version: 1.0
Generator: poetry 1.0.7
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
dataproc/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dataproc/cache.py sha256=CD_2_5Fj4D-LlYHjSQ5uK9yF7uUh0l1p1Ddnh41jNpM 5567
dataproc/clients/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dataproc/clients/crawler.py sha256=E7t25zYa-hHG9uk2Z4wepgRCTu0cIYgBpYm3I9dnOlk 7005
dataproc/clients/plasma_lib.py sha256=hFLoWLGBU70z7gfPh8i9THYqZGJK0wmvrjZNSk5yeBQ 320
dataproc/cmd/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dataproc/cmd/feeds.py sha256=s01d5BbtlAgGPlj4ds099oG-YbaWdqYRwWIGgFoY3ss 1010
dataproc/cmd/manager.py sha256=sB5pe0tjB_y8I0fA49WjEPAGAXMmQLda0BjnovQnLDg 1345
dataproc/cmd/plasma.py sha256=RHFSZUp9E4bt3v2gmeZLkr6-0QRfs2gjO9wbK-qKAgI 469
dataproc/cmd/site.py sha256=3KqLOwhLhMzMcQeF9_TWtwpXgIUyZQJUAIsXfLJ4jHA 3478
dataproc/cmd/workflows.py sha256=3Xf4lmGI4qSQ4vUCtN4tFXwruSY-BB7cgC5LEfbj7vA 1190
dataproc/conf.py sha256=klgQlEExWgp6VL-P5tz8DneiW4I3Oz8GdzJ6ASIzC08 3078
dataproc/crawlers/__init__.py sha256=W1Y7L5KF3IbhZJu4CmRHmKjMp9R3QthVPSEokZ5L_V0 504
dataproc/crawlers/batch.py sha256=x4lgQC5JQlxfi5ibsvs_vdByFFDNK1n2tuOAJ4lIh58 7822
dataproc/crawlers/batch_root.py sha256=iChlWB03IROtEGUTWxAWv9mesnYx6cTVOuLO8t1e5eQ 5357
dataproc/crawlers/datastore.py sha256=j4jNvcC-qlnO7J_HB0F2vZzNbRUwLL9J5dNCJ7whQK8 11200
dataproc/crawlers/documents_index.py sha256=HUxjQDFYlnsdz1k-ABLzm2J6veWrXfhDyPGym2H3114 1572
dataproc/crawlers/fetcher.py sha256=-LMijzFjoA3Kx6VQJmVKYcoNM21fxQmVvZdHtO02vr4 9106
dataproc/crawlers/google.py sha256=4vefbFFdY8Pv1DxxcC83xFYOcV2XffA8Ny4FvwDwHS0 5796
dataproc/crawlers/http_client.py sha256=IGWyawKdnTFpGTWc4EQ4y2o6ljBojnr327BEyPwGg1k 6622
dataproc/crawlers/image.py sha256=jLuR3k7ScKOlTZ05dZyadhsWnHcdy43KIUI5FDKSYUw 1481
dataproc/crawlers/indexes.py sha256=YhTtBqp4wFG_ghWoN9d5TYeBaXaHKoT6bEEgXa-Zfpo 6877
dataproc/crawlers/links_extractors.py sha256=dBsrGlJw3J2SqsFV2564OF4ZazDtwTC1ZC3oJTQ2Vfk 3345
dataproc/crawlers/managers/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dataproc/crawlers/managers/bucket.py sha256=FAodRnITTZoCnJc8-WGuBPKb_3EvQdpZ5D-RdIEryBE 3141
dataproc/crawlers/managers/data_task.py sha256=cTvAYqRys6P6K34vF_emkVTcB09zqndEN169DABoMJU 5619
dataproc/crawlers/managers/page.py sha256=Df5Bqqw1-z-3h1FXcGaT6CnZuz8g_nlcDTJ1k36nLmg 5991
dataproc/crawlers/managers/site.py sha256=yJRBFOTaqZECHsXTwt8QvbUv92sYyup2ZLUxMNe7bVE 12800
dataproc/crawlers/models.py sha256=d34kW2en9tASQoljQeVtTIvBS_dD9jir8vngPAPoXzg 6480
dataproc/crawlers/page.py sha256=BNgRTOHqbW-ns1vcK23-5alVe_-80n4wghM0B3RzD-0 6783
dataproc/crawlers/parsers/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dataproc/crawlers/parsers/article.py sha256=8snZWrtPaLYRg76t4oMfLSRJRWJqNUNVyXns5XWzHjQ 438
dataproc/crawlers/parsers/authors.py sha256=4g8amcckIthzYyfuuH5IThxa21HySutAFZRz5n-dhL4 3934
dataproc/crawlers/parsers/html.py sha256=GiUeyN5Qmz7AC6KrAtS8mpcgaZyXecmrw3jgU8P0lk0 5691
dataproc/crawlers/parsers/mppage.py sha256=CiyLAPdotnfu-nX4f5WEvud4ToJqOYaSav_8RbqTIvc 3347
dataproc/crawlers/parsers/page.py sha256=0a8YpVBnzylWBq5b1yJh3arBHe4TLbbQ3NbOid-q-X0 5103
dataproc/crawlers/parsers/rss.py sha256=qaCyLdgFQ83p9d8vkOE_m6KtckQOsWmTUIVj507szY8 4597
dataproc/crawlers/parsers/sitexml.py sha256=kIxGl_wEC6wizDqPGIKIo6m8AYCVBFVS6Q82LTMtMTY 2982
dataproc/crawlers/parsers/url.py sha256=eszqkjxuuhDNTw04EeMvGWNNik0hVUi3F68dTHm4w9Y 5846
dataproc/crawlers/root.py sha256=WcevnLXhSonn5q_fI4kn2Q6t_xdk3x63vDORNPU6-Hw 9440
dataproc/crawlers/url_index.py sha256=OF4EdP8V7NSudu7haPwSxcBoJDh1FrD-yqcPLMJPZj8 11509
dataproc/crawlers/utils.py sha256=qJNteLMIWcjqaN7xzfA4TdGCkzCCItauc7cBEvsvvhA 1768
dataproc/crawlers/web.py sha256=amgyZAnS4vhqF7vWJjxzS9qc55IPfxOEmMUumsa_ZRc 7525
dataproc/crawlers/youtube.py sha256=-XMg-xO-sPNIkWqoD7Y_iPbOtQI6Jg6on89tO8hDnkI 1013
dataproc/datasets/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dataproc/datasets/dataset.py sha256=EhXqVr8nFeauBMTAgdPqfKrd-JNFoIJ-qO5tcM_NQ6Q 5241
dataproc/datasets/managers/dataset.py sha256=x4Mi3yXymMLK0OvEhmxnQ4PPPn7A8AJwpOX1Aw8qJ2Q 1727
dataproc/datasets/models.py sha256=YympRpXiUWV8CmutOzSMJSQMAXxGerjZY5otQ_eMsks 2714
dataproc/datasets/table.py sha256=lHwqMfELiYwiXcKEk1ycfYwPVtmMec_8zMQLJFqJ_lU 4543
dataproc/datasets/utils.py sha256=lvY8TYCrSnhhkF5DasApXWCtFBRKnMw0rlj2UjtfTkE 1194
dataproc/datastore/__init__.py sha256=AbKn1GTqKaO3RC7bI66mrwbD-P-wKwmNAXPgauAxGCo 62
dataproc/datastore/base_model.py sha256=NKVWZfFbWBrqF5EVkojRiVQEjeGWEe_sg4Sq8pCIvj0 843
dataproc/datastore/core.py sha256=W_Mi_DqSorct3DTN5p_Tg9KgrF0CMCVyo3l19H1RQG4 7479
dataproc/datastore/managers.py sha256=gkLCN2H4GXWkPsF2NkKLL4EDepb-62BchX0-JCLm3dM 4817
dataproc/hashes/generators.py sha256=3kBUlhVNdeQNdAxQak7p7EmnY2JfdIT4l5id_0KOyIM 4092
dataproc/hashes/newsid.py sha256=SvYewYI-Le7TxreRBh-Gib0UFx79ZNkrxlBpz0sWllo 1370
dataproc/hashes/noncrypto.py sha256=d9ash3tmi65QPaOdQj8dEIrxMujze67RTLPyi5IVRzs 1670
dataproc/hashes/objectid.py sha256=iXZBCpej76JFW2wdKa8GMcn1Zhp_EQg0xwNUBGyTEec 8920
dataproc/http_client.py sha256=w0z43IJ6uGbSDpH2Bx3QK8v_xImqla72MqIzHWCXs_U 7024
dataproc/regions/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dataproc/regions/models.py sha256=v9uDUl_MdwXzcyyTesKZxbgAKz5Xyd6Wb9-xbYYlGUc 927
dataproc/regions/places.py sha256=5RASE5900vz_xEFpko-lZ9suMD4RGg1llBW6QxjVHJ4 1796
dataproc/server.py sha256=dolLc6XynP9Hkkmyww2FfOwadMp8isv3vPnOGQBW1pA 2165
dataproc/shortcuts.py sha256=BVVZtlfEORzjPhrFnfVOd2ZFhlxPjeaMyzCd2Moayfc 699
dataproc/social/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dataproc/social/core.py sha256=VFw4sJIt4Zc0-__eYnksN8Ku9qMhbPpHJEkXMWUiD30 4
dataproc/social/google.py sha256=B5TgnNUvV0yEixKvzZ--mc1IpVZSrCg4PrKpaaCU01s 3205
dataproc/social/linkedin.py sha256=RfhM83aUUY_igTIx9TGbPB_f32EezTRBb8g6fXdz0RI 4534
dataproc/social/managers/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dataproc/social/managers/bucket.py sha256=ImIk5VXILdOE5tPZ8KciN7bOLpeKk5RLm1qme0_daJU 3042
dataproc/social/managers/google.py sha256=xGqwcVfe5-MLjQ6j_L9P-Xt2aT1fdvYWg3No4Fsdv8E 4234
dataproc/social/managers/twitter.py sha256=CDGmdS2RVkkJDmpWB-OdGFOwpahMoDfiPslsm4X1VC8 4718
dataproc/social/models.py sha256=WVSSKhb-i4emjjzbZOT97ThmF39xEMfdi-fx-WpxSns 3077
dataproc/social/twitter/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dataproc/social/twitter/api.py sha256=g3a5QJHYmOVvYboR3DzczqWVzXUz60DZ_1Cr6PY_HlU 3819
dataproc/social/twitter/core.py sha256=pkaqPN-kHpNfb6aJ_IyTq6xYs6VS1TIhNcgSUG_27Yc 6512
dataproc/social/twitter/twitter_ml.py sha256=eWhTLud9IB7j_RMwF6NAJL51GaT1dowUmtqaszj8lSA 1707
dataproc/social/twitter/user.py sha256=huZopWZgMGgWOkHZ7iSD64R_kMNM6liyHc0aw-_4xM0 2203
dataproc/social/twitter/utils.py sha256=psXLNxhsYn0XS20bYQ-1Wqnid157PLZj0m6x9hm8HKc 4285
dataproc/social/wikipedia.py sha256=u_PvzLEwGdC3Egix5mcX_Us-pxxBxFLpemj_ZUOGVJA 998
dataproc/utils.py sha256=IrRp-K2ZwSx_60HoyvJOrg94lXv81TQbuHpIseU6EgI 5043
dataproc/words/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dataproc/words/clustering.py sha256=qNSesqALk5wfn4p21CjO7zaBaHpvCES4x6PHDObPJSM 440
dataproc/words/corpus.py sha256=ZUCSa-oyhXfpLZzXePzOtjoTbjW7gIMr2cm1EQoh_Gc 1929
dataproc/words/entities.py sha256=Rd_JORqGS9nM5DQayu7ZSVbAb-QIADvBDNXMBu36trc 5343
dataproc/words/iso_639.py sha256=G2__0iTMBvvPGCdZM9twu4FKYfG1rxaZSU8DAiJaCrY 5724
dataproc/words/keywords.py sha256=xNcw160s6429i0bFaWLm-8dNwbKC3QzQKviu6KhR54I 1954
dataproc/words/lang.py sha256=YiueXAfAeCH9mzOhUyB4Tw8vMKh66QlSo-XGVW46uY4 793
dataproc/words/lsi_models.py sha256=qJRr1tyknxtATWTWqnT-gI4SOAf1GZEotdRRSS4w35c 2863
dataproc/words/ml_models.py sha256=PMWA-1LbIa24d23IN0b7fBUr_4QKBLvtnoN0C4gtXN4 4701
dataproc/words/models.py sha256=SveGKP7B_XLqrmr9Exkc3mYrReiB3oLNtv0gVAd-LaA 5173
dataproc/words/nlp.py sha256=Lq7qJT9JYDWkFjgsLjcvHnPmWclZ16wwxskv8mlMh7M 465
dataproc/words/parsers.py sha256=CZEj6ScMaEuO-Rge-2GcOgwA3iLTPpjsdGNoQ6UyE9M 3029
dataproc/words/persons.py sha256=K7-Bes2GhVA_NMKkp_y7yWCJbHH2Z7FeWqSSSeKCO7c 5043
dataproc/words/ranking.py sha256=sZNt5ub9741KRzK0u8dKkjIZuqPGho15MF-nWWz-wLU 4780
dataproc/words/transformers/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dataproc/words/transformers/classifiers.py sha256=0M-9FvFF8EnjauohznMjKK6DBaHIAg_LdpdX7GhgRlg 2895
dataproc/words/transformers/core.py sha256=HtMnYOdzzpU70IqmWLQFZ2G6pXvrDwkJT7_Da267Xl8 5208
dataproc/words/transformers/translators.py sha256=740StgEqTjVsOiytP2_xUK51K5TPG6dOXEw7sJ02yiU 4476
dataproc/words/transformers/translators_mp.py sha256=PH3F_APbgq7tqujYddoZzYBg7K7huzQUNTCDHv3ny8s 4950
dataproc/words/utils.py sha256=z2xOkolq4fe4OxJSmpNqcEspYEMA-FgIfJlSA7t9Rxs 7282
dataproc/zio/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dataproc/zio/broker.py sha256=iB34hRfNbzqEiJpDP4h9dlVHgBn1a-zUKsPDGEze4cU 2353
dataproc/zio/cluster.py sha256=P6o2w45Qasa3IRJKIh7IDPBtE06UAuqhPMAll4GdPGI 3692
dataproc/zio/utils.py sha256=or1rCHtSsXnSyTEMu3hAq6qrmTrnUMlWp305KRMhyNA 1216
dataproc/zio/workers.py sha256=OYtOIrYzb98ZChMvgtm2PTwiqBoY8Eg5G7wiudIUG7s 7055
ai_dataproc-0.1.0.dist-info/WHEEL sha256=y3eDiaFVSNTPbgzfNn0nYn5tEn1cX6WrdetDlQM4xWw 83
ai_dataproc-0.1.0.dist-info/METADATA sha256=HW3VWCnAT7xtl0y9KfYxiw983ApreZ_Zz0gDQbYKkwA 2370
ai_dataproc-0.1.0.dist-info/RECORD