Wheelodex » Projects » toiro

toiro

View on PyPI — Reverse Dependencies (0)

0.0.9 toiro-0.0.9-py3-none-any.whl

Wheel Details

Project: toiro
Version: 0.0.9
Filename: toiro-0.0.9-py3-none-any.whl
Download: [link]
Size: 627886
MD5: 71a8194505c5a888ee8eada0be928561
SHA256: 1b7006409f12810acea9bacdfa310b9d7b26b6ef5e7eec26aafae08245127d36
Uploaded: 2023-07-31 15:07:59 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt

METADATA

Metadata-Version: 2.1
Name: toiro
Version: 0.0.9
Summary: A comparison tool of Japanese tokenizers
Author: Taishi Ikeda
Author-Email: taishi.ikeda.0323[at]gmail.com
Home-Page: https://github.com/taishi-i/toiro
Download-Url: https://github.com/taishi-i/toiro/archive/0.0.9.tar.gz
Keywords: Japanese NLP
Classifier: License :: OSI Approved :: MIT License
Classifier: Natural Language :: Japanese
Classifier: Programming Language :: Python :: 3.6
Classifier: Programming Language :: Python :: 3.7
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Operating System :: Unix
Classifier: Topic :: Text Processing :: Linguistic
Classifier: Topic :: Software Development :: Libraries :: Python Modules
Requires-Python: >=3.6.0
Requires-Dist: requests
Requires-Dist: tqdm
Requires-Dist: pandas
Requires-Dist: scikit-learn
Requires-Dist: py-cpuinfo
Requires-Dist: janome
Requires-Dist: nagisa; extra == "all"
Requires-Dist: sudachipy; extra == "all"
Requires-Dist: sudachidict-core; extra == "all"
Requires-Dist: mecab-python3; extra == "all"
Requires-Dist: spacy; extra == "all"
Requires-Dist: ginza; extra == "all"
Requires-Dist: kytea; extra == "all"
Requires-Dist: pyknp; extra == "all"
Requires-Dist: sentencepiece; extra == "all"
Requires-Dist: fugashi; extra == "all"
Requires-Dist: ipadic; extra == "all"
Requires-Dist: unidic-lite; extra == "all"
Requires-Dist: tinysegmenter3; extra == "all"
Requires-Dist: torch; extra == "all"
Requires-Dist: transformers; extra == "all"
Requires-Dist: catalyst; extra == "all"
Requires-Dist: torch; extra == "all_classifiers"
Requires-Dist: transformers; extra == "all_classifiers"
Requires-Dist: catalyst; extra == "all_classifiers"
Requires-Dist: nagisa; extra == "all_tokenizers"
Requires-Dist: sudachipy; extra == "all_tokenizers"
Requires-Dist: sudachidict-core; extra == "all_tokenizers"
Requires-Dist: mecab-python3; extra == "all_tokenizers"
Requires-Dist: spacy; extra == "all_tokenizers"
Requires-Dist: ginza; extra == "all_tokenizers"
Requires-Dist: kytea; extra == "all_tokenizers"
Requires-Dist: pyknp; extra == "all_tokenizers"
Requires-Dist: sentencepiece; extra == "all_tokenizers"
Requires-Dist: fugashi; extra == "all_tokenizers"
Requires-Dist: ipadic; extra == "all_tokenizers"
Requires-Dist: unidic-lite; extra == "all_tokenizers"
Requires-Dist: tinysegmenter3; extra == "all_tokenizers"
Provides-Extra: all
Provides-Extra: all_classifiers
Provides-Extra: all_tokenizers
Description-Content-Type: text/markdown
[Description omitted; length: 7003 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.41.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
toiro/classifiers/__init__.py sha256=iB7VwfpVsG7jf8zn4XSI5N9XE5dTlK30rUMxzYOcVYI 391
toiro/classifiers/classifier_bert.py sha256=_9oOhs33oUO2mx0pBYCayf1jCV4vl3GKTa4XysyjTWk 9429
toiro/classifiers/classifier_svm.py sha256=rrvSbZEMhb8xs7v36wFyzsSvjoQ8OYPeRW-3d933CsU 2793
toiro/classifiers/classifier_utils.py sha256=-VOMLF0wRdOqE-1dSRscyroORQoOMSOlmL98ao8q3Bs 736
toiro/datadownloader/__init__.py sha256=c5Bnt2a_yPvGxD3d0jl39BlDkVxOpvVqe22PM0GiZSM 215
toiro/datadownloader/download.py sha256=wu59LF33-h1lfQ8Skn52yPnDL2Ucmy1BA_yb6Bgj1U4 2266
toiro/datadownloader/downloader_utils.py sha256=xTsOe_YDaxBcKk_hsV9kYwYLg51yMTNyGgKhu1oGovs 1735
toiro/datadownloader/preprocess.py sha256=pdja4ztkQ0UFMGh9BoCIWWa_XIYf7Me3V-yJB8vi6Pk 14439
toiro/datadownloader/sample_datasets.py sha256=Wg_nSYwXsgh5D6HUBZE-zSuLvHjr_F2fsETX_U0YG5E 321
toiro/datadownloader/data/sample.dev sha256=O2Vz2ig5UhR-Qr6q_f4hLaHBe9b4KX_KoSwT_bHn23g 8257
toiro/datadownloader/data/sample.test sha256=0wwUjVzI_6tzagdI8kBub_Tifk88s_53zGbI97TrMp4 10706
toiro/datadownloader/data/sample.train sha256=JhghA59gC2PHZVcTLUQnMHTcG1MQPefZ1yqKRR_ejVc 66257
toiro/datadownloader/data/sample.txt sha256=ewseeJ2ffOGLkiejQsQln62Bksf9sxIsqRMcw9sXpiE 90137
toiro/datadownloader/data/toiro.gif sha256=rP2XbyzqnB-HUSK6wdhz1P-X4gr4DHnE_eOr0P8wHhQ 253961
toiro/datadownloader/data/toiro.png sha256=pM8QllpdpAUx0pnc8lgwvOVphtAbEVwu1oODh_Zt6JU 72909
toiro/tokenizers/__init__.py sha256=5wU8yNve_YPwErksAXpWmOkm4R4xr2tduEXircd2jZA 2588
toiro/tokenizers/tokenizer_fugashi_ipadic.py sha256=Oeyt0FDx5qD-tAV9lA7x9lem8453qKWCmAWKmMPI7UI 799
toiro/tokenizers/tokenizer_fugashi_unidic.py sha256=2UtGAWVb6hwlzaSYgYMEGoJeBFH-SI6TbzH5ohN2SYc 620
toiro/tokenizers/tokenizer_ginza.py sha256=hEX4DK9GRkN9VeS0MbYil0MPt8VGfCtJaNn6Pgg5WcU 624
toiro/tokenizers/tokenizer_janome.py sha256=-qo0gAdUW8L8prH031LRFIs5wqpBwIpdSqGynncEz9A 640
toiro/tokenizers/tokenizer_jumanpp.py sha256=p5I5T_mvwMxG3UuwDuzPOef6nDT39LG-SFiJKAZ-2-Y 933
toiro/tokenizers/tokenizer_kytea.py sha256=t_YY3XJ-XXS4HsJBTr090QimfuzRiTMJlCsLhiOYdXo 614
toiro/tokenizers/tokenizer_mecab_python3.py sha256=I5ub2clFONtG7Ca5fpuBGOgJD-o3WJaqNX9NfdwtFKw 671
toiro/tokenizers/tokenizer_nagisa.py sha256=DGRZ6TcS85mtqGYgx1xu9XlbPDOga5QLOAREDRjlGHs 583
toiro/tokenizers/tokenizer_report.py sha256=5ZbveSE0dtYPvb3-68EmuzYmSI5H68Hq3pfRdy9p8cc 7174
toiro/tokenizers/tokenizer_sentencepiece.py sha256=gyw1Ux2B4oNN4YvPVxCVCl915GfR9wmA-_Eu6ayE2Ws 874
toiro/tokenizers/tokenizer_spacy.py sha256=PibB75vtf4LE2fHoAoAE89XhIc1uCClpFK8oX-G-E7A 678
toiro/tokenizers/tokenizer_sudachipy.py sha256=oIIBOwO_jtXq8oO57nToxMUJzNUUEVEEgLZvt2OphGM 812
toiro/tokenizers/tokenizer_tinysegmenter.py sha256=qNyi5gxyBzF64_6c-bmPoV8uZ78dYbaFl3CFhM1j6Z4 577
toiro/tokenizers/tokenizer_utils.py sha256=IXVpU7NG5KiOVlJM4DPp_J8ZclGNc39ZfP-3ZyWZM6Y 9517
toiro/tokenizers/data/ja.text8.txt.spm.model sha256=rl3SprLavDir8wHzBvN9Ny-oMTkRhugRW8_JlsYlF5k 352418
toiro/tokenizers/data/ja.text8.txt.spm.vocab sha256=j2JZ5_xK5MlMH9z_ZveNucuCuXUIlpGD67K0C0nG2TU 121892
toiro-0.0.9.dist-info/LICENSE sha256=58nIU2IowkkdamiGEYm7pLtLjRzDjbBteBgGwEy4Seg 11346
toiro-0.0.9.dist-info/METADATA sha256=ZBFlda7uU4jTtRZteZpOt4AcQ9bmHhFkPT1cSIxoxss 10204
toiro-0.0.9.dist-info/WHEEL sha256=AtBG6SXL3KF_v0NxLf0ehyVOh0cold-JbJYXNGorC6Q 92
toiro-0.0.9.dist-info/top_level.txt sha256=cga35XtUWxdeKWujyan0a0tDxUYYJk0Nkq0lHlkmTlc 6
toiro-0.0.9.dist-info/RECORD — —

top_level.txt

toiro