Wheelodex » Projects » jptranstokenizer

jptranstokenizer

View on PyPI — Reverse Dependencies (0)

0.4.0 jptranstokenizer-0.4.0-py3-none-any.whl

Wheel Details

Project: jptranstokenizer
Version: 0.4.0
Filename: jptranstokenizer-0.4.0-py3-none-any.whl
Download: [link]
Size: 15200
MD5: 9f4bade64d952165ceae0d45a1115624
SHA256: ce8db27202302431e6065b082231e76880198a2ee67fd211d1415815321ab4ca
Uploaded: 2024-02-02 18:10:58 +0000

dist-info

METADATA · WHEEL · RECORD

METADATA

Metadata-Version: 2.1
Name: jptranstokenizer
Version: 0.4.0
Summary: Japanese tokenizer with transformers library
Author: Masahiro Suzuki
Author-Email: msuzuki9609[at]gmail.com
License: MIT
Classifier: License :: OSI Approved :: MIT License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.7
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Requires-Python: >=3.7,<4.0
Requires-Dist: SudachiTra (<0.2.0,>=0.1.9)
Requires-Dist: pyknp (<0.7.0,>=0.6.1)
Requires-Dist: sentencepiece (<0.2.0,>=0.1.96)
Requires-Dist: transformers (<5.0.0,>=4.24.0)
Description-Content-Type: text/markdown
[Description omitted; length: 3280 characters]

WHEEL

Wheel-Version: 1.0
Generator: poetry-core 1.8.1
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
jptranstokenizer/__init__.py sha256=LnpTDBde74AdVJtZYPtoI1Ud2RX3OzDwoz2kwHhfte8 114
jptranstokenizer/mainword/__init__.py sha256=vgtbwOv4pdKzxuMdGzfjz9ttXhunZ6G5zU1OdpvLeok 101
jptranstokenizer/mainword/base.py sha256=PX6YXkvfgEQopFe2WdOfDZbCugjhDta1Y1PzOZAXiYQ 1805
jptranstokenizer/mainword/juman.py sha256=LGySHyuOrP85K9hs2ja02zhz12cyruUbpyPKQiij6UA 3672
jptranstokenizer/mainword/sudachi.py sha256=SpRBEBd6aIeKcmLmdrbZgyFh-P8334ByDD2lZwbBy0c 4531
jptranstokenizer/model_list.py sha256=mNYY33EbI9np-TmC0FuQuuyCvoFyCMyOC_cgG1nUb-k 3819
jptranstokenizer/subword/__init__.py sha256=64y9MJMMFnVwHwIlIwANZxc3fz8yM8u7XpsawLxRbXs 50
jptranstokenizer/subword/sentencepiece.py sha256=lEBii86MZkyU3N3bGtzaRP3EIo2uv4aCRJHmI6U4IRc 2989
jptranstokenizer/tokenization_utils.py sha256=qddt_0-qdQX4vJyYftxFbGPZr30AQcSjaPf_Km3DUBk 25952
jptranstokenizer/version.py sha256=42STGor_9nKYXumfeV5tiyD_M8VdcddX7CEexmibPBk 22
jptranstokenizer-0.4.0.dist-info/LICENSE sha256=PNLvrKY57Ohybwz16FNQ9fpAdGd-NRaaelGNK9JbPLU 1067
jptranstokenizer-0.4.0.dist-info/METADATA sha256=KcKprfr3ZY88qzelSMXedicu3ZrJHZnbjJqNGWKzZI0 4276
jptranstokenizer-0.4.0.dist-info/WHEEL sha256=FMvqSimYX_P7y0a7UY-_Mc83r5zkBZsCYPm7Lr0Bsq4 88
jptranstokenizer-0.4.0.dist-info/RECORD — —