mm-tokenizer

View on PyPIReverse Dependencies (0)

0.4.0 mm_tokenizer-0.4.0-py3-none-any.whl

Wheel Details

Project: mm-tokenizer
Version: 0.4.0
Filename: mm_tokenizer-0.4.0-py3-none-any.whl
Download: [link]
Size: 6492
MD5: ab18b26a50c22944ab611013beb322d0
SHA256: 804c7b59f47ed24c657a3e5aaa3a41f76e4bf50eb78cbfd5ff8992177a12d469
Uploaded: 2023-10-06 23:40:32 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: mm-tokenizer
Version: 0.4.0
Author: hud
Author-Email: hudwahab[at]gmail.com
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Requires-Python: >=3.9,<4.0
Requires-Dist: pytest (<8.0.0,>=7.4.2)
Requires-Dist: sentencepiece (<0.2.0,>=0.1.99)
Requires-Dist: torch (==2.0.1)
Requires-Dist: transformers (==4.33.2)
Description-Content-Type: text/markdown
[Description omitted; length: 226 characters]

WHEEL

Wheel-Version: 1.0
Generator: poetry-core 1.6.1
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
tokenizer/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
tokenizer/tokenization_small100.py sha256=CHOVL_iYomc8L3n_OGlDNhQL8oCs3j2L0J9SD4CCEds 16282
mm_tokenizer-0.4.0.dist-info/METADATA sha256=7dTNLzsc8F1I-OIeER7BgMWszPfHSS4wPZZGRVgKfZk 762
mm_tokenizer-0.4.0.dist-info/WHEEL sha256=Zb28QaM1gQi8f4VCBhsUklF61CTlNYfs9YAZn-TOGFk 88
mm_tokenizer-0.4.0.dist-info/RECORD