Wheelodex » Projects » totokenizers » totokenizers-1.4.0-py3-none-any.whl

totokenizers

View on PyPI — Reverse Dependencies (1)

1.4.0 totokenizers-1.4.0-py3-none-any.whl

Wheel Details

Project: totokenizers
Version: 1.4.0
Filename: totokenizers-1.4.0-py3-none-any.whl
Download: [link]
Size: 766260
MD5: 8120db98847ce1b06bdbde918ea7c17a
SHA256: 79d5fa61253e117d4fd42bb75fd202cc9f9165c902eaa5c93060dea36ab28e23
Uploaded: 2024-09-11 13:07:34 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt · zip-safe

METADATA

Metadata-Version: 2.1
Name: totokenizers
Version: 1.4.0
Summary: Text tokenizers.
Author: TeiaLabs
Author-Email: contato[at]teialabs.com
Home-Page: https://github.com/TeiaLabs/totokenizers
Requires-Python: >=3.11
Requires-Dist: google-cloud-aiplatform
Requires-Dist: tiktoken
Requires-Dist: tokenizers (>=0.7.0)
Requires-Dist: pytest; extra == "test"
Provides-Extra: test
Description-Content-Type: text/markdown
[Description omitted; length: 600 characters]

WHEEL

Wheel-Version: 1.0
Generator: setuptools (74.1.2)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
totokenizers/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
totokenizers/errors.py sha256=9zrBonZ6RA2BLVBDpBCzM7Y1ials_P-AweX-tm9kIwg 2109
totokenizers/factories.py sha256=wRKSuLo3G1JFue_si40RZaBu6uGG7AF72cwDsJtgjao 2544
totokenizers/jsonschema_formatter.py sha256=cj56-7HP6yBmvxMQRzH-ctt9AUpsDAh4p487x6VPuko 2864
totokenizers/model_info.py sha256=Y8bXdLHP9ZMdVqearfBdgJuOYr5x2ED48U1nMcdeHQo 1035
totokenizers/openai.py sha256=LPkv7N4LEcVxQmP36qciPzgnb3NstP_QNmT6Jd4eRC8 6166
totokenizers/openai_info.py sha256=xxn4GwD5oa5CoFg8_wfTnCWIHYQyZ5uHJt7A-XcFyoI 7300
totokenizers/protocols.py sha256=ezrWWAmZmqTD3G5JD8DF3KfUa6SZ-f_dJcdCz-IyIIE 759
totokenizers/schemas.py sha256=VC5Moj1OgVrf9LW04XPgkiwNd3HqI3sRQZ1s_FB9iK4 865
totokenizers/anthropic/__init__.py sha256=N-gFH3IVBLsMjP15eMHfYglwCBPsoCdbSDq92qgMLq8 100
totokenizers/anthropic/anthropic.py sha256=CXnmS1vpHHJcO14UHENMiarqsZaHAtL-R49-5ULeFvw 2655
totokenizers/anthropic/info.py sha256=9aaiyjonfSBEXccmVcqimkyGgIIgXnTUgZthEKLMLFw 1138
totokenizers/anthropic/tokenizer.json sha256=wkFzffJLTn98mvT9zuKaDKkD3LKIqLdTvDRqMJKRF2c 1774213
totokenizers/google/__init__.py sha256=XWhdK-jjS0X0ZjM9jNMUnTuYEuHzOPswPTRv1bwvmDI 35
totokenizers/google/google.py sha256=cfoTFb424taybhhmd3gdVNKYvcA3Z89BgaD5Ssl1I1o 1688
totokenizers/mockai/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
totokenizers/mockai/info.py sha256=iDc1jX3tY_mGYcwwtBRia_-sGJtrdiCTyzl4PafyAp8 622
totokenizers/mockai/tokenizer.py sha256=1xrnVTofG2KE7TuacO0TRoPNgpf-8SUtMtpeExeAUI8 2043
totokenizers-1.4.0.dist-info/METADATA sha256=ertob-kJKfV05SZvj19CsK7Xja2D-WafPZ554Dj4h2o 1009
totokenizers-1.4.0.dist-info/WHEEL sha256=cVxcB9AmuTcXqmwrtPhNK88dr7IR_b6qagTj0UvIEbY 91
totokenizers-1.4.0.dist-info/top_level.txt sha256=zVc404HAXrqKr-Yk1_eOzaPAOgjigB0DCsZ0_BfB4j0 13
totokenizers-1.4.0.dist-info/zip-safe sha256=AbpHGcgLb-kRsJGnwFEktk7uzpZOCcBY74-YBdrKVGs 1
totokenizers-1.4.0.dist-info/RECORD — —

top_level.txt

totokenizers

zip-safe