Wheelodex » Projects » totokenizers

totokenizers

View on PyPI — Reverse Dependencies (1)

1.6.0 totokenizers-1.6.0-py3-none-any.whl

Wheel Details

Project: totokenizers
Version: 1.6.0
Filename: totokenizers-1.6.0-py3-none-any.whl
Download: [link]
Size: 766948
MD5: 3996cf433117bbad79dcd36578dc6139
SHA256: 38086fdf20941b35652dd62300783131e0bc36d7f4ced7fa9437aeac4b907acb
Uploaded: 2025-02-18 19:32:00 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt · zip-safe

METADATA

Metadata-Version: 2.2
Name: totokenizers
Version: 1.6.0
Summary: Text tokenizers.
Author: TeiaLabs
Author-Email: contato[at]teialabs.com
Home-Page: https://github.com/TeiaLabs/totokenizers
Requires-Python: >=3.11
Requires-Dist: google-cloud-aiplatform
Requires-Dist: tiktoken
Requires-Dist: tokenizers (<0.22,>=0.21)
Requires-Dist: pytest; extra == "test"
Provides-Extra: test
Description-Content-Type: text/markdown
Dynamic: author
Dynamic: author-email
Dynamic: description
Dynamic: description-content-type
Dynamic: home-page
Dynamic: provides-extra
Dynamic: requires-dist
Dynamic: requires-python
Dynamic: summary
[Description omitted; length: 600 characters]

WHEEL

Wheel-Version: 1.0
Generator: setuptools (75.8.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
totokenizers/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
totokenizers/errors.py sha256=9zrBonZ6RA2BLVBDpBCzM7Y1ials_P-AweX-tm9kIwg 2109
totokenizers/factories.py sha256=wRKSuLo3G1JFue_si40RZaBu6uGG7AF72cwDsJtgjao 2544
totokenizers/jsonschema_formatter.py sha256=cj56-7HP6yBmvxMQRzH-ctt9AUpsDAh4p487x6VPuko 2864
totokenizers/model_info.py sha256=Y8bXdLHP9ZMdVqearfBdgJuOYr5x2ED48U1nMcdeHQo 1035
totokenizers/openai.py sha256=_xgpbkqcnCbBC8r_CNxHIeOMwOIV8SFfbf9RALO3tL4 8258
totokenizers/openai_info.py sha256=r677esT_R6QDp30bftmkuA9wHCPyh0KVGvfhSGyRSjE 8024
totokenizers/protocols.py sha256=ezrWWAmZmqTD3G5JD8DF3KfUa6SZ-f_dJcdCz-IyIIE 759
totokenizers/schemas.py sha256=tFKxmuR98xZ17PITdX-nfK1MuorNSf7MhJozNVgJZh4 1285
totokenizers/anthropic/__init__.py sha256=N-gFH3IVBLsMjP15eMHfYglwCBPsoCdbSDq92qgMLq8 100
totokenizers/anthropic/anthropic.py sha256=CXnmS1vpHHJcO14UHENMiarqsZaHAtL-R49-5ULeFvw 2655
totokenizers/anthropic/info.py sha256=9aaiyjonfSBEXccmVcqimkyGgIIgXnTUgZthEKLMLFw 1138
totokenizers/anthropic/tokenizer.json sha256=wkFzffJLTn98mvT9zuKaDKkD3LKIqLdTvDRqMJKRF2c 1774213
totokenizers/google/__init__.py sha256=XWhdK-jjS0X0ZjM9jNMUnTuYEuHzOPswPTRv1bwvmDI 35
totokenizers/google/google.py sha256=cfoTFb424taybhhmd3gdVNKYvcA3Z89BgaD5Ssl1I1o 1688
totokenizers/mockai/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
totokenizers/mockai/info.py sha256=iDc1jX3tY_mGYcwwtBRia_-sGJtrdiCTyzl4PafyAp8 622
totokenizers/mockai/tokenizer.py sha256=1xrnVTofG2KE7TuacO0TRoPNgpf-8SUtMtpeExeAUI8 2043
totokenizers-1.6.0.dist-info/METADATA sha256=pftN2-S6fDvpGgV9CvfCijG4q372WJozWvKNw80Dqwo 1213
totokenizers-1.6.0.dist-info/WHEEL sha256=In9FTNxeP60KnTkGw7wk6mJPYd_dQSjEZmXdBdMCI-8 91
totokenizers-1.6.0.dist-info/top_level.txt sha256=zVc404HAXrqKr-Yk1_eOzaPAOgjigB0DCsZ0_BfB4j0 13
totokenizers-1.6.0.dist-info/zip-safe sha256=AbpHGcgLb-kRsJGnwFEktk7uzpZOCcBY74-YBdrKVGs 1
totokenizers-1.6.0.dist-info/RECORD — —

top_level.txt

totokenizers

zip-safe