Wheelodex » Projects » tftokenizers

tftokenizers

View on PyPI — Reverse Dependencies (0)

0.1.8 tftokenizers-0.1.8-py3-none-any.whl

Wheel Details

Project: tftokenizers
Version: 0.1.8
Filename: tftokenizers-0.1.8-py3-none-any.whl
Download: [link]
Size: 21690
MD5: 622f092296e676c41e829dda58ecb8d1
SHA256: 7d431bc2020f7ab1791083b01a81c1bd23c7a6f7902abe915dd9a25e223c19d9
Uploaded: 2022-03-29 15:08:34 +0000

dist-info

METADATA · WHEEL · RECORD · entry_points.txt

METADATA

Metadata-Version: 2.1
Name: tftokenizers
Version: 0.1.8
Summary: Use Huggingface Transformer and Tokenizers as Tensorflow Reusable SavedModels.
Author: MarkusSagen
Author-Email: markus.john.sagen[at]gmail.com
Home-Page: https://github.com/Hugging-Face-Supporter/tftokenizers
Project-Url: Repository, https://github.com/Hugging-Face-Supporter/tftokenizers
License: Apache-2.0
Keywords: huggingface,transformers,tokenizers,tensorflow,text
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.7
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Requires-Python: >=3.7,<3.10
Requires-Dist: pydantic (<2.0.0,>=1.6.0)
Requires-Dist: rich[jupyter] (<11.0.0,>=10.12.0)
Requires-Dist: sentencepiece (<0.2.0,>=0.1.92)
Requires-Dist: tensorflow (<3.0.0,>=2.5.0)
Requires-Dist: tensorflow-text (<3.0.0,>=2.5.0)
Requires-Dist: tf-sentencepiece (<0.2.0,>=0.1.92)
Requires-Dist: torch (<2.0.0,>=1.6.0)
Requires-Dist: transformers (<5.0.0,>=4.0.1)
Description-Content-Type: text/markdown
[Description omitted; length: 11846 characters]

WHEEL

Wheel-Version: 1.0
Generator: poetry 1.0.7
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
tftokenizers/__init__.py sha256=xPYaUe0ni1feJT8EFRC4DCyMmBpmdIZivsWQU-gCeAw 582
tftokenizers/database.py sha256=LrKSZGN8sRSoE93Y5JDKyJEldVHKKPv2Kt3SNm2OL9w 2059
tftokenizers/detect.py sha256=QYKEhg9gct5o3lzdGG3eD-0aw0YrK5CJ0pxziazF37c 1592
tftokenizers/download.py sha256=gtD3lQStVuo_r9qUGhFHq-DjzAyrcVDWbMS29E7SUFE 1744
tftokenizers/file.py sha256=OAAtHyofL8xDs1qP7x2s55j5a53B7_dnKTt4ASLjVSA 2424
tftokenizers/main.py sha256=gCCrD6x1iGXYZ76sm-uFyHffukp4Hix8Ufup5FdeaFc 3110
tftokenizers/model.py sha256=HzPGyJf8zOAKnM_9bi75cyXr2FY0m0ZSso90fKZbVDY 1702
tftokenizers/tokenizer.py sha256=AsLNE1pyp_0Re34bUEG2esLW3Yxoh8mC4aMtWjrDT_0 23443
tftokenizers/types.py sha256=HLEEmKg_zNNlEJDsnJForB26esbE9GxAYAhSokHVfxM 1694
tftokenizers/utils.py sha256=T41Imsyc39TATBPVuTmpiKQ07IeeyKcNGqrywWrWCLA 2318
tftokenizers-0.1.8.dist-info/entry_points.txt sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
tftokenizers-0.1.8.dist-info/LICENSE sha256=xx0jnfkXJvxRnG63LTGOxlggYnIysveWIZ6H3PNdCrQ 11357
tftokenizers-0.1.8.dist-info/WHEEL sha256=y3eDiaFVSNTPbgzfNn0nYn5tEn1cX6WrdetDlQM4xWw 83
tftokenizers-0.1.8.dist-info/METADATA sha256=S7bcrVBQ2sPop6uKHoyKQKOB8meaJbYj582Ih5ctF2o 12975
tftokenizers-0.1.8.dist-info/RECORD — —

entry_points.txt

[empty]