tokenizer
View on PyPI — Reverse Dependencies (7)
3.4.3 | tokenizer-3.4.3-py2.py3-none-any.whl |
Wheel Details
Project: | tokenizer |
Version: | 3.4.3 |
Filename: | tokenizer-3.4.3-py2.py3-none-any.whl |
Download: | [link] |
Size: | 112279 |
MD5: | 4a371e014043d0154036edc4514efa8b |
SHA256: | d9a4065760d63b6e17a914e4ec209608487aa64b0d9726a54b4ab064acb6eae1 |
Uploaded: | 2023-08-11 15:09:11 +0000 |
dist-info
METADATA · WHEEL · RECORD · top_level.txt · entry_points.txt
METADATA
WHEEL
Wheel-Version: | 1.0 |
Generator: | bdist_wheel (0.41.1) |
Root-Is-Purelib: | true |
Tag: | py2-none-any |
Tag: | py3-none-any |
RECORD
Path | Digest | Size |
---|---|---|
tokenizer/Abbrev.conf | sha256=jCnhYS-opVczkwR2kZD9yvppQ9AHIckOIqTYlMkdrhM | 47236 |
tokenizer/__init__.py | sha256=Q3NIXsAXFCWFzQUUEPTSJj-u1f5GnUVg8gOOuRLgOaw | 2764 |
tokenizer/__init__.pyc | sha256=AFzxWlrpPXNvVPpCr_x-CQ0WGiM876Zkr2XjS9AwlVg | 2433 |
tokenizer/abbrev.py | sha256=sbwHM6zhj3VaLG-BRP4F5-sYVWJjkJa9cNY4R0bcGhA | 13154 |
tokenizer/abbrev.pyc | sha256=QOfke4utOIU3_-Ez2dZo2Nl8T_FopwDBeYq5A-_iMTU | 8762 |
tokenizer/definitions.py | sha256=CBHQX2o4sYVb-6Q8WjAiC-fd-UNXFjCZ_AhH29LCP8Y | 27980 |
tokenizer/definitions.pyc | sha256=g91iiaOJU5XpkoJuQZd9T5YOeA97lR0GCTuMX3FvWy4 | 26571 |
tokenizer/main.py | sha256=tVSSsWcENdX9I9Hliz3Jww7DrxI6uCd8U2q0NyNJkBQ | 9660 |
tokenizer/py.typed | sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU | 0 |
tokenizer/tokenizer.py | sha256=1McexmZcPCEfeHBZsY-21UjdbchYD8S3nW3yhNmiUz4 | 128535 |
tokenizer/tokenizer.pyc | sha256=ho3uzqu3CIAGbUyKLgBxw5XnGCESQXzQi-rJ-M9FmrQ | 49803 |
tokenizer/version.py | sha256=HNo38i3AlfMCqVm-f3x3A2HRkN7m8KamIgg-jxq1h-k | 22 |
tokenizer-3.4.3.dist-info/LICENSE | sha256=EyROIUxke-bJsncd-5pHQeT5sH3j2sSaPI7JLekAuP4 | 1113 |
tokenizer-3.4.3.dist-info/METADATA | sha256=LPZufTMJUKzOiG2oujdo4_S0aT5RA960KrianDixcxU | 42206 |
tokenizer-3.4.3.dist-info/WHEEL | sha256=m9WAupmBd2JGDsXWQGJgMGXIWbQY3F5c2xBJbBhq0nY | 110 |
tokenizer-3.4.3.dist-info/entry_points.txt | sha256=v9w-Gt8suY5ymeStZe2K1KmAUoejA6YhNHMpfWTTFGM | 49 |
tokenizer-3.4.3.dist-info/top_level.txt | sha256=ODlQeKqMCvFle4_HiPNY1X5fX-qZyM3ABBmOPG__vnE | 10 |
tokenizer-3.4.3.dist-info/RECORD | — | — |
top_level.txt
tokenizer
entry_points.txt
tokenize = tokenizer.main:main