tokenizer

View on PyPIReverse Dependencies (7)

3.4.3 tokenizer-3.4.3-py2.py3-none-any.whl

Wheel Details

Project: tokenizer
Version: 3.4.3
Filename: tokenizer-3.4.3-py2.py3-none-any.whl
Download: [link]
Size: 112279
MD5: 4a371e014043d0154036edc4514efa8b
SHA256: d9a4065760d63b6e17a914e4ec209608487aa64b0d9726a54b4ab064acb6eae1
Uploaded: 2023-08-11 15:09:11 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: tokenizer
Version: 3.4.3
Summary: A tokenizer for Icelandic text
Author: Miðeind ehf.
Author-Email: mideind[at]mideind.is
Home-Page: https://github.com/mideind/Tokenizer
License: MIT
Keywords: nlp,tokenizer,icelandic
Classifier: Development Status :: 5 - Production/Stable
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: Unix
Classifier: Operating System :: POSIX
Classifier: Operating System :: Microsoft :: Windows
Classifier: Natural Language :: Icelandic
Classifier: Programming Language :: Python
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: Implementation :: CPython
Classifier: Programming Language :: Python :: Implementation :: PyPy
Classifier: Topic :: Software Development :: Libraries :: Python Modules
Classifier: Topic :: Utilities
Classifier: Topic :: Text Processing :: Linguistic
Description-Content-Type: text/x-rst
License-File: LICENSE
[Description omitted; length: 40750 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.41.1)
Root-Is-Purelib: true
Tag: py2-none-any
Tag: py3-none-any

RECORD

Path Digest Size
tokenizer/Abbrev.conf sha256=jCnhYS-opVczkwR2kZD9yvppQ9AHIckOIqTYlMkdrhM 47236
tokenizer/__init__.py sha256=Q3NIXsAXFCWFzQUUEPTSJj-u1f5GnUVg8gOOuRLgOaw 2764
tokenizer/__init__.pyc sha256=AFzxWlrpPXNvVPpCr_x-CQ0WGiM876Zkr2XjS9AwlVg 2433
tokenizer/abbrev.py sha256=sbwHM6zhj3VaLG-BRP4F5-sYVWJjkJa9cNY4R0bcGhA 13154
tokenizer/abbrev.pyc sha256=QOfke4utOIU3_-Ez2dZo2Nl8T_FopwDBeYq5A-_iMTU 8762
tokenizer/definitions.py sha256=CBHQX2o4sYVb-6Q8WjAiC-fd-UNXFjCZ_AhH29LCP8Y 27980
tokenizer/definitions.pyc sha256=g91iiaOJU5XpkoJuQZd9T5YOeA97lR0GCTuMX3FvWy4 26571
tokenizer/main.py sha256=tVSSsWcENdX9I9Hliz3Jww7DrxI6uCd8U2q0NyNJkBQ 9660
tokenizer/py.typed sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
tokenizer/tokenizer.py sha256=1McexmZcPCEfeHBZsY-21UjdbchYD8S3nW3yhNmiUz4 128535
tokenizer/tokenizer.pyc sha256=ho3uzqu3CIAGbUyKLgBxw5XnGCESQXzQi-rJ-M9FmrQ 49803
tokenizer/version.py sha256=HNo38i3AlfMCqVm-f3x3A2HRkN7m8KamIgg-jxq1h-k 22
tokenizer-3.4.3.dist-info/LICENSE sha256=EyROIUxke-bJsncd-5pHQeT5sH3j2sSaPI7JLekAuP4 1113
tokenizer-3.4.3.dist-info/METADATA sha256=LPZufTMJUKzOiG2oujdo4_S0aT5RA960KrianDixcxU 42206
tokenizer-3.4.3.dist-info/WHEEL sha256=m9WAupmBd2JGDsXWQGJgMGXIWbQY3F5c2xBJbBhq0nY 110
tokenizer-3.4.3.dist-info/entry_points.txt sha256=v9w-Gt8suY5ymeStZe2K1KmAUoejA6YhNHMpfWTTFGM 49
tokenizer-3.4.3.dist-info/top_level.txt sha256=ODlQeKqMCvFle4_HiPNY1X5fX-qZyM3ABBmOPG__vnE 10
tokenizer-3.4.3.dist-info/RECORD

top_level.txt

tokenizer

entry_points.txt

tokenize = tokenizer.main:main