Wheelodex » Projects » bigcode-tokenizer

bigcode-tokenizer

View on PyPI — Reverse Dependencies (0)

0.1.0 bigcode_tokenizer-0.1.0-py3-none-any.whl

Wheel Details

Project: bigcode-tokenizer
Version: 0.1.0
Filename: bigcode_tokenizer-0.1.0-py3-none-any.whl
Download: [link]
Size: 7459
MD5: c04bbddf718608456e67102946149f7c
SHA256: 591654a617fb3f88fdedd8c1d953d48c68529f024cbb66945898ef5e9a3b86bf
Uploaded: 2018-02-15 14:55:51 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt

METADATA

Metadata-Version: 2.0
Name: bigcode-tokenizer
Version: 0.1.0
Summary: Tool to tokenize source code
Author: Daniel Perez
Author-Email: tuvistavie[at]gmail.com
Home-Page: https://github.com/tuvistavie/bigcode-tools/tree/master/bigcode-tokenizer
Download-Url: https://github.com/tuvistavie/bigcode-tools/archive/master.zip
Classifier: Development Status :: 4 - Beta
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3
Requires-Dist: pygments
Requires-Dist: nose; extra == "test"
Provides-Extra: test
[Description omitted; length: 53 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.30.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
bigcode_tokenizer/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
bigcode_tokenizer/cli.py sha256=0pYcgRJR0L1Etaos7RQxbvEUt76JFTVvCSxRYq2Oa2E 934
bigcode_tokenizer/parallel_tokenizer.py sha256=unVMb7w4CadFEj5GEgg_qQWT8IPokdxpc7vgqJnNTqY 2335
bigcode_tokenizer/token.py sha256=FQEKaN4GuaV5NcgNC4yye3hGkrmQI3AP5tBK4C_TkD8 712
bigcode_tokenizer/tokenizer.py sha256=IfrkqfnmZB4vbarpK_eAqwjCiPyMMoNzKcOZcXWp1Uc 3621
bigcode_tokenizer-0.1.0.data/scripts/bigcode-tokenizer sha256=s8PiO96vJ4os7cKWAuvpUJsaxbmcfjwVdRsUBfTWGwk 87
bigcode_tokenizer-0.1.0.dist-info/DESCRIPTION.rst sha256=jDgb99kK0sUuXMrXADDakxsfqNju6WLfQbSIiJJ2pEY 53
bigcode_tokenizer-0.1.0.dist-info/METADATA sha256=tUxcqGw5MEnEiJ6T9o62uV7nkIAZQ08NTHtARgnm_ao 755
bigcode_tokenizer-0.1.0.dist-info/RECORD — —
bigcode_tokenizer-0.1.0.dist-info/WHEEL sha256=8Lm45v9gcYRm70DrgFGVe4WsUtUMi1_0Tso1hqPGMjA 92
bigcode_tokenizer-0.1.0.dist-info/metadata.json sha256=OG3aER_idMnFAsIAetg2aWaXz-NSiF3VsfHkfPVrRMU 873
bigcode_tokenizer-0.1.0.dist-info/top_level.txt sha256=XkYBobGFHv0KAnCuxo9Mst4mIKleGfei2JNt1sn1ml0 24
tests/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
tests/java_tokenizer_test.py sha256=0OMfjlL37TZuesLyAACJQk_RZwbIFbD2jsevFE5zJko 1551
tests/token_test.py sha256=hcsbaNJO-E-dM2W36rkwoOhFRFQju6tUqP6Oht3UL1M 918

top_level.txt

bigcode_tokenizer
tests