Wheelodex » Projects » gptfast

gptfast

View on PyPI — Reverse Dependencies (0)

0.2.1 gptfast-0.2.1-py3-none-any.whl

Wheel Details

Project: gptfast
Version: 0.2.1
Filename: gptfast-0.2.1-py3-none-any.whl
Download: [link]
Size: 20707
MD5: c72f1f1d35140d32ea02f09250cda2e3
SHA256: 2ce95845ca8664373f08e88cc41f4499a67962153356fd14fe35f3785ab02137
Uploaded: 2024-04-02 12:47:38 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt

METADATA

Metadata-Version: 2.1
Name: gptfast
Version: 0.2.1
Summary: Accelerate transformer inference by 6-8.5x. Native to Huggingface and PyTorch.
Author: MDK8888
License: Apache License 2.0
Requires-Dist: torch (==2.2.1)
Requires-Dist: sympy (==1.12)
Requires-Dist: typing-extensions (==4.9.0)
Requires-Dist: networkx (==3.2.1)
Requires-Dist: jinja2 (==3.1.3)
Requires-Dist: triton (==2.2.0)
Requires-Dist: fsspec (==2023.10.0)
Requires-Dist: filelock (==3.13.1)
Requires-Dist: MarkupSafe (==2.1.4)
Requires-Dist: mpmath (==1.3.0)
Requires-Dist: transformers (==4.39.2)
Requires-Dist: tqdm (==4.66.1)
Requires-Dist: pyyaml
Requires-Dist: safetensors (==0.4.1)
Requires-Dist: numpy (==1.26.3)
Requires-Dist: huggingface-hub (==0.20.2)
Requires-Dist: tokenizers (==0.15.0)
Requires-Dist: packaging (==23.2)
Requires-Dist: regex (==2023.12.25)
Requires-Dist: requests (==2.31.0)
Requires-Dist: bitsandbytes (==0.43.0)
Requires-Dist: accelerate (==0.27.2)
License-File: LICENSE
[No description]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.38.4)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
GPTFast/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
GPTFast/Core/GPTFast.py sha256=4yeAnrTlY-LKpM2JsRL4wr_bz_5EXGcgqNbnpz-SA68 1038
GPTFast/Core/__init__.py sha256=A3VCVIwuCDr-uDSrwNDXwji518th3hGxCPdB_mdzzo4 171
GPTFast/Core/Compile/Compile.py sha256=egoOmqA9c4VEX5plZbpp3mJkRUaGdcacUD29wCne6Ts 883
GPTFast/Core/Compile/__init__.py sha256=9Z9fu83iFKknNV5kcXwAtB0Wlg5xMKndKIcx9TtYli8 22
GPTFast/Core/Decode/SpeculativeDecode.py sha256=r20b_R9dIySwyppOzWUAt5w9moUWlu3Kl7v-z1_D7qQ 7805
GPTFast/Core/Decode/__init__.py sha256=c7syXGx5vA7EJ0a0be3RVEhTEh7173WYVmaT-2AHaXo 32
GPTFast/Core/KVCache/KVCache.py sha256=v2iJIZxtmnARO2T_8xnLq88cHcT4Je8QGcpN2nZy8es 4987
GPTFast/Core/KVCache/KVCacheModel.py sha256=bBNOil-bFSZ2hfshe02oHMTI-Ab-pyoNVYh8nNXepqU 13104
GPTFast/Core/KVCache/__init__.py sha256=5TisgDyj2GeZvMyIucJM0rC6GlWqf5hliyEH97L56kk 51
GPTFast/Core/Quantize/__init__.py sha256=9vtMyVgu30MkftlYTYEXsUl9sykSfPigG0xY2DDsEM8 28
GPTFast/Core/Quantize/quantize_int8.py sha256=Wi8VHtbxMLXAdqTOY-wOw4x9HyF2n3NAb21rBrOLQdk 213
GPTFast/Helpers/__init__.py sha256=g_nUsPFa8Er8LRerfYYdoX5HTg5cRWkeazKl_QovftM 64
GPTFast/Helpers/Class/__init__.py sha256=vab8qCmZ8kUA8UirJnlh9mVUuW-sHIeWAelVFSVKfG4 61
GPTFast/Helpers/Class/add_str_as_func.py sha256=RDpk--gdemb33QQ-YEVex9huEd9MPpOeSKMp_5RWisQ 556
GPTFast/Helpers/Class/get_method_str.py sha256=QzPMF8plpg9OnFVjPiXOHcCdmuxGZ7fF-UpVQ8TvJ_E 415
GPTFast/Helpers/Eval/__init__.py sha256=IFVVXE3ms6_3H-luxcH15ire0S288Isp-pfcbXwKCHU 20
GPTFast/Helpers/Eval/timed.py sha256=SjKJZHg8tlEsdm_t5rOkUjYkFrUMXjg34YPKiEG5sZg 266
GPTFast/Helpers/String/__init__.py sha256=uBQ6HZvFDtQ9GwhJpHPaD4y3VQxCgdMN719EIZRaHyc 203
GPTFast/Helpers/String/add_default_parameter.py sha256=rOWOW1OlA_twFuekjkEgD20djrZCpqwsCnm0wRzo6PI 1207
GPTFast/Helpers/String/add_input_pos_to_func_str.py sha256=VxgBHukEw9Cz0of4UdcAQV-ARd7lbtfzctL6hxrAXiE 1044
GPTFast/Helpers/String/modify_function_block.py sha256=DzVyCdeATnSPsc5_ShAOBXu6dYn6Gbajn8GirmxsNVc 1213
GPTFast/Helpers/String/modify_if_block.py sha256=2q7qeVs2f5qZp8BU8nnNYkIF1v4Yxwt5RB_KcZw1RG8 1669
GPTFast/Helpers/String/shift_left.py sha256=WXhrSyUPJkOh7LueX7t7IQ1xcKPJA3x1XuceyMgVzwA 369
GPTFast/Helpers/String/shift_right.py sha256=EF-NoAclzM1DEmLGdjdm6ShbWHjAKQxzLsNz6wWGPMI 377
gptfast-0.2.1.dist-info/LICENSE sha256=pJ50ZuLGKHbfnuNyRAIG24FqSx9a8rF6xJim3z6TdiE 11538
gptfast-0.2.1.dist-info/METADATA sha256=AT-rke8kZaowd9a_A2EK4jQu_iZHM-EwzYQH0atTgO0 1048
gptfast-0.2.1.dist-info/WHEEL sha256=2wepM1nk4DS4eFpYrW1TTqPcoGNfHhhO_i5m4cOimbo 92
gptfast-0.2.1.dist-info/top_level.txt sha256=3qMb-fGakHDTI4lzxgJnH9n9bW0TfpV6JKfGtNspy4U 8
gptfast-0.2.1.dist-info/RECORD — —

top_level.txt

GPTFast