exllama

View on PyPIReverse Dependencies (0)

0.1.0 exllama-0.1.0-py3-none-any.whl

Wheel Details

Project: exllama
Version: 0.1.0
Filename: exllama-0.1.0-py3-none-any.whl
Download: [link]
Size: 50054
MD5: bbabafe808f71a3d0b802fa6ef2762c5
SHA256: f12f27686fbcaaa74298626eb5e8182f39207f2e0db2d28e8634bc2d8124a75d
Uploaded: 2023-08-02 18:44:30 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: exllama
Version: 0.1.0
Requires-Python: >=3.9
Requires-Dist: ninja (==1.11.1)
Requires-Dist: safetensors (==0.3.1)
Requires-Dist: sentencepiece (>=0.1.97)
Requires-Dist: torch (>=2.0.1)
[No description]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.34.2)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
exllama/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
exllama/cuda_ext.py sha256=RhLMfPsr9JcynquwB_TtfoZybdfoCAspTrN48pk16zk 5707
exllama/generator.py sha256=Xz22aoFJrctGYTnP2mxHF8nk5FX5Gp8ZFXa7PG4bj44 25007
exllama/lora.py sha256=MlP-YxEzLSWl0j3gIEW3rcmPcr8_KKV8AVQCG83z86E 4647
exllama/model.py sha256=0klrg4eeRs5pC3hYWVmpQm1rO-LonVzOUgaED30UEKw 41935
exllama/tokenizer.py sha256=e8Kq_QjErFN9dCIlPJvmFvFsVcL0EM-wXjbxJVLXrFU 7514
exllama/exllama_ext/cuda_buffers.cu sha256=iRjupIn6Q1RXUl6rv9fKEEl-PEYqNXSZispEfD9AWEc 2262
exllama/exllama_ext/cuda_buffers.cuh sha256=s6jEkZ7MsGn-7uJUeg8kGtZnTR1i0etZbdGBqHc5cDk 1422
exllama/exllama_ext/cuda_compat.cuh sha256=KUJLk93Fd-I2OmAyUhT-RmYt_Bayu_CF3QM6AnsbxjQ 1579
exllama/exllama_ext/exllama_ext.cpp sha256=qSEhCA-XOLdfr7U_RgA5TC4s0M1y1vuylV2NRTQRGxU 19912
exllama/exllama_ext/hip_compat.cuh sha256=OmW_aK8fiyOnsoGR1UcL7HPnMfjKoobKJsI0ztBBho4 2462
exllama/exllama_ext/matrix.cuh sha256=FzYuhSRkTV9046r5VEJ2lMAU662nk4vsv7AYjmAjVQE 10943
exllama/exllama_ext/tuning.h sha256=BMzVAajXLqPSoU_9jqbrejvpPtB5ojOxhOMmSepv5KM 297
exllama/exllama_ext/util.cuh sha256=a3TRIiNb9gsu19dgTDsnXTEkOEQlUKH-U4ZGfFvgKBc 1681
exllama/exllama_ext/cpu_func/rep_penalty.cpp sha256=9076I0jw6P9MzRDkxMe4Q109O9Sl6RAm4sRbjlYsUpQ 1689
exllama/exllama_ext/cpu_func/rep_penalty.h sha256=_CU58eJkWOFMm9bDN9HdCD9B19hYN9CIKfGuE4UUJoE 495
exllama/exllama_ext/cuda_func/column_remap.cu sha256=lpcHFSk50PtRqEw9z3d2mxdKHm9uKWk2SImSmhLe_j0 1449
exllama/exllama_ext/cuda_func/column_remap.cuh sha256=kaOzzBvDR47ryfK6NyDStSuwtEiaAXqs2_GjzwyZZWk 266
exllama/exllama_ext/cuda_func/half_matmul.cu sha256=AaZvaeBIpkgtGQHqzC0f_1Kw4i_-fAbQrFSHWttXt88 7842
exllama/exllama_ext/cuda_func/half_matmul.cuh sha256=W1rnoJsT-fuXCTm3BjaKpmBRe4NHh-hTsVz_admxKHM 1040
exllama/exllama_ext/cuda_func/q4_attn.cu sha256=7G23iXYR0zloTlPldM8wTGHsoNGJlzVpN5YJDGjVrDM 8031
exllama/exllama_ext/cuda_func/q4_attn.cuh sha256=TA3h06C1S1jCRvC-QHKbCkq_njBkl6IN78lz7GjAuUk 1267
exllama/exllama_ext/cuda_func/q4_matmul.cu sha256=e81Yy3-BemFAxaDeZgk1SrnWRgc2g6RGwST--5ognSk 8618
exllama/exllama_ext/cuda_func/q4_matmul.cuh sha256=2-rtWG1olb7y1eRiGE907Vmsgr6Gin3PZYXzneca7DY 788
exllama/exllama_ext/cuda_func/q4_matrix.cu sha256=7HWACyuMpLUm9cfuxaLC-dxlsBS92b_2JFtXrgXQ9Hs 5548
exllama/exllama_ext/cuda_func/q4_matrix.cuh sha256=EaJCw9PcDdbniVKFkaMYtHeTNUeuCG3fmxJrU3ASJxI 788
exllama/exllama_ext/cuda_func/q4_mlp.cu sha256=YfW6CJVFS-pp92WAJ5tm6W_hEJ_p39X4BUO62cyFyU0 5785
exllama/exllama_ext/cuda_func/q4_mlp.cuh sha256=sOCJYcCKiV9A0roh2WjTZqgXqg1I2gfkohEv_NUQufg 796
exllama/exllama_ext/cuda_func/rms_norm.cu sha256=1SZ31Ynyy4ftkuvYCSUKgCN65k4E_Bzk9ToJiPgK6k0 5053
exllama/exllama_ext/cuda_func/rms_norm.cuh sha256=SRcGSE_koE9scNYkwTO_HEBF27Auue4Q6_nWaNe1zTU 340
exllama/exllama_ext/cuda_func/rope.cu sha256=TvtgHYP8qQxoZPpZSmRp6NEI5r07Dui9yB6cArwSgG8 3681
exllama/exllama_ext/cuda_func/rope.cuh sha256=wUJu0_pPJueYZ0Ff9QuF_N3ZfC5llK8ommC7lTbCw1k 392
exllama-0.1.0.dist-info/LICENSE sha256=UIp30ue1HZit7tMmSK0SS3swJBqOcLLnLJn5LY5YdNE 1036
exllama-0.1.0.dist-info/METADATA sha256=pclTLQ1smNAh8akQw22xgsvUjj3ttYeyYU-wBdy9bNQ 296
exllama-0.1.0.dist-info/WHEEL sha256=g4nMs7d-Xl9-xC9XovUrsDHGXt-FT0E17Yqo92DEfvY 92
exllama-0.1.0.dist-info/top_level.txt sha256=9niRLhEz4mo6cEayXfppIPwx2KX8Gnf-Uk8dOhwWWws 8
exllama-0.1.0.dist-info/RECORD

top_level.txt

exllama