medusa-llm

View on PyPIReverse Dependencies (0)

0.1 medusa_llm-0.1-py3-none-any.whl

Wheel Details

Project: medusa-llm
Version: 0.1
Filename: medusa_llm-0.1-py3-none-any.whl
Download: [link]
Size: 35981
MD5: 22bca79194684f7e07d9c66305c8f18e
SHA256: e4a0f04dcc1cac018a103d32891dccf7055c92147e87ae051f92c34030da1ab3
Uploaded: 2023-09-11 15:45:53 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: medusa-llm
Version: 0.1
Summary: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads
Project-Url: Homepage, https://github.com/FasterDecoding/Medusa
Project-Url: Blog, https://sites.google.com/view/medusa-llm
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: Apache Software License
Requires-Python: >=3.9
Requires-Dist: fschat
Requires-Dist: torch
Requires-Dist: transformers
Requires-Dist: accelerate
Requires-Dist: sentencepiece
Requires-Dist: protobuf
Requires-Dist: bitsandbytes; extra == "train"
Requires-Dist: wandb; extra == "train"
Requires-Dist: scipy; extra == "train"
Provides-Extra: train
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 8274 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.41.2)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
medusa/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
medusa/hf_utils.py sha256=2vFMu5BGdjPTDeYjQuKrWipm-nxWvmzZFIhhsjs4PHE 539
medusa/inference/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
medusa/inference/cli.py sha256=IG4aLqY7ofsvDxq84nAESnYVzlFZWOOOOPCzZCYOjuY 8026
medusa/model/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
medusa/model/kv_cache.py sha256=CYUL3CsrBNVMzH-JHWDTkyb2M5Ft-pLQZpsVbCHAdSA 4371
medusa/model/medusa_model.py sha256=B1LdKHs_ZXJm4zabM7x4x-Ds7y24q25bZjgioVQPayw 11710
medusa/model/modeling_llama_kv.py sha256=FJQETFu9ac1rSgtxlzyACXiiTKcZAm_jcNk_iEpe2PA 48326
medusa/model/utils.py sha256=Ej9dwiA2nqEPACd7lek7B2SOXpMJCrSU_y05LeCIroE 17436
medusa/train/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
medusa/train/train.py sha256=GADpqufzCpni6rGl6zh4qCN2dBCa9T4ukL2Ii3Al-V4 13472
medusa_llm-0.1.dist-info/LICENSE sha256=QwcOLU5TJoTeUhuIXzhdCEEDDvorGiC6-3YTOl4TecE 11356
medusa_llm-0.1.dist-info/METADATA sha256=hBIFtbPqvfjafRJ00mh2QJqUymy_Bdr648HcFlNZtzw 9041
medusa_llm-0.1.dist-info/WHEEL sha256=yQN5g4mg4AybRjkgi-9yy4iQEFibGQmlz78Pik5Or-A 92
medusa_llm-0.1.dist-info/top_level.txt sha256=0_b949BybCEynuwy7nuRYdCWv3stHWFBxHQfY1Gf8WU 7
medusa_llm-0.1.dist-info/RECORD

top_level.txt

medusa