airllm

View on PyPIReverse Dependencies (0)

2.8.3 airllm-2.8.3-py3-none-any.whl

Wheel Details

Project: airllm
Version: 2.8.3
Filename: airllm-2.8.3-py3-none-any.whl
Download: [link]
Size: 41929
MD5: 3d59a76de6ad8aff906bb910e6811bc4
SHA256: 7a2cfb1133393fd4dfa232550c4becfab2a5b001bdda20c9e856303079facf99
Uploaded: 2023-12-27 14:54:45 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: airllm
Version: 2.8.3
Summary: AirLLM allows single 4GB GPU card to run 70B large language models without quantization, distillation or pruning.
Author: Gavin Li
Author-Email: gavinli[at]animaai.cloud
Home-Page: https://github.com/lyogavin/Anima/tree/main/air_llm
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Requires-Dist: tqdm
Requires-Dist: torch
Requires-Dist: transformers
Requires-Dist: accelerate
Requires-Dist: safetensors
Requires-Dist: optimum
Requires-Dist: huggingface-hub
Requires-Dist: scipy
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 13590 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.41.3)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
airllm/__init__.py sha256=-U-pBW8xOqLWX4XwWyR-AgXwoMptKJ0qcUF-gsybA3g 695
airllm/airllm.py sha256=lOghi5WZGs_289_M5UvWq56qFbmmY-SvS5XGgotLR6c 185
airllm/airllm_baichuan.py sha256=2R4_1buR1zOnywlAM71vSEDh6Adfk1iOaeXoDYLsHjw 697
airllm/airllm_base.py sha256=DImIQyYRmJNKKvXAMS9G3fEq62xtqbL_X2KseMezew8 25395
airllm/airllm_chatglm.py sha256=dRGat-jvb0vatuJe-AR_1X95v4KjSJZu4pLj8qYhfvM 1630
airllm/airllm_internlm.py sha256=UsfBeapQ4wjzOkCgFV_ggrOn8KjqhTRNQgSGZHIDPNk 371
airllm/airllm_llama_mlx.py sha256=GO_G4S91cCD1ohxeLBaSWsLLyhaBtNxGk-5nNjqykGI 16729
airllm/airllm_mistral.py sha256=7tT-sz4nVBfJrATm_hU1Mb5zwSo7lCMqj23pjZtSP9o 369
airllm/airllm_mixtral.py sha256=QdjBGkzwFvX9WQ16trWFQ6fCCm5xFMNbD-GQHiMp1D8 370
airllm/airllm_qwen.py sha256=BXGMJkyoSZdl_6tQtD9zlQxoVFfdksnrZqaG7ZP9Aas 1833
airllm/auto_model.py sha256=Y_hSSoae3kr0xpZOu9COpmX7P8bmkGaz_qICuNjlluQ 2137
airllm/profiler.py sha256=GWh_omZ3ueQFdEn5RybnEwbDEAKOZzmmo0_3fPlwvz4 601
airllm/tokenization_baichuan.py sha256=aEcxhbpwJbER9os8nJbuhO7Dn1qTNWAg2Q7DlUxOCLA 9613
airllm/utils.py sha256=paoIbqnORezHtQ8ZdDYZYMHG6jvBybOp2vOEskt2hy8 16387
airllm/persist/__init__.py sha256=h0sbHhGInv9eluUUGCxLAdQ7_Q76yGfXVKqwSmIP0V4 44
airllm/persist/mlx_model_persister.py sha256=IBJohwVh16cySAv9xV4YnIWi6pf1dk-UVnZL7vn9ozY 3664
airllm/persist/model_persister.py sha256=Jl6-Vlx16caA5QBNmyzHliwE3tS0r4dC-I7vylaBKSQ 897
airllm/persist/safetensor_model_persister.py sha256=-W48wPbVuHUofjoqCPNhDbSWfyKNg2TFR0fQY2_Rkwc 1091
src/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
src/airllm.py sha256=GulSLoOSU0Vx3H_bfSrcjAkIO5jfGwqI5LCWKgcJtQw 16544
src/inference_example.py sha256=3yysC9U2e76G6wZo6Yr43ul6JRTRP0ZWva87mgkBeXQ 844
tests/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
tests/test_automodel.py sha256=FFrg7hRypzLq88w6IilbkYFulXdbcpFuzFIjTvLrYBs 871
tests/test_compression.py sha256=m-PUm5eUwXVkIsMWNk_tagqiLmMWjf6sh0hCUdBZkNI 1344
airllm-2.8.3.dist-info/LICENSE sha256=xx0jnfkXJvxRnG63LTGOxlggYnIysveWIZ6H3PNdCrQ 11357
airllm-2.8.3.dist-info/METADATA sha256=6oVdqsutGF0EYhG5vlstJxhwodQBRNoqvE3bfzxp4ew 15072
airllm-2.8.3.dist-info/WHEEL sha256=Xo9-1PvkuimrydujYJAjF7pCkriuXBpUPEjma1nZyJ0 92
airllm-2.8.3.dist-info/top_level.txt sha256=oPMKGeTR_qbUPPqoD7MMrJIHQe1OJnV2DPHkiEYJRhU 13
airllm-2.8.3.dist-info/RECORD

top_level.txt

airllm
tests