Wheelodex » Projects » OpenLLM

OpenLLM

View on PyPI — Reverse Dependencies (3)

0.4.44 openllm-0.4.44-py3-none-any.whl

Wheel Details

Project: OpenLLM
Version: 0.4.44
Filename: openllm-0.4.44-py3-none-any.whl
Download: [link]
Size: 123349
MD5: 8e5a1292202b11bd41565982040dbc3c
SHA256: 56eed57b66235128607b8769dda7e4c8487c0c16435a982895071418eed2c6b9
Uploaded: 2024-02-06 03:08:42 +0000

dist-info

METADATA · WHEEL · RECORD · entry_points.txt

METADATA

Metadata-Version: 2.1
Name: openllm
Version: 0.4.44
Summary: OpenLLM: Operating LLMs in production
Author-Email: Aaron Pham <aarnphm[at]bentoml.com>, BentoML Team <contact[at]bentoml.com>
Project-Url: Blog, https://modelserving.com
Project-Url: Chat, https://discord.gg/openllm
Project-Url: Documentation, https://github.com/bentoml/openllm#readme
Project-Url: GitHub, https://github.com/bentoml/OpenLLM
Project-Url: History, https://github.com/bentoml/OpenLLM/blob/main/CHANGELOG.md
Project-Url: Homepage, https://bentoml.com
Project-Url: Tracker, https://github.com/bentoml/OpenLLM/issues
Project-Url: Twitter, https://twitter.com/bentomlai
Keywords: AI,Alpaca,BentoML,Falcon,Fine tuning,Generative AI,LLMOps,Large Language Model,Llama 2,MLOps,Mistral,Model Deployment,Model Serving,PyTorch,Serverless,StableLM,Transformers,Vicuna,vLLM
Classifier: Development Status :: 5 - Production/Stable
Classifier: Environment :: GPU :: NVIDIA CUDA
Classifier: Environment :: GPU :: NVIDIA CUDA :: 11.7
Classifier: Environment :: GPU :: NVIDIA CUDA :: 11.8
Classifier: Environment :: GPU :: NVIDIA CUDA :: 12
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Science/Research
Classifier: Intended Audience :: System Administrators
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3 :: Only
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: Python :: Implementation :: CPython
Classifier: Programming Language :: Python :: Implementation :: PyPy
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Classifier: Topic :: Software Development :: Libraries
Classifier: Typing :: Typed
Requires-Python: >=3.8
Requires-Dist: accelerate
Requires-Dist: bentoml[io] (<1.2,>=1.1.11)
Requires-Dist: bitsandbytes (<0.42)
Requires-Dist: build[virtualenv] (<1)
Requires-Dist: click (>=8.1.3)
Requires-Dist: cuda-python; platform_system != "Darwin"
Requires-Dist: einops
Requires-Dist: ghapi
Requires-Dist: openllm-client (>=0.4.44)
Requires-Dist: openllm-core (>=0.4.44)
Requires-Dist: optimum (>=1.12.0)
Requires-Dist: safetensors
Requires-Dist: scipy
Requires-Dist: sentencepiece
Requires-Dist: transformers[tokenizers,torch] (>=4.36.0)
Requires-Dist: diffusers; extra == "agents"
Requires-Dist: soundfile; extra == "agents"
Requires-Dist: transformers[agents] (>=4.36.0); extra == "agents"
Requires-Dist: openllm[full]; extra == "all"
Requires-Dist: autoawq; extra == "awq"
Requires-Dist: cpm-kernels; extra == "baichuan"
Requires-Dist: cpm-kernels; extra == "chatglm"
Requires-Dist: ctranslate2 (>=3.22.0); extra == "ctranslate"
Requires-Dist: xformers; extra == "falcon"
Requires-Dist: datasets; extra == "fine-tune"
Requires-Dist: huggingface-hub; extra == "fine-tune"
Requires-Dist: peft (>=0.6.0); extra == "fine-tune"
Requires-Dist: trl; extra == "fine-tune"
Requires-Dist: openllm[agents,awq,baichuan,chatglm,ctranslate,falcon,fine-tune,ggml,gptq,grpc,mpt,openai,playground,qwen,starcoder,vllm]; extra == "full"
Requires-Dist: ctransformers; extra == "ggml"
Requires-Dist: auto-gptq[triton] (>=0.4.2); extra == "gptq"
Requires-Dist: bentoml[grpc] (<1.2,>=1.1.11); extra == "grpc"
Requires-Dist: triton; extra == "mpt"
Requires-Dist: openai[datalib] (>=1); extra == "openai"
Requires-Dist: tiktoken; extra == "openai"
Requires-Dist: ipython; extra == "playground"
Requires-Dist: jupyter; extra == "playground"
Requires-Dist: jupytext; extra == "playground"
Requires-Dist: nbformat; extra == "playground"
Requires-Dist: notebook; extra == "playground"
Requires-Dist: cpm-kernels; extra == "qwen"
Requires-Dist: tiktoken; extra == "qwen"
Requires-Dist: bitsandbytes; extra == "starcoder"
Requires-Dist: ray (==2.6.0); extra == "vllm"
Requires-Dist: vllm (==0.2.7); extra == "vllm"
Provides-Extra: agents
Provides-Extra: all
Provides-Extra: awq
Provides-Extra: baichuan
Provides-Extra: chatglm
Provides-Extra: ctranslate
Provides-Extra: falcon
Provides-Extra: fine-tune
Provides-Extra: full
Provides-Extra: ggml
Provides-Extra: gptq
Provides-Extra: grpc
Provides-Extra: mpt
Provides-Extra: openai
Provides-Extra: playground
Provides-Extra: qwen
Provides-Extra: starcoder
Provides-Extra: vllm
Description-Content-Type: text/markdown
License-Expression: Apache-2.0
License-File: LICENSE.md
[Description omitted; length: 57140 characters]

WHEEL

Wheel-Version: 1.0
Generator: hatchling 1.18.0
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
openllm/__init__.py sha256=yXvLtAdkCyoZtR8UdjTL1dEGjx-SJZhbJ0oi5gu9QAk 1900
openllm/__init__.pyi sha256=Xt9iRlxVHD9BjoCzVh-P0FHlUBrVfEOtQhWSMGl7nW8 2191
openllm/__main__.py sha256=8CD9lFRbexTWeIXfmXDJgXmSGdB7drAsocN2ACHh-o0 77
openllm/_deprecated.py sha256=QpQCO5Sb09J44tjHdttj7OM68epWR1j2yQYD6DZfbX8 1659
openllm/_generation.py sha256=JDBI1gYM6wB_hYn6qI1KCNDse4PCqOGCKRn5Z2b-X6g 1647
openllm/_generation.pyi sha256=rOsbb14WdoErjcqIcuSCl4jOyVIbSy3NF-DOQotu1kI 349
openllm/_llm.py sha256=dpzyjaAD6itwvvfiK1UCueDTJeledshizJNzRFcsKB8 21441
openllm/_llm.pyi sha256=B-cZftUO1lJznhPPB7sdXdeVlftlVPuODf0055StRow 4603
openllm/_quantisation.py sha256=zSs4a7ptzCBWSFA_vEMKfyaxEmhWSKQiE3CPPqozbLE 4695
openllm/_quantisation.pyi sha256=OI-FRTfJqGp1EWiVKIE529znIYGRHyMylXk9x8kiQ2w 863
openllm/_runners.py sha256=blgJnQK2BZtcaI8TpzFaODB5_IYsSbolT0ttuELWK_c 13324
openllm/_runners.pyi sha256=jRjfsuM0LFgHAEfaAi8b1xFey_qtOoGYJCSUP6jSjOw 3524
openllm/_service.py sha256=rbwnBPhEqlpxK5dBBKTS2tD_X63vrbThDHoEPRzcF54 2702
openllm/_service_vars.py sha256=pI57VsYgyIwiKvHMDiYb1DTqqmkS5qpAVLizfqSIql8 552
openllm/_service_vars.pyi sha256=LOQmKiDguUf2TrBbk8Jfo9a_JJZWIuEA-gkKmt9cjDU 264
openllm/_strategies.py sha256=DFM9jGr-FbSH0g8oc5G3OGTb0E-yxBgvwc9WZT05buo 12059
openllm/_strategies.pyi sha256=raIUT48BcmX4RorjQGbnZ9dU3HEDfWyRyKnheP10EVc 1661
openllm/_version.py sha256=Hodf0RyFyMLEUHae1zRtpuRqo91VxdPPlmb7Ok37M6o 413
openllm/client.py sha256=ELXxa0ZHUyJPQojTYGHSX30FCIwEJFFKc87IjVsRlZ8 170
openllm/client.pyi sha256=nXMnY68ydBu3V67Y7ii_pUcS-JtfVeOsZtA2nqLkolM 261
openllm/exceptions.py sha256=wBORkYZWVWMtDYsepLvET6U0v2dPE0QOjmsrQDvVhVs 443
openllm/py.typed sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
openllm/utils.py sha256=wlk-Y3pEAmYbdeuCNHcEltS4MjT2y1wptGvmzJSW17o 1053
openllm/utils.pyi sha256=YlqML6p6ainzu8TJL0OX2vXrOoglUY7Ui4H6kWpBBZQ 2312
openllm/bundle/__init__.py sha256=qzPvcopYLHxcU2459t7ZYkqhVWITIOXmzaQz69ryWG4 1809
openllm/bundle/__init__.pyi sha256=w-oFyVRqvWrqMIQea7_MRBkR-uRE5dIhuK5uCTKVnDc 711
openllm/bundle/_package.py sha256=NXVgYI2hpWTGvZtKYxPXamdMKBNfiXY1GnvzIah_ugg 6019
openllm/bundle/_package.pyi sha256=Q37NcitykBpPw0Tn7RsG7KJOd5o4kUE4BwOi8-mMmMQ 1315
openllm/entrypoints/__init__.py sha256=culkWf7aXfKTpY7TCLFuAi3cZ9dktQZgT32lwOvghds 526
openllm/entrypoints/__init__.pyi sha256=4r6sILQp1szfLxn9xMa_w_w3UfUcuFs74BJ7IFz5H4Q 457
openllm/entrypoints/_openapi.py sha256=HHJurdy5MMa8jW5IYh-pNQkXPCHypPyK_8wtFNU7ms0 19916
openllm/entrypoints/_openapi.pyi sha256=KtSx9eqUYzE7EB3yi0BiNKRyY_KUXEl5WOFYiyb_Z9E 1223
openllm/entrypoints/cohere.py sha256=3TCe6_v-yJo4EOfjxYZqvX3vC44q6axp0pLcbartHFo 9917
openllm/entrypoints/cohere.pyi sha256=yFQmGw73R9ofUO3drckHyiPxVlKJsT24JeLW4vj47LU 815
openllm/entrypoints/hf.py sha256=5unnXYso3XrhDVzRz1bLiA5udnfnLhlhFBJoFTWwZH4 2748
openllm/entrypoints/hf.pyi sha256=5ET_h_jeqydCMa3QhO7VloXfC33xleR9889ufsr5JxU 493
openllm/entrypoints/openai.py sha256=pRudkfq17jpT06aunUB1q2wAoh_gYF8qZpLitRAApcA 17155
openllm/entrypoints/openai.pyi sha256=gOyXtmFN-_80XO19A34rC-IAlNPJ1vJLIERD8OG07Yk 1113
openllm/models/__init__.py sha256=_tDrA2UfAoWKoEG_ZaKIkx5WaUbcIIwOdoSnYsH5eyM 172
openllm/protocol/__init__.py sha256=A_r2xLdXQabYOq_cSwz5tWOb4MlSrqSXq9iC6prl8sI 431
openllm/protocol/cohere.py sha256=TjTWfNnM75OM4D1nttyrCQn8Js_utwUWwtyQZvyTL6o 4114
openllm/protocol/hf.py sha256=_UaoK2HF1AIF77PIeK27olybeVtaQ1jplVVEvads6Dk 278
openllm/protocol/openai.py sha256=iAWzFtkaVURdS15L6AVZ5RFQVOtXyyiOsl28-OVL-Ps 5951
openllm/serialisation/__init__.py sha256=z5J8-n-Pgb2KEX4xUMI6d-ddR498ZiuvvQn79Y6US6M 3274
openllm/serialisation/__init__.pyi sha256=Albc8_HRc9V5t_QyZT3omuAbWr4IJlIPUj8GZswBRRI 808
openllm/serialisation/_helpers.py sha256=KuqYXPIvzrzTq2MaxOM15EAw1U69czg-end4TL1FHVg 5365
openllm/serialisation/_helpers.pyi sha256=xiEBF4q02fF0ExxNdgix4yCTriHW55lyCcJAzVwQflY 680
openllm/serialisation/constants.py sha256=T_KFgTIcJcpsKUret-kBq659997t3g3oqwKeL89mvTU 313
openllm/serialisation/ctranslate/__init__.py sha256=Zr0NSorOSZVOzCV5XRXwdxVNYOEQh2BcWpjp3UONFmE 3664
openllm/serialisation/ggml/__init__.py sha256=FNEsK69i8xTVW6zdTY915pmp8huMEZSYGggNVAlWip0 334
openllm/serialisation/transformers/__init__.py sha256=VDNk5K1hmL-ZP8DT1AFiY9LcnLOfolx7cxYW4oA6mFw 6452
openllm/serialisation/transformers/_helpers.py sha256=SL8RwNFgt1WZpFPAxfFC0F2vCl4JNFh127T7J2d3b68 2124
openllm/serialisation/transformers/weights.py sha256=HoER9SlaLDIo7htnziPmVcIjqeAf2UXXDBHGq05_DPk 2310
openllm_cli/__init__.py sha256=Gwt9e4FTk-KOZ3xiTHkZrab9Qyw9v0pdFT6VjRvzHYQ 62
openllm_cli/_factory.py sha256=qqk41FK4qsVrzdP3JBiYXr5FnVjmA00jodS5HFX2AUM 14785
openllm_cli/_sdk.py sha256=4J7ag8hzEm-8_Ayrfi44Dj6VeqrumAt5TzL2DOU0KY8 12793
openllm_cli/entrypoint.py sha256=-_FWdEB4cnB4vD3L-XtHaE9ycnCg9TVUlMcEqvsuFCc 42466
openllm_cli/termui.py sha256=UHJ4FUGfPPl9HPZjLDsB2kWNLw4Wu_Z6SF6FLr5X3yc 2431
openllm_cli/extension/__init__.py sha256=SUTaU74L-26yfh7J9KAWNy4rgY54YgNVLvsa1iPTRKw 527
openllm_cli/extension/dive_bentos.py sha256=gMCThIE4soauAvP6ExXiY3hQ3qbH2ggav_RQjJ_qyoU 1561
openllm_cli/extension/get_containerfile.py sha256=W9gIwnQl__77lsEOIyXaf5Nup7RyyuwZuRr2jn6SAY8 2215
openllm_cli/extension/get_prompt.py sha256=c7XF_jPC1iRUAIqDBr7jBG7WIirD8qqoI-ZI4fGJD8w 6612
openllm_cli/extension/list_bentos.py sha256=YAUdEvUCpR03_8K12ew8NZWPN6BTguYZK8tIo6d3f2A 1116
openllm_cli/extension/list_models.py sha256=JWiRenuSwIE-Myczjr6tNr1JfH2ZnQ1EX6CXnH_iK8I 1590
openllm_cli/extension/playground.py sha256=Ee0lYQlJXa9hKRsse-zdy94TB4pQOkuYA4yyVr26VH4 3623
openllm_cli/playground/README.md sha256=KeaanN0mWsUzR7HKv5AeeOu0FJY_sEV6fLqDAY-Hhpw 368
openllm_cli/playground/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
openllm_cli/playground/_meta.yml sha256=U-LEG2murq1nHfVD7FXZraY2XWmnP-lszDPisRD0cvg 1359
openllm_cli/playground/falcon_tuned.py sha256=uA8o_ZP8BzB_62ETMpE1dNFa0QU8yi-l_HiAnONWj08 3112
openllm_cli/playground/features.py sha256=ez2nTDniwgFDYlebm9BpkLjVT9yqYPpJUn3GbrEweGY 1086
openllm_cli/playground/llama2_qlora.py sha256=D5hnExDqgLwSxfgVcVcF0yHsezrGidWUjY6Dh_WSmZI 8315
openllm_cli/playground/opt_tuned.py sha256=61BN84lVvt3D7ymUsmx3nXdeRfPTsfpF3Vx30x3sXFY 2688
openllm-0.4.44.dist-info/METADATA sha256=GYvAN1Lvmsp4jQuwIXOmNZgj2iFkRYV_3Zh1MTt1d24 62432
openllm-0.4.44.dist-info/WHEEL sha256=9QBuHhg6FNW7lppboF2vKVbCGTVzsFykgRQjjlajrhA 87
openllm-0.4.44.dist-info/entry_points.txt sha256=Pxxz__bK3a4GgWdPlQimxDzeYNQE_5XRxYBpzZsTaYY 423
openllm-0.4.44.dist-info/licenses/LICENSE.md sha256=CYovEhTMXtmLOTu5qaIIll5Y50AdmyodHP0025XUsRQ 10470
openllm-0.4.44.dist-info/RECORD — —

entry_points.txt

[console_scripts]
openllm = openllm_cli.entrypoint:cli
openllm-dive-bentos = openllm_cli.extension.dive_bentos:cli
openllm-get-containerfile = openllm_cli.extension.get_containerfile:cli
openllm-get-prompt = openllm_cli.extension.get_prompt:cli
openllm-list-bentos = openllm_cli.extension.list_bentos:cli
openllm-list-models = openllm_cli.extension.list_models:cli
openllm-playground = openllm_cli.extension.playground:cli