Wheelodex » Projects » llm-foundry

llm-foundry

View on PyPI — Reverse Dependencies (2)

0.7.0 llm_foundry-0.7.0-py3-none-any.whl

Wheel Details

Project: llm-foundry
Version: 0.7.0
Filename: llm_foundry-0.7.0-py3-none-any.whl
Download: [link]
Size: 176082
MD5: 5cefe7f633753820f7405a9d5d274968
SHA256: 6d736d5edf380dc7ab2812df16d4cc8cde2a93494b37911131af258701cfdf53
Uploaded: 2024-03-27 05:19:17 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt · entry_points.txt

METADATA

Metadata-Version: 2.1
Name: llm-foundry
Version: 0.7.0
Summary: LLM Foundry
Author: MosaicML
Author-Email: team[at]mosaicml.com
Home-Page: https://github.com/mosaicml/llm-foundry/
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Requires-Python: >=3.9
Requires-Dist: mosaicml[gcs,libcloud,oci,wandb] (<0.22,>=0.21.1)
Requires-Dist: mlflow (<3,>=2.10)
Requires-Dist: accelerate (<0.26,>=0.25)
Requires-Dist: transformers (<4.39,>=4.38.2)
Requires-Dist: mosaicml-streaming (<0.8,>=0.7.4)
Requires-Dist: torch (<2.3,>=2.2.1)
Requires-Dist: datasets (<2.17,>=2.16)
Requires-Dist: fsspec (==2023.6.0)
Requires-Dist: sentencepiece (==0.1.97)
Requires-Dist: einops (==0.7.0)
Requires-Dist: omegaconf (<3,>=2.2.3)
Requires-Dist: slack-sdk (<4)
Requires-Dist: mosaicml-cli (<1,>=0.6.10)
Requires-Dist: onnx (==1.14.0)
Requires-Dist: onnxruntime (==1.15.1)
Requires-Dist: boto3 (<2,>=1.21.45)
Requires-Dist: huggingface-hub (<1.0,>=0.17.0)
Requires-Dist: beautifulsoup4 (<5,>=4.12.2)
Requires-Dist: tenacity (<9,>=8.2.3)
Requires-Dist: catalogue (<3,>=2)
Requires-Dist: typer[all] (<1)
Requires-Dist: lz4 (<5,>=4); extra == "all"
Requires-Dist: databricks-sql-connector (<4,>=3); extra == "all"
Requires-Dist: flash-attn (==2.5.0); extra == "all"
Requires-Dist: mosaicml[databricks] (<0.22,>=0.21.1); extra == "all"
Requires-Dist: pytest-cov (<5,>=4); extra == "all"
Requires-Dist: pytest-codeblocks (<0.17,>=0.16.1); extra == "all"
Requires-Dist: packaging (<23,>=21); extra == "all"
Requires-Dist: databricks-connect (==14.1.0); extra == "all"
Requires-Dist: mosaicml[peft] (<0.22,>=0.21.1); extra == "all"
Requires-Dist: tiktoken (==0.4.0); extra == "all"
Requires-Dist: pre-commit (<4,>=3.4.0); extra == "all"
Requires-Dist: toml (<0.11,>=0.10.2); extra == "all"
Requires-Dist: hf-transfer (==0.1.3); extra == "all"
Requires-Dist: openai (==1.3.8); extra == "all"
Requires-Dist: mosaicml[tensorboard] (<0.22,>=0.21.1); extra == "all"
Requires-Dist: pytest (<8,>=7.2.1); extra == "all"
Requires-Dist: pyright (==1.1.256); extra == "all"
Requires-Dist: ai2-olmo (>0.2.4); extra == "all"
Requires-Dist: lz4 (<5,>=4); extra == "all-cpu"
Requires-Dist: databricks-sql-connector (<4,>=3); extra == "all-cpu"
Requires-Dist: mosaicml[databricks] (<0.22,>=0.21.1); extra == "all-cpu"
Requires-Dist: pytest-cov (<5,>=4); extra == "all-cpu"
Requires-Dist: pytest-codeblocks (<0.17,>=0.16.1); extra == "all-cpu"
Requires-Dist: packaging (<23,>=21); extra == "all-cpu"
Requires-Dist: databricks-connect (==14.1.0); extra == "all-cpu"
Requires-Dist: mosaicml[peft] (<0.22,>=0.21.1); extra == "all-cpu"
Requires-Dist: tiktoken (==0.4.0); extra == "all-cpu"
Requires-Dist: pre-commit (<4,>=3.4.0); extra == "all-cpu"
Requires-Dist: toml (<0.11,>=0.10.2); extra == "all-cpu"
Requires-Dist: hf-transfer (==0.1.3); extra == "all-cpu"
Requires-Dist: openai (==1.3.8); extra == "all-cpu"
Requires-Dist: mosaicml[tensorboard] (<0.22,>=0.21.1); extra == "all-cpu"
Requires-Dist: pytest (<8,>=7.2.1); extra == "all-cpu"
Requires-Dist: pyright (==1.1.256); extra == "all-cpu"
Requires-Dist: ai2-olmo (>0.2.4); extra == "all-cpu"
Requires-Dist: lz4 (<5,>=4); extra == "all-flash2"
Requires-Dist: databricks-sql-connector (<4,>=3); extra == "all-flash2"
Requires-Dist: flash-attn (==2.5.0); extra == "all-flash2"
Requires-Dist: mosaicml[databricks] (<0.22,>=0.21.1); extra == "all-flash2"
Requires-Dist: pytest-cov (<5,>=4); extra == "all-flash2"
Requires-Dist: pytest-codeblocks (<0.17,>=0.16.1); extra == "all-flash2"
Requires-Dist: packaging (<23,>=21); extra == "all-flash2"
Requires-Dist: databricks-connect (==14.1.0); extra == "all-flash2"
Requires-Dist: mosaicml[peft] (<0.22,>=0.21.1); extra == "all-flash2"
Requires-Dist: tiktoken (==0.4.0); extra == "all-flash2"
Requires-Dist: pre-commit (<4,>=3.4.0); extra == "all-flash2"
Requires-Dist: toml (<0.11,>=0.10.2); extra == "all-flash2"
Requires-Dist: hf-transfer (==0.1.3); extra == "all-flash2"
Requires-Dist: openai (==1.3.8); extra == "all-flash2"
Requires-Dist: mosaicml[tensorboard] (<0.22,>=0.21.1); extra == "all-flash2"
Requires-Dist: pytest (<8,>=7.2.1); extra == "all-flash2"
Requires-Dist: pyright (==1.1.256); extra == "all-flash2"
Requires-Dist: ai2-olmo (>0.2.4); extra == "all-flash2"
Requires-Dist: mosaicml[databricks] (<0.22,>=0.21.1); extra == "databricks"
Requires-Dist: databricks-sql-connector (<4,>=3); extra == "databricks"
Requires-Dist: databricks-connect (==14.1.0); extra == "databricks"
Requires-Dist: lz4 (<5,>=4); extra == "databricks"
Requires-Dist: pre-commit (<4,>=3.4.0); extra == "dev"
Requires-Dist: pytest (<8,>=7.2.1); extra == "dev"
Requires-Dist: pytest-codeblocks (<0.17,>=0.16.1); extra == "dev"
Requires-Dist: pytest-cov (<5,>=4); extra == "dev"
Requires-Dist: pyright (==1.1.256); extra == "dev"
Requires-Dist: toml (<0.11,>=0.10.2); extra == "dev"
Requires-Dist: packaging (<23,>=21); extra == "dev"
Requires-Dist: hf-transfer (==0.1.3); extra == "dev"
Requires-Dist: flash-attn (==2.5.0); extra == "gpu"
Requires-Dist: flash-attn (==2.5.0); extra == "gpu-flash2"
Requires-Dist: ai2-olmo (>0.2.4); extra == "olmo"
Requires-Dist: openai (==1.3.8); extra == "openai"
Requires-Dist: tiktoken (==0.4.0); extra == "openai"
Requires-Dist: mosaicml[peft] (<0.22,>=0.21.1); extra == "peft"
Requires-Dist: mosaicml[tensorboard] (<0.22,>=0.21.1); extra == "tensorboard"
Provides-Extra: all
Provides-Extra: all-cpu
Provides-Extra: all-flash2
Provides-Extra: databricks
Provides-Extra: dev
Provides-Extra: gpu
Provides-Extra: gpu-flash2
Provides-Extra: olmo
Provides-Extra: openai
Provides-Extra: peft
Provides-Extra: tensorboard
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 17597 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.43.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
llmfoundry/__init__.py sha256=XJrd1YGESOTX4_vQZTJb3CUTs8czQw7d_Qwhv_VdJ-w 2291
llmfoundry/registry.py sha256=2CoLcyDX6JbfFDdM3iY2ShmXqenMdo7V98jERNGJr5Q 5682
llmfoundry/algorithms/__init__.py sha256=CZiNMQ2O5Keg6ID8P561DepMtPsPAySDi1HVpBGr1wQ 507
llmfoundry/callbacks/__init__.py sha256=O8nprw-cbvmwDKQ9bFRwP1aQ9q8TV7sBq9NmfSULrfA 2343
llmfoundry/callbacks/async_eval_callback.py sha256=xyb5L_YiIwy0fmD3QOq96ByWf36FpdGjTtzABOR6Usc 22746
llmfoundry/callbacks/curriculum_learning_callback.py sha256=FWu_pzrtI9LebUcZ1lZmaa9Pc_6p2dY2Re3eFLC0Cak 4877
llmfoundry/callbacks/eval_gauntlet_callback.py sha256=7fY7PLGkQ8c-6RdrN75W1GyoLAasFQAgtcBw_A2P-r8 9357
llmfoundry/callbacks/fdiff_callback.py sha256=jmiFwaaFA92jOtCXC3maHKkqsz7RwBeHAED7ni4Cll0 2453
llmfoundry/callbacks/hf_checkpointer.py sha256=oIllg19sA6uYBSDA4n6dOuHvK6cIyN4eMQiqegw8gww 19041
llmfoundry/callbacks/monolithic_ckpt_callback.py sha256=Q1NE1qFecRJOlI0D4zeGv3gPgWHEdz41jX7PrvkbSUs 5176
llmfoundry/callbacks/resumption_callbacks.py sha256=60EvBG-6KD1Gh82iS4IHBazwA59mq9mCXc9XE5usI6g 2919
llmfoundry/callbacks/scheduled_gc_callback.py sha256=Ogc3Bh_RuqjUOoYw4UZoJrbcd1bXhLLW79VkO9E-9cc 2387
llmfoundry/cli/__init__.py sha256=gJ8lXYYQoLkj9zfaXSzaPPy46lnRl3QPbiSXSIEGY_A 84
llmfoundry/cli/cli.py sha256=XrLeHCqSlaKmX6bBqLbPYhndEC8kYJ0TGueiK7HF8g4 282
llmfoundry/cli/registry_cli.py sha256=GLpl8PiuFV3x78i8GZhpSELmMbdvoSRUQr0b5SmeEic 2107
llmfoundry/data/__init__.py sha256=xHlGbflEBDjdNzyctVl8NeHRJe28Cf7WmEs_rCOCN5Q 855
llmfoundry/data/data.py sha256=SQvrhtYpm8HKY3CsdFz9phByh6AkF-pUXtn3PESIyhY 4759
llmfoundry/data/dataloader.py sha256=9uKGsE-7NwRK7GuSuZIC5AnynLJXBdeovHrOJZTUaxQ 1175
llmfoundry/data/packing.py sha256=sM_zoRb42jRXgTaABzZ-P96NdxVyDXrLpl0uBwWHj7o 18057
llmfoundry/data/text_data.py sha256=uhBLrWcExnDUhTLlGqXCSoKYQ0qwcHlLI3VlSLRKTKc 18460
llmfoundry/data/finetuning/__init__.py sha256=eEY6rY1nHeZchIbKaodEMVOHVXVqlKfe60s3Oj9IhSI 309
llmfoundry/data/finetuning/collator.py sha256=HaBRUpkY41DvfTS9tnmPvBXN3o2otHIU1nuDjZf0VE4 19697
llmfoundry/data/finetuning/dataloader.py sha256=8ZiLmr7dVr5lAp7nALjxCAvsfcaGrTKuqhtCQCBKTi8 28886
llmfoundry/data/finetuning/tasks.py sha256=XgUgAdxIKcXqigGa36b2oL3bCyNXdEyu7F7Hq310KQ0 39462
llmfoundry/interfaces/__init__.py sha256=emxMtqjUDeGjX4F0Q_tfZ6PYGwssq3A6XFflbX06ni8 200
llmfoundry/interfaces/callback_with_config.py sha256=Q0rJWTX7t8kqYQw8tjgTgITK7tiBp29Ds9jzPsPdpMg 495
llmfoundry/loggers/__init__.py sha256=7loOALPqr5fB37Pr5etU2OZJFF9qJCNbKOnBf_QFi7g 551
llmfoundry/metrics/__init__.py sha256=AmboVAI18EGmfQxNGfsjqQCuy4VYziHh6HW2Feaga5A 2402
llmfoundry/metrics/token_acc.py sha256=bl1skRTUD8gZe4bt-uDxDRs0o7-vre0K8DFvgLQ-NHg 2344
llmfoundry/models/__init__.py sha256=8S0gc3JmVRKdTX4jeETRg2Bxac93FHcR92YrOKnT3LQ 1368
llmfoundry/models/hf/__init__.py sha256=yU6pQtOr9F5QYBQm0x_bu6R76Wb85UjRa74aT083-gw 605
llmfoundry/models/hf/hf_causal_lm.py sha256=YPwg2OowZoQtuAGBCngk_gNFH4Igp6HXJLFT4QIzvwE 13644
llmfoundry/models/hf/hf_fsdp.py sha256=y4MVeKGSCCPuGuZ_1hGJHP_DGRUXgP9fEbuWlUgb6vo 9795
llmfoundry/models/hf/hf_t5.py sha256=LSmCiH8FGQ-LeAJ2EkW-FgB_4u-98InxkfC9iGf0I0Y 5348
llmfoundry/models/hf/model_wrapper.py sha256=E-KHK-Bj8obbr5tKXho8xjabKNS-rDM94XiNYglVmV8 2766
llmfoundry/models/inference_api_wrapper/__init__.py sha256=P4DVPVK93Wr4qxXAk8dc0xopT5ZzrMynKxDvRmsmJKc 594
llmfoundry/models/inference_api_wrapper/fmapi.py sha256=58isq_ITM35oWjo9x6RY8G_ew8aKbNXrbliQHpIpZHk 2283
llmfoundry/models/inference_api_wrapper/interface.py sha256=IHAdGBUzuE6oFlIsn3AnxnGK5Ho4Q6J8GsPQRI2tMGg 4124
llmfoundry/models/inference_api_wrapper/openai_causal_lm.py sha256=ZDFQ3cewWtXvXZZj4dCyshP_Wx-9TUudkek5yJGFlAc 11279
llmfoundry/models/layers/__init__.py sha256=Y8WNib2k-BWEx_agW1Lbz9Z_3PBYy5j-XsUIpOwopn8 1101
llmfoundry/models/layers/attention.py sha256=7RELoKUM9VxLbgLZb5w2tEjYCvVxZJQla4j04xzFQgM 27661
llmfoundry/models/layers/blocks.py sha256=jcHVHdrZUvGiu0FBb7kkb_z5UXF3toi5O7TxLREs6TU 5155
llmfoundry/models/layers/custom_embedding.py sha256=yuLlWty7Q5jBSucr5HAgc2irqTNjaPr3X6VXMqF27sg 381
llmfoundry/models/layers/fc.py sha256=mmZyMTQo_iLDrHoqjNJOMgmuFU_d1prMIug2Xsdke3U 262
llmfoundry/models/layers/ffn.py sha256=EOUbsUyWia1OV_qgmFIRNyqsHV2GzkgcgnVILwBqJm8 6148
llmfoundry/models/layers/norm.py sha256=TZKiMEhY-jlweNaOufqEc8AndiY7P_5nJ_5KyA3bWiA 3766
llmfoundry/models/mpt/__init__.py sha256=_GpMnOi5nRyvbOEK-EbHfFRnZteZjPSV_NUVwdObs-Y 481
llmfoundry/models/mpt/configuration_mpt.py sha256=ouikknarz8fhux48nEoKLhuAxw8ZXItp1ZWU0tE1AYA 17388
llmfoundry/models/mpt/modeling_mpt.py sha256=uhaTtiP7SW2TiBP5_uOrHmtrK7IZoQgNwoIMjTZQcpg 45260
llmfoundry/models/utils/__init__.py sha256=nIReek3L8ZGnS-PZ1YOX1ugPNbj9q1IeNqEsTW6ghIE 500
llmfoundry/models/utils/act_ckpt.py sha256=HsgP9l-IcjV_pOxKMAYNgGRD21KmrU1hry3NWaTOGnY 6254
llmfoundry/models/utils/meta_init_context.py sha256=gDUe8cYGy71WU4-XCyKV4sd00Hp_kgyAjucyXQ-aNBc 5014
llmfoundry/models/utils/param_init_fns.py sha256=-QjeJiRSFGWozLSG_yY7SySZVEHQcJnukDHuDto6wi4 15082
llmfoundry/optim/__init__.py sha256=1JRqy79je48AmQK7W2GjQU8pJvh_q4s6SaVVWT7aN6U 1233
llmfoundry/optim/adaptive_lion.py sha256=_XDwX137BU9undUhg8ReCT4bjVXps3eMZFCJgeCIbpo 18249
llmfoundry/optim/lion.py sha256=EZil6e2dgQg560JLIcHriL9pcLMucIAIdbBPSZLkisY 5919
llmfoundry/optim/outlier_detection.py sha256=OBNATwAtwR82U5dF4aNOYXzzv9SBzyy_7CTm-8NSk1Q 2765
llmfoundry/optim/scheduler.py sha256=xYUY4C_F6Y-DjKkfHADoikt58lxwk599ZW-mZJSCZ_s 7422
llmfoundry/tokenizers/__init__.py sha256=PgQG4kMngrpP9KKVhhFEupNWN4MnKCLxjyxwZMA66kM 200
llmfoundry/tokenizers/tiktoken.py sha256=UrU6mnkkXr-PBBMbvXqJTg9VtqgZqSeqYjfixhGabDE 15297
llmfoundry/utils/__init__.py sha256=oQByIdFqowNTBeOY1AdqDjdNby_29FTQDBeiCkU34eo 2562
llmfoundry/utils/builders.py sha256=INedLGM1ytPPcxakUNMOvhAuVH-VWW0_z-Vf9vEeqpM 23151
llmfoundry/utils/checkpoint_conversion_helpers.py sha256=ArpcHsWaFm8QEK9YMJPtnEIGXqU2__MQimmcIG69UYg 15947
llmfoundry/utils/config_utils.py sha256=458wNzMoY0XNyuZmHASVW-SFG8q8WzxddehC8Eoq3oc 7123
llmfoundry/utils/data_prep_utils.py sha256=cTO4J7RfhMu0wo5jen1YTqOd4-H0RmRXsDrreRjjBpw 3718
llmfoundry/utils/exceptions.py sha256=_Ot8o0KgNDWIqUHrA8VLcqfOgiZanUlMD7E40YiSFmI 7542
llmfoundry/utils/huggingface_hub_utils.py sha256=l_Dsl2TUicnj2tw1eXGMdBQRG1CZbKM7vFeo00OBXIA 5920
llmfoundry/utils/logging_utils.py sha256=qLHdT8DPBHfPOZcVZfUvM34X3QRugY8pv0gHr534Oj8 1251
llmfoundry/utils/model_download_utils.py sha256=_zsg02u_w86BIHgD72J7jIeqAX4Z1SU1Pn2USlHMH-A 11858
llmfoundry/utils/mosaicml_logger_utils.py sha256=qe4Tv3Qb8dyBMqu8mIqVGqIEE2b-nGXmNXoGY7zlgdA 5646
llmfoundry/utils/prompt_files.py sha256=KtQISxzvpYMN83QLgVhzIETHUowojFrnWNC-YmoB7cc 2050
llmfoundry/utils/registry_utils.py sha256=M_2eAhZvAjD66_-6sJH7Wd_QYibZmmvzzmzfsjj5nxA 5827
llmfoundry/utils/warnings.py sha256=f_IjU3JdYiaMflb7z49R2ZpDPY0xbmxn7T7Xs11-3x0 2653
llm_foundry-0.7.0.dist-info/LICENSE sha256=YADP8fw0j_VxCGGTMMJtZ9WWv0TGhmHHSabFYc3D-08 11355
llm_foundry-0.7.0.dist-info/METADATA sha256=WEVPFRR3NPsYsEwMEuuG7ghwrrQ04UU61cxlTBW98tI 23287
llm_foundry-0.7.0.dist-info/WHEEL sha256=GJ7t_kWBFywbagK5eo9IoUwLW6oyOeTKmQ-9iHFVNxQ 92
llm_foundry-0.7.0.dist-info/entry_points.txt sha256=h8suzPbmMPNjkRv06agR4FIvXJHoqf8R7FFaPjfKKvc 54
llm_foundry-0.7.0.dist-info/top_level.txt sha256=hcLqk9UVR_PGNRva6kBTT_dfKtJy9tLa9iI_2faAHGs 11
llm_foundry-0.7.0.dist-info/RECORD — —

top_level.txt

llmfoundry

entry_points.txt

[console_scripts]
llmfoundry = llmfoundry.cli.cli:app