Wheelodex » Projects » torchtune

torchtune

View on PyPI — Reverse Dependencies (0)

0.1.1 torchtune-0.1.1-py3-none-any.whl

Wheel Details

Project: torchtune
Version: 0.1.1
Filename: torchtune-0.1.1-py3-none-any.whl
Download: [link]
Size: 210713
MD5: 1539c2e581ebb607be03d9ea861ed892
SHA256: ad80069ca1974146735aa324035df4af8d79191cc5644ebc56a26d9b8825564c
Uploaded: 2024-04-18 19:05:18 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt · entry_points.txt

METADATA

Metadata-Version: 2.1
Name: torchtune
Version: 0.1.1
Summary: A native-PyTorch library for LLM fine-tuning
Author-Email: PyTorch Team <packages[at]pytorch.org>
Project-Url: GitHub, https://github.com/pytorch/torchtune
Project-Url: Documentation, https://pytorch.org/torchtune/main/index.html
Project-Url: Issues, https://github.com/pytorch/torchtune/issues
License: BSD 3-Clause License Copyright 2024 Meta Redistribution and use in source and binary forms, with or without modification, are permitted provided that the following conditions are met: 1. Redistributions of source code must retain the above copyright notice,this list of conditions and the following disclaimer. 2. Redistributions in binary form must reproduce the above copyright notice, this list of conditions and the following disclaimer in the documentation and/or other materials provided with the distribution. 3. Neither the name of the copyright holder nor the names of its contributors may be used to endorse or promote products derived from this software without specific prior written permission. THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS “AS IS” AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
Keywords: pytorch,finetuning,llm
Requires-Python: >=3.8
Requires-Dist: datasets
Requires-Dist: huggingface-hub
Requires-Dist: safetensors
Requires-Dist: sentencepiece
Requires-Dist: tiktoken
Requires-Dist: blobfile (>=2)
Requires-Dist: tqdm
Requires-Dist: omegaconf
Requires-Dist: torchao (==0.1)
Requires-Dist: bitsandbytes (>=0.43.0); extra == "dev"
Requires-Dist: pre-commit; extra == "dev"
Requires-Dist: pytest; extra == "dev"
Requires-Dist: pytest-cov; extra == "dev"
Requires-Dist: pytest-mock; extra == "dev"
Requires-Dist: pytest-integration; extra == "dev"
Requires-Dist: tensorboard; extra == "dev"
Requires-Dist: wandb; extra == "dev"
Provides-Extra: dev
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 14763 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.43.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
recipes/__init__.py sha256=no8aE2zRiWMAkoPaKlysg0zZa1T3lRkYrceTFI5kxjs 1204
recipes/eleuther_eval.py sha256=gAOOFpzmXyCVMhRLei78ecFNe-KAQ9awW6w_UvDVEHU 7039
recipes/full_finetune_distributed.py sha256=tGW9r6SOCCfcF0IHOUoaooX557Juy6I9tvhipTZlAT0 21147
recipes/full_finetune_single_device.py sha256=iYy_T9tjvUlLBV7AoQZ7YGAnvt0jtQIu1iqQv6gIEss 21165
recipes/generate.py sha256=qBgtXs01dl6g-4bVKDJuXUPrqyE6V41nCV9P9cbfLn4 5485
recipes/lora_dpo_single_device.py sha256=a4AcxxXQ2fjl2GPZW9HJW6eaUhJH-bvKkyWYuk8Wat0 22625
recipes/lora_finetune_distributed.py sha256=fXA8F__AInV9vFEW_N6Kqnc4mBxuWFpR0Sf-RvaA6-w 25790
recipes/lora_finetune_single_device.py sha256=qRGChnpnxk6kwo4IOjUYbmM19_rXeuOHKK1dlm37-Rw 21491
recipes/quantize.py sha256=J0lIIESz-k7CcZ-BoUJMyeCgmcv3ccjzwbEA2r-9ycQ 4284
recipes/configs/eleuther_evaluation.yaml sha256=kbw8igAJy1Rn4j_ep7CZWDR9RhvbW4grUmro6zzgQDE 893
recipes/configs/generation.yaml sha256=0_aXRDO3PJELA1PvV0TFKalV0KsC9TVudrD4Tjre5es 900
recipes/configs/quantization.yaml sha256=RWYyn3upYtNLgpitYGHz_vnhpcvhyizepq9Px14LWPk 664
recipes/configs/gemma/2B_full.yaml sha256=pHpwTsDUrRexEI-ivjDk4oiOQS2e2vBfnEPnZk5i668 1925
recipes/configs/llama2/13B_full.yaml sha256=3S-o7260e5BwmAGuB-i5jcBGg43DyIH6wmnTd0xnFC0 2163
recipes/configs/llama2/13B_lora.yaml sha256=VbzsK8cdNwJATWGYBAfE_ryCX6xDa2pDDmAf6BdONkQ 2441
recipes/configs/llama2/13B_qlora_single_device.yaml sha256=Nl6kjwaFn6I_8kanVZfasLl_DSfKe-dvk4gyi4ey1go 2576
recipes/configs/llama2/70B_lora.yaml sha256=Pb5XzhqjBHg0okibzZfI0CGbpw1ieM-juNHpnt_GL1A 2278
recipes/configs/llama2/7B_full.yaml sha256=xMqrXS0r_uaff2tO6_jyfoUqJ3spVl8gai1Za8sR1x0 2083
recipes/configs/llama2/7B_full_low_memory.yaml sha256=giZeXJFVTAc0hPBa6SQ1gs5EqxhX-p972dl6zlmX3WU 2117
recipes/configs/llama2/7B_lora.yaml sha256=FzgupI16spliKSSq3WBMRIGWEGjJQZUFd9-TvXHvb6A 2326
recipes/configs/llama2/7B_lora_dpo_single_device.yaml sha256=ejg5X2jcTkFFFq0-AJ2CcwmFSvG9IdbRWUCdQ59iDH8 2262
recipes/configs/llama2/7B_lora_single_device.yaml sha256=2qIFFKnPoq3wTxVRwd7o1CVaNWxeiduFILD9z9TNhGQ 2423
recipes/configs/llama2/7B_qlora_single_device.yaml sha256=EHC7bwjzjmA6wjv9rruO6OKz2n3NJHEKBMtH22OlrKM 2528
recipes/configs/llama3/8B_full.yaml sha256=LQ3HXLOQAvvoe4OaG2SASosNsyI8T8nTAUcdAYgP9gA 2061
recipes/configs/llama3/8B_full_single_device.yaml sha256=N8OiJcUeRgPLNFhNBJcAsqNo19pJmVyQTBQ-FU4dYdI 2103
recipes/configs/llama3/8B_lora.yaml sha256=9I3cCClOIrTHz3OW7bqILlIq1EGgLTFgCpsArNR0YFE 2269
recipes/configs/llama3/8B_lora_single_device.yaml sha256=vHjEOrHs2QVZjCr13whJRbtc2jkwxNDvfUYu0xLQyKg 2254
recipes/configs/llama3/8B_qlora_single_device.yaml sha256=SIRRUPgNQrfJoMEVL6DnRICtqUTJgRIt4SNZJlICv4E 2359
recipes/configs/mistral/7B_full.yaml sha256=jDn1BFkj50J2hRh1P7kE89yFRf-AXjkPARdS9GjFW9s 2260
recipes/configs/mistral/7B_full_low_memory.yaml sha256=eaPMhASABLYRKEogOQVCchQ2fG1hjEAG1BBfhDtOniw 2321
recipes/configs/mistral/7B_lora.yaml sha256=KocHmgxTi-19QgRJzwdzMZjWP8ShLhnZEYTQY1I-0QQ 2502
recipes/configs/mistral/7B_lora_single_device.yaml sha256=29o-KdHrdB4yscORHjWt1IlosNvqyzZgHx8ni1RzmMY 2618
recipes/configs/mistral/7B_qlora_single_device.yaml sha256=J9n9j0xEtt_SmE4bicY8sytLPlCB4VnhSpilN5BE37U 2624
torchtune/__init__.py sha256=KBR3t2VOxR3GgBY_9CbRUQ53wnM-TpplUTFaDAR8a6I 337
torchtune/_recipe_registry.py sha256=kIqxkOS52E694y1ApjIERrNXMHMvQXjo6Th0QfJ3p2s 4547
torchtune/recipe_interfaces.py sha256=dZlJqmMuPVeaVRTWYKQeFHYDG2eTT0Thid9XXdrYm0M 2986
torchtune/_cli/__init__.py sha256=Md3cCHD7Ano9kV15PqGbicgUO-RMdh4aVy1yKiDt_xE 208
torchtune/_cli/cp.py sha256=K7lHVYYBYnUeL57ezg6GOfNkvTm9X3O1aLnx9aaAsYA 4285
torchtune/_cli/download.py sha256=jrGjNQbRgQbApc-sYTRM-3WUFVjbq_VZj-tirykMVYw 4516
torchtune/_cli/ls.py sha256=MZIEbLG-zDKkWqJLDWYtKBDx5zOLEeDMUJrEUmHwVIE 2334
torchtune/_cli/run.py sha256=HiAGXynG9MU1c9GZetRLgk2phxt5dGzEoo9zYpT_adI 7246
torchtune/_cli/subcommand.py sha256=jNSPqghuwu4iinHmuLRLJLF61dfQFMhHh6p4De_k22c 418
torchtune/_cli/tune.py sha256=xigrRZ7rThlo3EBRDfJELhYRzxjezckAV3YwlJM4Ico 1486
torchtune/_cli/validate.py sha256=q9ac66SVHgMTj4YBCkM3ijnTpjKl0td2wZwoJRt939Q 1837
torchtune/config/__init__.py sha256=Nw5DMSiF7P1jNxToKN01K-8BkFrXFUd2Q55hHf6wFzw 417
torchtune/config/_errors.py sha256=jwWwQr_b9MFo6llwo_DcoPz8aYL2N_6VMDGNxS4epAU 956
torchtune/config/_instantiate.py sha256=Kb3Qha4JSX1svkSPKV7qTm_n6TRx23NHTO5PzfRYpzg 4047
torchtune/config/_parse.py sha256=UV0iCINngaEb2PzFwnTJLq40oVMdBcpoEXVsO1AD1Z8 1598
torchtune/config/_utils.py sha256=bIhHNQodW709bysBPGvOdPIjN6yBTrHmCba28MOuoJQ 8148
torchtune/config/_validate.py sha256=nLJZHy_GkL8kWJTmb42QQd-zQEih_yflpEooUS7ecLM 1636
torchtune/data/__init__.py sha256=6eMBug1N1MCOBSfk9b38Bhhflp1Lu0aIEVwvD0Un2tw 1136
torchtune/data/_chat_formats.py sha256=k_HymaLTPlz4V7AmGU6bDctVtMANrW3TwS0YiMZ2S4w 7107
torchtune/data/_common.py sha256=Ctlddql8czaLac8fIfeDn65gCsvhpckfuN8sieV1-0c 241
torchtune/data/_converters.py sha256=8z91zG7DvIA_ODrsAUe0TWaUbFFNoyEQ9lOyqSoOhfU 1706
torchtune/data/_instruct_templates.py sha256=Fh3VrV6qlVw852na4ZJL46CeLpv8aFkM5sv7nH8oQTo 5989
torchtune/data/_types.py sha256=q5okK4jDPCkl6PhoIjYaKDfHSWzNXIIDzJQL-LdSBhs 1193
torchtune/data/_utils.py sha256=D8LI8c9XylzC3Q4MSSRJuIHmA_bTNrvOUuP1lhiW19M 2401
torchtune/datasets/__init__.py sha256=luVSpZ0PmQJktQd4EOsaGw7dkIVuiyog9DBvJAHw0YI 939
torchtune/datasets/_alpaca.py sha256=NKoNG0I2bTpEIG9s-_YR50RtSCRGHuWs9XHbeAtC3Ho 2593
torchtune/datasets/_chat.py sha256=uIShB6ScAs2lTBAAcwhv_EliYts2hywwr9UFdsxfGi4 5951
torchtune/datasets/_grammar.py sha256=TVW-Q7_M6wT5QJPXaKO1UQnpdjM4sKma-KmvxRrFBVA 2191
torchtune/datasets/_instruct.py sha256=SLCNpp7lQ6lg3_lwqdGgIRT1BuEuRP367wf8Aa1Ag-s 6802
torchtune/datasets/_preference.py sha256=pGSRYmNkmaNVzjWhhb-lIQNwinRG707YQ39ui2wyTyE 5049
torchtune/datasets/_samsum.py sha256=RsSjl8bJ8h-3YPDf-fsM2iTcv3zStkWUg1NTuAVGY9w 2097
torchtune/datasets/_slimorca.py sha256=PC0_ulZXE8almm9fDKOx3H67QNEStPtRu5Z1NOXOfQ4 2698
torchtune/datasets/_stack_exchanged_paired.py sha256=52WSUGAeqGhPhFxizf0DxxNoSkFkwhuA-b13PPIiRZc 1460
torchtune/models/__init__.py sha256=8Y3tcvEUgMSZWt9PlwpgV717r7dTtnMcFExSAAZMkZc 286
torchtune/models/convert_weights.py sha256=J2hZUrMcxkPXjNXg3mBC_8La4FFhBGgjT6jdfwr9O2o 7447
torchtune/models/gemma/__init__.py sha256=yR7Vb15zV2JE2mslcw2YxLu4uYPwDks4LyXMsCZ2ad4 319
torchtune/models/gemma/_component_builders.py sha256=07PPo7emXEXTd6c0NOBbRvorYt8iBacmGSqk9P2exLk 4617
torchtune/models/gemma/_model_builders.py sha256=E5SaFP4taDsfEB44r_ixIU4W_Bw0zhqZIOSB7YJOXlA 1258
torchtune/models/gemma/rms_norm.py sha256=XcZepZ_6RsCQLnmu5snrTMSxwkMGKzXcE924gqZgo7o 910
torchtune/models/gemma/transformer.py sha256=UmbgnqM_2GoGgKCIzrEy8GeDr52258yI5MNk_fTsR5M 5077
torchtune/models/llama2/__init__.py sha256=szRMLpDhi0RppGwjrswBCtENAKWhvv28mK4_KJMQwrA 719
torchtune/models/llama2/_component_builders.py sha256=Us7sNgBi1GuZE_6jKCOeyIsKJvLtpAuAMU4P5yowYFI 14695
torchtune/models/llama2/_model_builders.py sha256=dmrxA3_JD7UiSeoHxfaM8QhnOgt6y2yoc9lLgEyNL-o 8514
torchtune/models/llama2/_model_utils.py sha256=tz0Dxc-Lf_V2FZTcihLR7s1dT7Trsc0u3ZG3dpmZOuA 902
torchtune/models/llama3/__init__.py sha256=cCoSuQbYsSbxJ6BIt_EdcvV1FpIcqYy_cnLhmb3k-90 599
torchtune/models/llama3/_component_builders.py sha256=NKSYMYrCnPq6BmfkDQ4TU7WsTGzXcrdq9aNjDakSwcE 14554
torchtune/models/llama3/_model_builders.py sha256=GCdCexInevTv6Z_9GlvuSqPvISpQVLBOxl1YuNn6mT4 3672
torchtune/models/llama3/_model_utils.py sha256=tz0Dxc-Lf_V2FZTcihLR7s1dT7Trsc0u3ZG3dpmZOuA 902
torchtune/models/mistral/__init__.py sha256=4HyA_kfuREzx1azO8PbWuAfnxsKNEotKdJeF_Engz30 519
torchtune/models/mistral/_component_builders.py sha256=4iLp7oI5pw3RumHUUyjk3uQQdpSwM0M4vCvI0Sn1Ak8 14328
torchtune/models/mistral/_model_builders.py sha256=xZdQpGM7cuOFb9C5xarh21Qjsi1Gu4OOz52yGEruARM 3460
torchtune/modules/__init__.py sha256=jXWXNX7SbTJbtlZ82sOEo3dj3EEm3VrHW0gl8Diw0TI 936
torchtune/modules/attention.py sha256=2MDfDGNW1R_jvV3P5MUju2ss-ZsFRxRorFriqGdZRTo 9266
torchtune/modules/common_utils.py sha256=YMDfO6e4MOOD8OJVYe0cX7Pi-nfcrYsOVVILQaU2dKw 2059
torchtune/modules/feed_forward.py sha256=ZevFfZOoZ-lcvPXFpbZL04ctNcTVF6BegTjr_v-Tf8Y 1200
torchtune/modules/kv_cache.py sha256=DCM3zuWQIXB_U9jczUdxaxQ687BQHhT7E8WpwuJIWkg 1845
torchtune/modules/lr_schedulers.py sha256=N7n7V1mvX-BNEp6uf-lDrLFPE1RqxR0bwd2HFcwym9s 1982
torchtune/modules/position_embeddings.py sha256=2ABqyXoyLx6CXRvTVN5JmYl0fCVJSoY4feAexXY9BP4 4621
torchtune/modules/rms_norm.py sha256=TbDCFRsgVtso4_PQ8sCt8kfs8APcZa8Ly0D8QtoFTHo 1273
torchtune/modules/transformer.py sha256=RODa2pnyACMUb14XKbC16_L3mX52If4gtBEYCgdK354 7239
torchtune/modules/loss/__init__.py sha256=e_Gk5d8UTcsBatstAjbDAUmwPbD8KvSqom-pFWtEwSM 257
torchtune/modules/loss/dpo.py sha256=EUIEB6HnGD4tAPazenZ9mYS6jylK_AOVDRSCpQBhjLY 4726
torchtune/modules/peft/__init__.py sha256=-iMifYv2Hqko3mLl5oOcYbs_wY4RD0hBFqYELwwiDXo 636
torchtune/modules/peft/lora.py sha256=5aori-GLn7qm1qdq5jQZVdE9_N6GTPunH2PqZhcrYng 5749
torchtune/modules/peft/peft_utils.py sha256=9B61J-QDT1By-euQmAyn28uPCKfQSleuvfPCxn3W5fo 14306
torchtune/modules/tokenizers/__init__.py sha256=Wi0QGrGvXXyZFO41has1-8lpVJrJiRHo_Hhd7PIgSCA 403
torchtune/modules/tokenizers/_sentencepiece.py sha256=WvBYyb4KmlL2teA6VZcZ40lWXTJ3VOYqXgBp3U0Q_DA 7543
torchtune/modules/tokenizers/_tiktoken.py sha256=T5SMeWcMYilEMeHPhzlXxhlEIWTPeODTZUEaxL1hc8Y 12993
torchtune/modules/tokenizers/_utils.py sha256=AfwURdKvhGMkhsZvLZT1oFfw-fY8mP9aFRni9YBg348 2022
torchtune/utils/__init__.py sha256=gIstF1M1jpAzDPWG-hH-1IjhYr7uH8NbCTD3pQvF1CM 2301
torchtune/utils/_compile_utils.py sha256=AfiAIgoJbKRNE9irI6K_PrWe7qlJ48LtDQ7YGuzkgsM 1509
torchtune/utils/_device.py sha256=MZIcGGnIxrqUkPBs7PJam4J5Gx_zQBagV6iUakIjv8I 3446
torchtune/utils/_distributed.py sha256=aVIwWIffq_1sObFVX5UBm1EGExjUIeF5vRIu6XJp-PA 11462
torchtune/utils/_generation.py sha256=6qwK5zQga4Qbw1WgTosiwujjdsytvjfef33xrsoVN8M 5012
torchtune/utils/_profiler.py sha256=WWrPuyoCVGqO4PXssXpCw4ImDVPxVlKP6aqqreRFuyQ 1613
torchtune/utils/_register_nf4_dispatch_ops.py sha256=J2awWNb5lYxxR_QS8n3tDM6X_abPKXXJeETt-a4GLOE 1785
torchtune/utils/argparse.py sha256=EOHT5pEx_jmxJPrEtLZeSb3K9ezGO0Nm_viJZTcx7XY 2622
torchtune/utils/collate.py sha256=eIYIqChJpR7LDWKkq8l7WlCYh4Lu-D5tRD_3Posu7Wg 4845
torchtune/utils/constants.py sha256=E2Fi4xBCc1btiX9ti7X55f-h-6rHKl3DboCm9OoNcnQ 657
torchtune/utils/logging.py sha256=k-qe0VoR30AF6dtkLvby6nzYkLYNT3hEyV-BbKIJQ6s 810
torchtune/utils/memory.py sha256=fXhfVFtOKpqP8yZu5Pgrsytxuh7tSia-kx5Af_FokxA 7480
torchtune/utils/metric_logging.py sha256=hJW1pe-rkmgDRm7xdXTSLfsxHXGrr82L4neTB4N0mNU 11104
torchtune/utils/precision.py sha256=Iq5bVjwSh1mUlq6toZ_iq0vuxu10hWivf233Me89lz0 6399
torchtune/utils/quantization.py sha256=_oyKZKsxszFsZoktYv-YFFLnNC9d6czNY_KawHoteIg 1284
torchtune/utils/seed.py sha256=gCRaoyYNUcLM4Yeq2MDnZhEC5oqyvAQVpg2atdkO77k 3411
torchtune/utils/_checkpointing/__init__.py sha256=FEAB_MOI3fN2XgZ02WQr1uqTzVRHABgd5MhiRoSg7ZA 421
torchtune/utils/_checkpointing/_checkpointer.py sha256=b7r6H22zrFoIxZTi53VqCDe614whyspeopcey46hc_k 26322
torchtune/utils/_checkpointing/_checkpointer_utils.py sha256=6UqmF7gih7TDDKii66klrnmU-yaSvaTtCFIMUf-oYyE 3883
torchtune-0.1.1.dist-info/LICENSE sha256=jveMLW54exA6BUjnO6LP5ovEabWw5vXn22SfExL08qY 1474
torchtune-0.1.1.dist-info/METADATA sha256=HAqhVGBaAh7Yuvw0KF7T2E3T3_4cDwadX5b4XfyKcN0 17565
torchtune-0.1.1.dist-info/WHEEL sha256=GJ7t_kWBFywbagK5eo9IoUwLW6oyOeTKmQ-9iHFVNxQ 92
torchtune-0.1.1.dist-info/entry_points.txt sha256=V6VpdiAZzL1MrHve8PgY5rg975NIJfbdehu4Itk659Y 50
torchtune-0.1.1.dist-info/top_level.txt sha256=e5HCz8F_XvIfggkyjYEGQr1dn9QbRi6Lvny7UV4jIY0 18
torchtune-0.1.1.dist-info/RECORD — —

top_level.txt

recipes
torchtune

entry_points.txt

[console_scripts]
tune = torchtune._cli.tune:main