Wheelodex » Projects » alpaca-eval

alpaca-eval

View on PyPI — Reverse Dependencies (2)

0.6.2 alpaca_eval-0.6.2-py3-none-any.whl

Wheel Details

Project: alpaca-eval
Version: 0.6.2
Filename: alpaca_eval-0.6.2-py3-none-any.whl
Download: [link]
Size: 295695
MD5: 2d32bb074639ec07c368516645cfb8b9
SHA256: 0d4778571b838001ae9f21982778b7980c5092aa35a5f5bf1fb0a616eb8041cc
Uploaded: 2024-04-19 06:28:11 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt · entry_points.txt

METADATA

Metadata-Version: 2.1
Name: alpaca_eval
Version: 0.6.2
Summary: AlpacaEval : An Automatic Evaluator of Instruction-following Models
Author: The Alpaca Team
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Education
Classifier: Intended Audience :: Science/Research
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Requires-Python: >=3.10
Requires-Dist: python-dotenv
Requires-Dist: datasets
Requires-Dist: openai (>=1.5.0)
Requires-Dist: pandas
Requires-Dist: tiktoken (>=0.3.2)
Requires-Dist: fire
Requires-Dist: scipy
Requires-Dist: huggingface-hub
Requires-Dist: patsy
Requires-Dist: scikit-learn
Requires-Dist: accelerate; extra == "all"
Requires-Dist: transformers; extra == "all"
Requires-Dist: bitsandbytes; extra == "all"
Requires-Dist: torch; extra == "all"
Requires-Dist: xformers; extra == "all"
Requires-Dist: peft; extra == "all"
Requires-Dist: optimum; extra == "all"
Requires-Dist: einops; extra == "all"
Requires-Dist: vllm; extra == "all"
Requires-Dist: anthropic (>=0.18); extra == "all"
Requires-Dist: cohere (<5.0.0a0); extra == "all"
Requires-Dist: replicate; extra == "all"
Requires-Dist: boto3 (>=1.28.58); extra == "all"
Requires-Dist: google-generativeai; extra == "all"
Requires-Dist: seaborn; extra == "all"
Requires-Dist: matplotlib; extra == "all"
Requires-Dist: jupyterlab; extra == "all"
Requires-Dist: pre-commit (>=3.2.0); extra == "all"
Requires-Dist: black (>=23.1.0); extra == "all"
Requires-Dist: isort; extra == "all"
Requires-Dist: pytest; extra == "all"
Requires-Dist: pytest-mock; extra == "all"
Requires-Dist: pytest-skip-slow; extra == "all"
Requires-Dist: pytest-env; extra == "all"
Requires-Dist: python-dotenv; extra == "all"
Requires-Dist: seaborn; extra == "analysis"
Requires-Dist: matplotlib; extra == "analysis"
Requires-Dist: jupyterlab; extra == "analysis"
Requires-Dist: anthropic (>=0.18); extra == "api"
Requires-Dist: cohere (<5.0.0a0); extra == "api"
Requires-Dist: replicate; extra == "api"
Requires-Dist: boto3 (>=1.28.58); extra == "api"
Requires-Dist: google-generativeai; extra == "api"
Requires-Dist: pre-commit (>=3.2.0); extra == "dev"
Requires-Dist: black (>=23.1.0); extra == "dev"
Requires-Dist: isort; extra == "dev"
Requires-Dist: pytest; extra == "dev"
Requires-Dist: pytest-mock; extra == "dev"
Requires-Dist: pytest-skip-slow; extra == "dev"
Requires-Dist: pytest-env; extra == "dev"
Requires-Dist: python-dotenv; extra == "dev"
Requires-Dist: accelerate; extra == "local"
Requires-Dist: transformers; extra == "local"
Requires-Dist: bitsandbytes; extra == "local"
Requires-Dist: torch; extra == "local"
Requires-Dist: xformers; extra == "local"
Requires-Dist: peft; extra == "local"
Requires-Dist: optimum; extra == "local"
Requires-Dist: einops; extra == "local"
Requires-Dist: vllm; extra == "local"
Provides-Extra: all
Provides-Extra: analysis
Provides-Extra: api
Provides-Extra: dev
Provides-Extra: local
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 83767 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.43.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
alpaca_eval/__init__.py sha256=b_uELEpNH5pl1NgFK3t7BM4aze44Ksvslzcnj7GHBqE 98
alpaca_eval/analyze.py sha256=I_U1We1l-f_yeupJsloYFDI_YH08AbVrUJ5rAAbIv6U 25709
alpaca_eval/completion_parsers.py sha256=9asWPIH_eJ7d9YoFs5SAACOFeK_JNXvdDjOuyPXj7oc 15013
alpaca_eval/constants.py sha256=goO6ikh_HUxWzY8EQC_iNeDLMywBxcnqh0vVEKQYL6M 7868
alpaca_eval/main.py sha256=xdUNNInHR3OCOYDW0yW6gC1NyIhsPlSy0nh4u5nb_w0 28388
alpaca_eval/plotting.py sha256=c2-iZ06TUOl_tdrsah0Tg7zqmbexNE3i2R9RQZY24p4 30592
alpaca_eval/processors.py sha256=2eAjXd7au8Wt8wGFPNu-nh30RVPvmmMEBYVxGZvkSMI 12890
alpaca_eval/types.py sha256=8HLSXehZRLOJ24xpqN4IFTGQNoG67VznWGkFv-sLjMc 356
alpaca_eval/utils.py sha256=JCHz_Uk7ukL-uFftn4hn9cB4xs1pER8XRuKI_u-ZT2w 22523
alpaca_eval/annotators/__init__.py sha256=1Hwqc8H9AdbPscwqM7NsPkNNSYdajZhv69ZbaXr6blY 54
alpaca_eval/annotators/base.py sha256=sY4mMHf-9MqsksedReo_0g_J8GErbiHfVRuFfLP1yhI 35481
alpaca_eval/annotators/pairwise_evaluator.py sha256=aO7xrZlUgPkx2yF4er3-Qm-MtK6UrwgxEWmHqC2iriA 16739
alpaca_eval/decoders/__init__.py sha256=mkMgPTSg40NZFZ5pp2TthnRilw7psEFvaOwEuFkYmGI 3543
alpaca_eval/decoders/anthropic.py sha256=YMDDM-Em1qqbRFz_2s5O1NNmpAO02J2BxAR4m6ovAlI 6166
alpaca_eval/decoders/bedrock_anthropic.py sha256=szjSVQjkHGhwBwbVJosec2A80jfZE9knwP-6UT9R2OU 4070
alpaca_eval/decoders/cohere.py sha256=t-l4dwOcKqQ4dL7Fm6efIeOqticWePCcNoi20KhVszM 3290
alpaca_eval/decoders/google.py sha256=55G6gojecEgjEUHVi1oR0lkQqoS-usvVoEPwIGsjRPw 5047
alpaca_eval/decoders/huggingface_api.py sha256=eG0OgBD5oNLbnWduBIBTkALTcZds3EPH_Xpk_Xo7auI 3651
alpaca_eval/decoders/huggingface_local.py sha256=3wy2BPGoT7bGFYXX0CTPV1dFAE8BcQQq3pzvo2PL2DA 5441
alpaca_eval/decoders/jinachat.py sha256=62T-cWyCVdLL67m70G9Z0KjywUQZ-LVtcuTxBixbT3k 3120
alpaca_eval/decoders/openai.py sha256=z7dG-1fFae89SunL4GoIDhDgONm3GTjWjHXyoyytUjU 14052
alpaca_eval/decoders/replicate.py sha256=QyNg2-Hq8zlrMHYddHVuLl7Zae6z8sS058Yb08qhAR4 2440
alpaca_eval/decoders/vllm_local.py sha256=oXncBdN-XQGXKNexxPv6Km1hvj8q9OXEgtHDpYnD2Ig 2427
alpaca_eval/evaluators_configs/README.md sha256=--pRV-y7aghLUzgMKJVL2RVQ-GtcYflmRKIuE6CClrw 10038
alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt sha256=Aq3rWPVwfGrujPkN-It0WfXNhnnZW_gW52TbcgUZ87A 1655
alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml sha256=6sg7-nVNio3piY8A7AC9tskIjH6yp14rrlv5YkG5s9w 643
alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt sha256=eEIn5twoMvwIxD0sjqOjCOdSN4AYehqq0vheMLrIX2I 1398
alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml sha256=hp209mapy_M4w6XJY36xt9kjtUO5-vA0guiEXPGSHdY 550
alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt sha256=EkkNcwb83MbTljrgPqDRbAQ8--Ly0Qp_82ditsFYCy4 1206
alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml sha256=qFTHimWyMT_UUWoeqhd9MrP_PltR7882z0DET1NGcaI 1565
alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt sha256=z0us5D-mrHGUS5yiUGWHrXxQlHiiGemKOVCr-dW0Kpg 1204
alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml sha256=Z2cX05ktVZMH1jZh7xJxEy39YTEA90f2zo1Ypwd8Yj0 270
alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml sha256=EO6tHSlkdRzwe1n7gfx6-ZWCMu49NJG5ATL-l_OqOE4 263
alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml sha256=qAM-6iHl5hYYE0Hr5_hJ0oRrmricSN2DkdsFOWMfGaI 263
alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt sha256=9zTCMVT1nvo-SCQMoNHfbyAgvQVvstLML4iuuddbYFQ 905
alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml sha256=IHCZfpO3LhD9AHwZBw_4EbbVwQkQWTFuVk9fsZYT4Vc 1233
alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt sha256=EkkNcwb83MbTljrgPqDRbAQ8--Ly0Qp_82ditsFYCy4 1206
alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml sha256=dsxNnaFg2eZ0FTNjjDVz1CSHvA7OrstiIo1cwcYarOw 1349
alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt sha256=4VRVSzcJpnryc8yHTx3K3aK4WWFpwZzjKB0gBQMVP1o 1650
alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt sha256=Cll_ks6pOhHARQ0yGxFssI4C_umPPJwUxCKv6aX0TRs 5869
alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt sha256=yZ7au5tYkFdFCgOzbl8gfu8VzKKqK2LMOx2-9Oyxw-A 2475
alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt sha256=bQe5XEzsMFMBZXmD21NJwBcf5fhVpnXAm_plQyOonJ4 3721
alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt sha256=VK2beVTCnIavX-q2i0lWZrAA8cLMI0Efa4P4oaoSHxk 3423
alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt sha256=s9T1FPC3yxAexzb0a9SZOzg9444jzrKraYRvNzDSRV0 6849
alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt sha256=q-s4owUh0sIGwIiCfyK0Xs8IyOwLS2eHukRyH47XFpM 6797
alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt sha256=6gfwH7o3IaZqaOW9bqglvn2HmUzGK7IkCEVreIfGKIc 6700
alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml sha256=Dtrmj42kXO3wjeQn5M6rBuDJcS1nIg-eFQs1RC53UuM 6045
alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt sha256=24FS2HDAuG5xEcloqKnUNqdXd_dNbdW4O2_2J3UpA8Y 1016
alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt sha256=IYW9P6ETBgN2F7Ik8qjEollpWTuu92KqORcSF5KuNac 3969
alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt sha256=RyfwflTDqRso7HTUZJs_mV0eSyfC9ybMQdT_5SO0XUg 5932
alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt sha256=cv6mHjAODbT1v9eDjI3ToOFMdKmnuUGiDR2jXaiysnI 5370
alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt sha256=dr3cjE02RI2kyIKHsqOWyMzp4bwvBBguBNHVKx-tH04 7373
alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml sha256=U4sd7U_DNeMAM6Tn5CQM1Jt9nAzzOqypizG7w05Aiww 362
alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt sha256=BL867OYK2tnxjR2T65kEOtFQLQShlhtC7py8TBUZd7o 1048
alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml sha256=qGy-Ry647x_8jTHD8mCu83zdunWkfMD_P7mnKtdUMQc 324
alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml sha256=4exFkwDMahl1UKmPPX7Zl6wTq1jMYWp-eTN62_sVoF4 353
alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml sha256=h3Hu5QQOkfyBDkdnTAR6bV3S0vS5fv5_UIRoVvthjW0 355
alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt sha256=rwQQTdGqV2oCmSi9jQWia4iLAR-7vjJ8Yt26ymh_UKU 1116
alpaca_eval/evaluators_configs/chatgpt/configs.yaml sha256=z5rMMY7ppnDBkmlKAs0AMaeXciM3t-BL122jxVTK3fk 325
alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt sha256=35qjKHOV1dy5PwpQnBY69T1HgR_u_xlx057egWH5Jwk 1197
alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml sha256=u4jeWyEL3YMLmZVSWQHJSF34_UtnwdmS4dX7PHjdhqI 754
alpaca_eval/evaluators_configs/claude/basic_prompt.txt sha256=-eqQpv17cZMhcY4NVY2VcFMzyFzkrYrgtilyzzPQvco 1137
alpaca_eval/evaluators_configs/claude/configs.yaml sha256=kzFUCCwDehO-uOuKp09HyELhVshyl4lxfqvC9I3beGw 367
alpaca_eval/evaluators_configs/claude_2/configs.yaml sha256=niC56E_ruq3dRvk9Y1mzyUndf0S6M_B6WiOZB_OlPjU 368
alpaca_eval/evaluators_configs/claude_3_opus_ranking/configs.yaml sha256=v80QSajOyrXfRJp-z0XoqfvoyqGa0_7jSRYoG_4kGeM 322
alpaca_eval/evaluators_configs/claude_3_opus_ranking/ranking_prompt.txt sha256=qKxRToezBjZ2AKtyEkW-ClZCa5RXuEi6vmd9alIBpCI 1094
alpaca_eval/evaluators_configs/claude_ranking/configs.yaml sha256=fKDNFyy7sfHmlO5kegVfs5RMWxRlCC_-kOiDy5NAXLs 269
alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt sha256=OfHk_hUfoJKhH6gJCDr99pzAZlBsR53Ds02vG-Z2a08 1087
alpaca_eval/evaluators_configs/cohere/configs.yaml sha256=-cNayFIGhr8CZdz0VLyrQIV4GjZkY12NTMQ8rzwtlwQ 310
alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/configs.yaml sha256=Fs-IaDj-67yZeqXI1BBjHqvynNaKkau-1e5D4Gp3Nk0 289
alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/ranking_prompt.txt sha256=z0us5D-mrHGUS5yiUGWHrXxQlHiiGemKOVCr-dW0Kpg 1204
alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml sha256=BVqZa6wvYoZZxjbrVluwe_aoeYDO51P05evCHk5OW64 351
alpaca_eval/evaluators_configs/gpt4/configs.yaml sha256=3qG3NBGx2uHev1Skl9vcXf1-MC3GY8J8UeLEblESS1M 314
alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml sha256=6DXjx8dmBeStOVnMgH1gB_aoRaXt9sRi0ZUi-jXs8S4 328
alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt sha256=64ulGN3dpHwNoP2ui9n_tYRpqcUfyenxFy8AQWhVo9U 1005
alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml sha256=K3qNyVtTDNvMVv-dWutU2d_1C-wr7DTrdoxgio2keAA 528
alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt sha256=fH1B9USktWpO6AwOHAHrdSXah_Qu_KOHpgRa1smwPDM 1266
alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml sha256=U-eT0TV1p0Bkb4eWwmT14jdFR39o8iChe7RIjHQvMH4 565
alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml sha256=joEkqdEM22D1Wdn1zVpm54L85HLsTcSNi_W5LcwmN2U 570
alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml sha256=K40jgDMsiWZL2FFwulAhdxpCF0B-Qqaum4U8pAM66Kw 533
alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt sha256=xBgbTZlelyXRLn_Q2X3OLLE4lV_Pg7pq20gVxCVMDdA 1298
alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml sha256=si-gfneuNq6FVkGuvETwSeREYTx3S2_3eBh6hSCF_EM 452
alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml sha256=HYsADbFZ_2CWMIQH4RlC0t2KX_l3Ro3gTLgOASzvj2M 322
alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml sha256=imCB9vrHIJCu1SIHFlGvMS6SJlv6b_M3uqpEJU4Bpik 317
alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml sha256=AImjL3flznl5i8EHC-OH1CPhnDSToRf0-X9pIZV1QPU 319
alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt sha256=-uJdKpGLh316NJdWlsW3BiTnvlbSVUhZbcJxKmHQRqo 1051
alpaca_eval/evaluators_configs/mistral-large-2402_ranking/configs.yaml sha256=W80F3DPZwlcckaO5W_Fe-6OP2rzptgLFVxaHzx3XP8I 398
alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt sha256=UaRuxfczwfI1keeluht1ZBMnnNRphTIghNkhz-M_Ysk 1054
alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml sha256=4bNuCEpLUwL1xR2eOR0udE81lRhcVK4zl6BVstlwNzs 367
alpaca_eval/evaluators_configs/test/configs.yaml sha256=UWUcEZBhPwkb7UfPV5T_e69rdNQS2rjDv_1ZefIKhnU 329
alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt sha256=lxxVEKg3FjfxeTuJ0QpFVsRSBw4gRXLzUU04xxyUMh0 1017
alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml sha256=yHQT2yNxBOZ7-7RMvjOW7aORc--ZZi-8BghvE0Z5uRs 341
alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml sha256=fzu9hgjDmaPfWVOPLNVF-Zh7fYW-OBxZ0cGtlARoKHc 593
alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml sha256=_VxlbZlZ_9Y7mGyCFqgeg-AB0XztWgje_ByFfOndAz4 556
alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new/configs.yaml sha256=C9hYDBvKKMA418Ra_PivjI1Bj_Qn5iTfiL_JD1eiVY8 553
alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv sha256=zx9Wcaz6POqO5TE4oEL7M2kXCQIOvG23KPi_HPu12l8 9807
alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv sha256=4RR_bcm4i0RvvHXXnaTkORPSjG5PYXLclohuljhK2Ko 898
alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv sha256=6J5OHNr-6iwR-7JPdnUQUPzf0Fu_WWIqApYqjC9lUAs 2402
alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv sha256=L8DQ_8Xm02hC0Gq6b-6kQtfxqqRoUC7VseR012xx6hk 351
alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv sha256=67lJL1ZQ7bDujwu2qwSR4Tc9vfm9J4h8m6nE-hd3VNU 1307
alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv sha256=osOTquFlLog6des8oqmDjHJs6cO1U4XwdIAV8Pv3Z10 1027
alpaca_eval/leaderboards/data_AlpacaEval_2/claude_3_opus_ranking_leaderboard.csv sha256=GlDVq0Zu-tXot2qGJbkpQ85ScdR3ayJEAcDONgsdzsg 766
alpaca_eval/leaderboards/data_AlpacaEval_2/mistral-large-2402_ranking_leaderboard.csv sha256=gNpnu59nZO3tacQxUDETFaINcH9xuIplXedDpjKL8KQ 767
alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv sha256=moyqptcq7IK-0doXL21_G0wmV39BT-U4UcIVIHmQGkA 17837
alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv sha256=yeXLKhWymdiocWPvJ_8tRDGrB1gid88Y4ecPuE4KRS0 5773
alpaca_eval/metrics/__init__.py sha256=g4_i-0Ytrl-luO5gwAUhHpRn0JRS5gFWbkw8Cle8890 201
alpaca_eval/metrics/glm_winrate.py sha256=Q17pKBZAnz0jEF1rHdQJux9UM2oCGpepueVTPGv3L38 15665
alpaca_eval/metrics/helpers.py sha256=QFsM1nh5YPgVjEvGPAvxzxGgOKiuabibqpW36oPFCpA 7140
alpaca_eval/metrics/winrate.py sha256=TzWY0eNe8KednhGdDCeF-NdRPG30ACxH7K2lbkZLajc 1189
alpaca_eval/models_configs/Conifer-7B-DPO/configs.yaml sha256=wohPWAlMUtl5dTGTO_05BhKy2l33PwxMDeMPh7qJy8o 376
alpaca_eval/models_configs/Conifer-7B-DPO/prompt.txt sha256=WsTBbeQYSdN684jIt7iIZItZQ8WqRSi1RO-cm00Q7XQ 50
alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/configs.yaml sha256=3OFDvS2a5Frq5L2e1us36FkBa9dBHMMqB4B5_CPIDnQ 682
alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/prompt.txt sha256=SRlDv0pFl6WGz5Ad_C2E8iJo1_2kkDLmvlyekhokSXE 36
alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/configs.yaml sha256=IShysWJC_pA-e_GEmaR9vkLWuzDYUZgB8yMA99JFq8o 654
alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/prompt.txt sha256=vnQBS89qcthUFp5CacV-PZ4WsKYrNo8QeUtXU_glgbs 41
alpaca_eval/models_configs/Ein-70B-v0.1/configs.yaml sha256=_VPIEP_lW9R36tMRGb9HHKwzZgfhmrqIo2rhH46CFsA 772
alpaca_eval/models_configs/Ein-70B-v0.1/prompt.txt sha256=6BYR5tJbonmv-m6POePzAF01STolAe12KVW4E-cKb0s 28
alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml sha256=b5ImyR-o6MwXDg7B9n8b4G2EUJruunuK0QOKrppoY8U 470
alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt sha256=B1Y_o1VTLPfpjt_p-_tnBm7oLFN1us0mQEibQwaimIs 344
alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct/configs.yaml sha256=sO8U9M_25EUODgqyw3Hv_-GHiX5ka9mxr33m8qsgXPo 452
alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct/configs.yaml sha256=Z2rMKifolNFaodh5tmfXtZ37Zya2a1CectSku6tXZ1I 448
alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml sha256=vtN7KkihgJvQXlTHVL1L2y7eeMkhgit_cDmnfQH9bRo 483
alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/configs.yaml sha256=3n84ZPvzeRAZjKV0Z8yzljcoizcgQZGE4-SyxbztrAo 434
alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/prompt.txt sha256=6BYR5tJbonmv-m6POePzAF01STolAe12KVW4E-cKb0s 28
alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1/configs.yaml sha256=bw2d3S4adB-414iGqcucG1i8FR9hvee6H0DOFBbqpHo 460
alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml sha256=PrL2fqRcXJxnCEJiSp7lmFjwFi5Ee8LBNsvKwakZVSE 491
alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt sha256=vnQBS89qcthUFp5CacV-PZ4WsKYrNo8QeUtXU_glgbs 41
alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/configs.yaml sha256=bwUylgKa6Ai9svJ_WEQe1l4-2QXjiUpEJw3_BumBCmA 488
alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/togetherai_prompt_concise.txt sha256=TsjyeFWXFeDLyZjJQgJC5DMdOLFrw73XAPVJ7Ng1nAs 143
alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/configs.yaml sha256=wj74j2wisIBjdaRRxu9OiA7xmDoIZGPw-fIEPogalAg 488
alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/togetherai_prompt_verbose.txt sha256=IbEkMM-iCIqNrynY_yzOtpgEEGvBkU21si21xDma4UM 81
alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/configs.yaml sha256=okPPP8uZmiCxu2SCYM3ooppNZ9faRCT53kAUoe83Mr4 419
alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/prompt.txt sha256=tCLvnQQuKbHklEkpx0uVVAOEj6_8nqBJb-dVCii1EP0 696
alpaca_eval/models_configs/Nanbeige2-8B-Chat/configs.yaml sha256=Gtp7JwzbbuPNSmsMfRcHn3YF_7v7JY21KIGyhQKlq28 382
alpaca_eval/models_configs/Nanbeige2-8B-Chat/prompt.txt sha256=XHF3y3wv1mK5E52-_9iI-t1uQGD9N_hTNuQdXrXm6FM 671
alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/configs.yaml sha256=_FFTD7r7RiCEHOA62WRMhOWhZQeQhVxR9vIAJsRzizs 493
alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/togetherai_prompt.txt sha256=vnQBS89qcthUFp5CacV-PZ4WsKYrNo8QeUtXU_glgbs 41
alpaca_eval/models_configs/Qwen-14B-Chat/configs.yaml sha256=UjJvogANe_tUngYI4wlkkV9paJLpSyADaD5yIWFP3vA 467
alpaca_eval/models_configs/Qwen-14B-Chat/prompt.txt sha256=E8xe9wyYrLGzPaTco7iTaa3sJcJ3U4k5lN-p_nB4Dns 63
alpaca_eval/models_configs/Qwen1.5-72B-Chat/configs.yaml sha256=9o1KuMvIGpN6RZj5bxXA7Y_YVGcXJP5wYdfH4De9-DA 448
alpaca_eval/models_configs/Qwen1.5-72B-Chat/prompt.txt sha256=r7l3eAAI7XpdcoYlTN2O9LMp_a2sIGqDpzeb6pcqrcM 99
alpaca_eval/models_configs/Samba-CoE-v0.1/configs.yaml sha256=0YJGaSI9FO0-4v0CPx4exOeGNM7uIgBv8-L7S62qArc 361
alpaca_eval/models_configs/Samba-CoE-v0.1/prompt.txt sha256=kI8MC7ikclXO-9TjdVWtsIx0adk9Zk__75fGwe2idrU 428
alpaca_eval/models_configs/Samba-CoE-v0.2/configs.yaml sha256=oDudS4QVcjuMMJRNOv81qN7EJZ-jKA9xsQJ8pv_TiCk 361
alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16/configs.yaml sha256=wNQICaf3xY7ltoIwtUz6UlU72v-TR-w1l5qeAmA_QuA 385
alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/configs.yaml sha256=8Xis9IomPzY7j57VJ3D89pF17Ja6o9gwOzvmT8DouSw 728
alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/prompt.txt sha256=La57oXsb44fGIaCXqUmtqYfrhzIknQ6MkJg2PLq4G0I 31
alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/configs.yaml sha256=I7gFlkw8rKFYNoAS-mL9QwiVwDsMdU5CS8SOT2lmMto 833
alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/prompt.txt sha256=La57oXsb44fGIaCXqUmtqYfrhzIknQ6MkJg2PLq4G0I 31
alpaca_eval/models_configs/Starling-LM-7B-alpha/configs.yaml sha256=BjAas0I9IYJ_GPqiTXYEc3ArdnYvzHnA_feOKqQh4zM 435
alpaca_eval/models_configs/Starling-LM-7B-alpha/prompt.txt sha256=iBbalHHywhjz86p6mQiRyAXzWCIJVsS0PpIznE42g04 70
alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1/configs.yaml sha256=UUc7jjXmvz256CnMOS6Md2fNy5Fge2FrYXsWhBLxBtg 406
alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/configs.yaml sha256=Dud09CZHmAIshcpDBj2zJ9t1e2qClpi59osFpmI4UsQ 407
alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/prompt.txt sha256=6BYR5tJbonmv-m6POePzAF01STolAe12KVW4E-cKb0s 28
alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/configs.yaml sha256=nhUNhYG0JmfIWqCBptoo0KvuH6iATJiWEweJ5-v8g-Q 403
alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/prompt.txt sha256=JlUi3JsCiHISbsxcmAKY0YV81uoUOgs8rNsducw6ERc 558
alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml sha256=AQXfDz-8Y6qu7kXbvfBN2AjdoTOT7W-rWFfv3UbaX_8 432
alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt sha256=E8xe9wyYrLGzPaTco7iTaa3sJcJ3U4k5lN-p_nB4Dns 63
alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml sha256=fcmRwvK7rKURpJ7xVjZWZQN_CZquEaZcorg1IFHh5i8 405
alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt sha256=gVMoe5Vdb0aB9c1wFPiGE75e8k5nVROSvconwpD0Igo 41
alpaca_eval/models_configs/airoboros-33b/configs.yaml sha256=RojwP5mDycbxowDd_vDHCOMOKa8t_Lrv34J_bo1ywuM 415
alpaca_eval/models_configs/airoboros-33b/prompt.txt sha256=7Len5nRwR3rPmHWgtiRZ5pGavle5XaLP2t5IwRZw2yA 171
alpaca_eval/models_configs/airoboros-65b/configs.yaml sha256=wCbPdu0yWeBYnvASjWgtcbm5gpZF5XU0hM54W5su1UQ 415
alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/config.yaml sha256=KmYtANEenPZpH4uwGezy6RPfA7FS82cWX4I-WL871Y4 435
alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/configs.yaml sha256=KmYtANEenPZpH4uwGezy6RPfA7FS82cWX4I-WL871Y4 435
alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/prompt.txt sha256=RDX9mWKBAkd70N77DjoR7hcmQeQSfmYu7nYxYTBIt_E 98
alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/config.yaml sha256=rskjNaTKfAMiOZo8b73iJt7zGi3iv7utV6MdJqsYvEI 426
alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/configs.yaml sha256=rskjNaTKfAMiOZo8b73iJt7zGi3iv7utV6MdJqsYvEI 426
alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/prompt.txt sha256=RDX9mWKBAkd70N77DjoR7hcmQeQSfmYu7nYxYTBIt_E 98
alpaca_eval/models_configs/alpaca-7b/configs.yaml sha256=k2YoxKEb9zXxN7xSGn2GZmul8JSZprU2eLwiUnYXHmE 382
alpaca_eval/models_configs/alpaca-7b/prompt.txt sha256=NRAbw20QmXx9km2PIffRc67GUj86V9eIIblEqJklzco 152
alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml sha256=pXOP1GFnCp519_4R7rxFkEt-4HA3teJ2ER-5vlTi_aI 383
alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt sha256=NRAbw20QmXx9km2PIffRc67GUj86V9eIIblEqJklzco 152
alpaca_eval/models_configs/alpaca-7b_concise/configs.yaml sha256=KqlevP5CrR0MA7h53nGvXYLOcuBBf0cnu-UM39b2iEY 478
alpaca_eval/models_configs/alpaca-7b_verbose/configs.yaml sha256=vwhQlC6sbmSxCYBmRW-JTgdT89-it46r0m90h7pcl1Q 478
alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml sha256=JEOapM_OWv44Fyxm-wdBb6C1cji4cBwpl_UtuZKn_4U 433
alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml sha256=wy5ibYQ4_BVIv0LdE63g5jc_5pIWWLSRQfsQrpD1A2o 456
alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml sha256=t0vri-V1HE_3GQT_K0O2N0zwGumeB2C_DjwXXYHsdkY 417
alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt sha256=hHA7taxoeGgAGyIov2caoGgST53HR8WVmsffifuxL-k 29
alpaca_eval/models_configs/baize-v2-13b/configs.yaml sha256=TekFFvDsDLkCPhWKgCCEU7GyPW4xQKeq6bZJCt7QmD8 394
alpaca_eval/models_configs/baize-v2-13b/prompt.txt sha256=49cS93u95lriRC1ArUlWyqrkbNyDWqUiPi1FFI64udc 109
alpaca_eval/models_configs/baize-v2-7b/configs.yaml sha256=6OZB3JFwJr35Yni-ayydjuAKtdTypfI14cPyLDrdz64 390
alpaca_eval/models_configs/bedrock_claude/configs.yaml sha256=Z4OXl4e9tvdUN9h7FybUzA5DB3lYF-ex19nQkxy-koY 227
alpaca_eval/models_configs/bedrock_claude_2/configs.yaml sha256=B7r1UXoZcEPEs10Xl21x5ZP6MTbxMDDe9gNxNNog8mU 231
alpaca_eval/models_configs/causallm-14b/configs.yaml sha256=wqQhK11V1MgRJmWcQK7BJ9Rmm0JfwvffRSl3GppO0DU 392
alpaca_eval/models_configs/causallm-14b/prompt.txt sha256=lB3CRjiLrKGYFK_6mReCIHjCvqNVQrdw3Y6tLvlcAi8 123
alpaca_eval/models_configs/chatglm2-6b/configs.yaml sha256=uTLieoMKeYWgqMtZIXwoM3HYjWzroPV38D9IWwEjjhM 373
alpaca_eval/models_configs/chatglm2-6b/prompt.txt sha256=lvZkvjA8TZb9VpaJOlu0hYMTBVl_4MyTDUUGKVyqokY 43
alpaca_eval/models_configs/claude/configs.yaml sha256=3EdnA1Acpt9E5Ztvbzk4E1ePdeTvUuJcfFvVYVFrm-c 194
alpaca_eval/models_configs/claude/prompt.txt sha256=PvC8O9ekfFdmoh0MAWzKtEJyLz7rmqu_BC50YGd1lyc 34
alpaca_eval/models_configs/claude-2/configs.yaml sha256=DvqKBkAOXWJTY8Cv8OTmeMTVdTzPugZ1LrQKKHuDdVM 197
alpaca_eval/models_configs/claude-2.1/configs.yaml sha256=7LETdoGV-HU1wlJdGsjzx4CeBP0COYrHEyCyxFyDxj4 203
alpaca_eval/models_configs/claude-2.1_concise/configs.yaml sha256=vZkudeovLQJriM3rm3Z2sV_Xxd7XJy4V_wnbLpiMMgs 241
alpaca_eval/models_configs/claude-2.1_concise/prompt_concise.txt sha256=7QSdEYREcBdwzgdmvum-W0OC4tIIhlUOAOBpoGISfGg 136
alpaca_eval/models_configs/claude-2.1_verbose/configs.yaml sha256=2_asZrpaUQORrHPiQEfj0tCRdzJVWv5NrQLJnhkYdHU 241
alpaca_eval/models_configs/claude-2.1_verbose/prompt_verbose.txt sha256=ytOQDgaGUhBCldUPDgI8SPoNWMxBL36lsxCqFb2eUVY 74
alpaca_eval/models_configs/claude-3-opus-20240229/configs.yaml sha256=zTfLmg5XOSj_wmC3Er8o2n1pTjrY3hKTK5xG0YIpb2Q 358
alpaca_eval/models_configs/claude-3-sonnet-20240229/configs.yaml sha256=F4ETT9B15UasXv9gJVro2TrOfQfq9RrJg89s47TeKcg 363
alpaca_eval/models_configs/claude-3-sonnet-20240229/prompt_chatml.txt sha256=vnQBS89qcthUFp5CacV-PZ4WsKYrNo8QeUtXU_glgbs 41
alpaca_eval/models_configs/claude-instant-1.2/configs.yaml sha256=1sEsXpNBfVMUXAFlu4GGSQo6HBSa0Nxp6ivPRyvQBOY 227
alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml sha256=psEyY4CRgjXC2X0IxGj063XI_BSFGb9CHBDgLyZj0H8 407
alpaca_eval/models_configs/cohere/configs.yaml sha256=DGSOfysfddMCsX1nc8OnfLQ7iX1bFMjva9Ne-qv7zRw 234
alpaca_eval/models_configs/cohere/prompt.txt sha256=9kTp7EdLbsJld0AetmPMdAyzo5UgyCYsuuEA30rI5JI 13
alpaca_eval/models_configs/cut-13b/configs.yaml sha256=TmoejdUqememZeVrgkKEYFO8K4vEiP-O6wbxg18cUNE 355
alpaca_eval/models_configs/cut-13b/prompt.txt sha256=NRAbw20QmXx9km2PIffRc67GUj86V9eIIblEqJklzco 152
alpaca_eval/models_configs/dbrx-instruct/configs.yaml sha256=zofJutMBPeNoc47kyy2fy4roiDS4OC5r4r95Gm_cCnA 416
alpaca_eval/models_configs/deepseek-llm-67b-chat/configs.yaml sha256=Mq5vd6MMxfRIHCI5MnRCeV7BOTswmfJlNoXw8lEr6mo 435
alpaca_eval/models_configs/deepseek-llm-67b-chat/prompt.txt sha256=2nWlVa3ftKkRHnTe93igfgFPlVuuzGx7V8Ln6ueSHfk 32
alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml sha256=pi8BCFLwOHU7Jwji9zuc1934cyw9Ke3NhQ8InSV4uRg 368
alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b/configs.yaml sha256=nXRga5oOWpPu_gIu3RKIV58-Zo9B3HmIfKgPj8HBNWk 483
alpaca_eval/models_configs/evo-7b/configs.yaml sha256=lNLUo1IWgr8W5cQSWD8lr8i66QWO-G8Psy0ieQoruKM 312
alpaca_eval/models_configs/evo-v2-7b/configs.yaml sha256=EcyeoTXWt2OG3vDVCr1ppcopclX4YIKCPX5ryMtp12g 350
alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml sha256=A1-g5lZKRaMv8sjy4Fa72HwmwqbfatUQr6ctc0OnvRM 435
alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml sha256=DX5sdQm5ZA0V9WLvzX4jpnvzrzDXTkrvVUWmGCfnu5k 761
alpaca_eval/models_configs/gemini-pro/configs.yaml sha256=JtL_GpwTidpPcS5_n5fVMBBuzUQbLSYnVOQB44pbjic 223
alpaca_eval/models_configs/gemini-pro/prompt.txt sha256=9kTp7EdLbsJld0AetmPMdAyzo5UgyCYsuuEA30rI5JI 13
alpaca_eval/models_configs/gemma-2b-it/configs.yaml sha256=EjOQqjBzK9LCIDEnZQqrIgD3ZpbXBw5E_NqPqXa08zo 442
alpaca_eval/models_configs/gemma-7b-it/configs.yaml sha256=qVZpDQleHm3j7a5w0rISKsdk-sjbv_tcqUKJcTO0XqA 442
alpaca_eval/models_configs/gpt-3.5-turbo-0301/configs.yaml sha256=_SHUwLud_etxDRUUh9MeVlaCbZb2xe93mhRSTpnXbrc 221
alpaca_eval/models_configs/gpt-3.5-turbo-0613/configs.yaml sha256=2gDLJKIjKEayQ7yQqj0OgePiRSSP0BE6oHD3C7qYVCc 221
alpaca_eval/models_configs/gpt-3.5-turbo-1106/configs.yaml sha256=V4jhWgwJiu2URGb3Vwuaxa5r8MgZZ66vB4i12i3Ppi0 221
alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise/configs.yaml sha256=XtlgOb8Gjg9P2nC1AQ8dqumCFwdAFuGwXZMFJVnLhrE 265
alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose/configs.yaml sha256=tESbW1te9Pfr4icy92isZ8bB2R97-9l-ijki1imAws4 265
alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613/configs.yaml sha256=DF2G0iFGuq4gf0h8dWCDPoQScWM0es1cYhFM_dvVc5k 229
alpaca_eval/models_configs/gpt-4-0125-preview/configs.yaml sha256=DQAzZXvLByZtlt2uV6c1UTqlKyqySBHfDI9XN8VPGi8 234
alpaca_eval/models_configs/gpt-4-turbo-2024-04-09/configs.yaml sha256=s8kIvACCB1E-yUQa0CLdmRDdGZLeCkR6HSsQojaNb70 240
alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml sha256=0csU48ilVSFI7rFVPX4pnGEo0BsXf9F_aSOdTZ0MjWo 218
alpaca_eval/models_configs/gpt4/chatml_prompt.txt sha256=arTl2x29spY85yctvxTqcDP3mQfjubCeiTKw-cu1Gc0 100
alpaca_eval/models_configs/gpt4/configs.yaml sha256=yGWFWZBvDQEaZM-4YZ7xXcWFb5RNMyDVyd18dIoxD4Q 178
alpaca_eval/models_configs/gpt4_0314/configs.yaml sha256=9-dN4H6-WBU2Qqii7HATvBwjJWCLAtGNakvIaNaVBWM 196
alpaca_eval/models_configs/gpt4_0613/configs.yaml sha256=HS87_3bp0R-cRvkFfKMfKcxOKIIrW-qT2dNA-J4REPs 196
alpaca_eval/models_configs/gpt4_0613_concise/configs.yaml sha256=9yhpQMcEC8BmIlLODmU29Vemv03Nj9Q7hn_kndUHkkU 240
alpaca_eval/models_configs/gpt4_0613_verbose/configs.yaml sha256=BO_KnO68RA7gFVH9DhnJGSiu1rvS5Zvov6jtb_LMeuA 240
alpaca_eval/models_configs/gpt4_1106_preview/chatml_prompt.txt sha256=arTl2x29spY85yctvxTqcDP3mQfjubCeiTKw-cu1Gc0 100
alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml sha256=RwteKdtEjT-o3wNBj9bvMf7EqUdPPQ9WUHcVWdU7U6I 233
alpaca_eval/models_configs/gpt4_1106_preview_concise/chatml_prompt_concise.txt sha256=9rz5pmAu41lUOS93wx6Uf-tm2H2_PUtLP3QiJxOLSGI 202
alpaca_eval/models_configs/gpt4_1106_preview_concise/configs.yaml sha256=HHrbddjJzkaqU6b9aREkSxWbZ7NnPbzndphnHrGQreM 259
alpaca_eval/models_configs/gpt4_1106_preview_verbose/chatml_prompt_verbose.txt sha256=c5-gdgtMpnXNfFdt_blH08epVY4-LK-4ECKKlL7Ik84 147
alpaca_eval/models_configs/gpt4_1106_preview_verbose/configs.yaml sha256=jKz9SEthGDhiwh_6lKa1mQzakfTSNRCIftJP9SkoATo 259
alpaca_eval/models_configs/gpt4_gamed/configs.yaml sha256=sCdRaKaRoKSyRSF7CPmcm8VjkyIh389NtqpOx7Dd5FM 277
alpaca_eval/models_configs/guanaco-13b/configs.yaml sha256=4cOqkCd5WObgxDxrylD7I7xB3-C8vvN2s9lJOa2tjA4 430
alpaca_eval/models_configs/guanaco-33b/configs.yaml sha256=HiuZonrB3iXe3jpQUQkSKeldhBq8PTAkXlw7W_SxMuU 430
alpaca_eval/models_configs/guanaco-33b-api/configs.yaml sha256=IguBvUe1E_Nkq1npVGQT6iepauvOTfBg02cm4zUMxsE 257
alpaca_eval/models_configs/guanaco-65b/configs.yaml sha256=pMLykSK0hp6UoGM3w0YLtm9ofNUMgF4_ICbjqy2XbgU 430
alpaca_eval/models_configs/guanaco-7b/configs.yaml sha256=vxPzRaJaTkMwHxJiuFlnfiIJBcML3RH-rBvofgxzhPg 425
alpaca_eval/models_configs/guanaco-7b/prompt.txt sha256=APH_lUF2II27aqsmv9WPrqqJhUZrvHYJybO-XSXhp0k 195
alpaca_eval/models_configs/humpback-llama-65b/configs.yaml sha256=ciRQhEWB_o9Zg-Qp2kqdgQNa9tdTfiBRBsZ7BeeH70E 288
alpaca_eval/models_configs/humpback-llama-65b/prompt.txt sha256=6BYR5tJbonmv-m6POePzAF01STolAe12KVW4E-cKb0s 28
alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml sha256=NUEI3wB9jh-Xluw_3-vvTTdWZwFA3jF-bpIWqW4aRss 290
alpaca_eval/models_configs/internlm2-chat-20b-ppo/configs.yaml sha256=ome2oFydypKmPWJraaJnHsRLA5P8TDj_6pZ5XUErF2A 501
alpaca_eval/models_configs/internlm2-chat-20b-ppo/prompt.txt sha256=E8xe9wyYrLGzPaTco7iTaa3sJcJ3U4k5lN-p_nB4Dns 63
alpaca_eval/models_configs/jina-chat/configs.yaml sha256=lbLyWmJm9sIOS-OnUStw_XgIgcR6hcrbXii7KE2yx-s 145
alpaca_eval/models_configs/jina-chat/prompt.txt sha256=7L82PT6HE-QIY0kspD9YYFJG0VAP7ZGbFjK1XBP24Ns 404
alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml sha256=0ZLLZfAf_lMxsT4vX5tZ6VAXxGo4doo0fBKfct4_hTI 391
alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml sha256=dTNs18MGjMnVFIKNGlB_dtEpteqFjGbhq43bg9LvWtU 374
alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt sha256=6BYR5tJbonmv-m6POePzAF01STolAe12KVW4E-cKb0s 28
alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml sha256=0R6EYKLXJMQd074Fbm5ifJImdv4STo-V7C0FcRmtBo4 388
alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt sha256=JlUi3JsCiHISbsxcmAKY0YV81uoUOgs8rNsducw6ERc 558
alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml sha256=q27-4rzmc46M38_JiXIc1lewk2i5hS3enzxnoiBThTs 434
alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt sha256=NRAbw20QmXx9km2PIffRc67GUj86V9eIIblEqJklzco 152
alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml sha256=DyGaC-GazY4QBCK_cjpxj7flOuQOeWEkSGz_meD-CeU 390
alpaca_eval/models_configs/minichat-3b/configs.yaml sha256=bl1e8_zoRaaRHBjW8aLLDuceqd59ydI7FmCAwE9URm4 374
alpaca_eval/models_configs/minichat-3b/prompt.txt sha256=Bt6bzPgWMi7mfMKu8AYdvc9oLSyyHY7dmBJnraxPV3A 285
alpaca_eval/models_configs/minotaur-13b/configs.yaml sha256=MEHthFt8AloykOkY0ppsX2ibhD6njYR_TAawJSKZqxs 429
alpaca_eval/models_configs/minotaur-13b/prompt.txt sha256=tqN6XNRzD9DhM5wEafFYCCI2mB1_6mEENWpCOUydprM 186
alpaca_eval/models_configs/mistral-large-2402/configs.yaml sha256=utfjndit2rhhi-46eNJONSrPpmcfd37zkiUElKBjpxg 439
alpaca_eval/models_configs/mistral-medium/basic_chatml_prompt.txt sha256=vnQBS89qcthUFp5CacV-PZ4WsKYrNo8QeUtXU_glgbs 41
alpaca_eval/models_configs/mistral-medium/configs.yaml sha256=Mg6bXcmjMxEriKUVm93xpOBVJ3eNcaK2_DpIkTM1tY4 424
alpaca_eval/models_configs/mistral-orpo-beta/configs.yaml sha256=Y7_cmNnUNqjbQfS-ejEtad4n866W7Su0RAscXZ-LcfY 394
alpaca_eval/models_configs/mistral-orpo-beta/prompt.txt sha256=TdvP1M4EoFF-LD1LRvsCwVZ9byIzgLb0-9phj37R51c 41
alpaca_eval/models_configs/nous-hermes-13b/configs.yaml sha256=pn7O29arABiT8TFUTthU8oO5Mh9nDg0r-eQZSXkPw1A 407
alpaca_eval/models_configs/nous-hermes-13b/prompt.txt sha256=xo9TqyfhIAGjoxRYOMyFxsIwZ1k2fq9lrnnjJ0LQRmk 185
alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml sha256=RpVH_q0JKJne6E0GHsm1er1QFPaICkIOLzLfdaBkt4M 449
alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml sha256=EihXA4LnHO656XnYZoptUyjLdD9dN45yI3mtIddV8aY 436
alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt sha256=e4vHUbrNTKpS68p8sK0gBd2KpVRT9HFotvL8DCVQegk 42
alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml sha256=oC7UcXtTwldBbSA7-ZpUhRjaToCBTJCOulfd5DXIhcg 458
alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt sha256=uMUj-Kfo1PWb8Fj9PHwWb2ESSUL-_lxr-YbL5Z01eCA 51
alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml sha256=J--PumtizRpe5b0bQBGMbMzO08ToTGqjAZfTz4YYrU8 470
alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt sha256=v0q2Ka9DkQII-beWonpSgvM1lIctSkareZTThmPEEfI 747
alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml sha256=ctgcMv0o8Lx9un2JrZvYz1fovXwyv7RGSGyfcm4YHE4 465
alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt sha256=v0q2Ka9DkQII-beWonpSgvM1lIctSkareZTThmPEEfI 747
alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml sha256=WOucZir-7-Mgtj4aCIHezbVV5zhzJxTTws4dP3WiXD4 475
alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt sha256=6BmVISSrKbMKLYPVcnFDScyUZrmd9yc5VvyimxZGBP0 736
alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml sha256=-qSFJs0-uaUAjkR7rYvW2AH6yMHQ0Be6wsAvNJ-3F5w 465
alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt sha256=v0q2Ka9DkQII-beWonpSgvM1lIctSkareZTThmPEEfI 747
alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml sha256=ol9KvTFJeQv5qJ3bsmlwcDgk-iTgQNTU_eIda-REzSU 679
alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt sha256=eZWEsMfoE2DI8CDTEocBnKmSw-4cj52YJ1NuUXN8SCA 601
alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml sha256=ByUPaplcjQr1avCcTq5vAzLwIsP2sFH1oQcS59PZi0s 679
alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt sha256=eZWEsMfoE2DI8CDTEocBnKmSw-4cj52YJ1NuUXN8SCA 601
alpaca_eval/models_configs/openchat-13b/configs.yaml sha256=EcTbsNKyLOs2q0DEKaxFyG8UwbIdnpz0JU4g28NczI8 374
alpaca_eval/models_configs/openchat-13b/prompt.txt sha256=vnQBS89qcthUFp5CacV-PZ4WsKYrNo8QeUtXU_glgbs 41
alpaca_eval/models_configs/openchat-v2-13b/configs.yaml sha256=tNPLMnlHrmzCyQ4_D3zYc9WIh90XFho9ujDVQl4WqKo 403
alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml sha256=qZ8qt-JRKgprfW9Ud8IgfHuxIs7P6_M9xHTsU4R128k 407
alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml sha256=2vLNXksRwzt_uEiM17elL0s-8OLK5GuYNOFobzCNZd8 416
alpaca_eval/models_configs/openchat8192-13b/configs.yaml sha256=Ahc5nmsaVI5vobbgUNGEB773F1M4k16nPIlOj2QYH74 387
alpaca_eval/models_configs/opencoderplus-15b/configs.yaml sha256=WUfx-DUulUjpdcKiLl-ih1pOqMYAUk-e6va-__NXwMM 389
alpaca_eval/models_configs/pairrm-Yi-34B-Chat/configs.yaml sha256=UBuG0I4O24AwcF29iLBmn8iTLOw6m9WhB_Wtey-qBEw 553
alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml sha256=AVC4Hn4jtruN6eW7oFbapCiOPZnL-Nmky-ChYGjnqBk 531
alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml sha256=z5-WT7mEkvM8tHgro3V2jgJNJjA7Akvv2KghqtU0Y4g 586
alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt sha256=3tOd2J19_58LQPWdTrl3D2A-GlvQPHLs9J2bZz9tSNQ 37
alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml sha256=NHywWpLwJWZB61U8Isvkyf0wOFLuCENa1EdRgxYf9ZM 516
alpaca_eval/models_configs/phi-2/configs.yaml sha256=pAZflc2E2qDMlhFCdNrNJs4Ml2RBpNAdgLZWEpg5KLE 415
alpaca_eval/models_configs/phi-2/prompt.txt sha256=YxP2ZOna53_b5aNnPBsfHeE5wWEK1ZdGq--9e5pjJDk 31
alpaca_eval/models_configs/phi-2-dpo/configs.yaml sha256=-RBFSshc-9tJrxk3S_ZvgsSeY9jkOeWMiXJvAuoL_k4 400
alpaca_eval/models_configs/phi-2-dpo/prompt.txt sha256=f8Prz_H_9mcL5siIFjUYW296Ndy2dj-dfTuq-7QYFu4 40
alpaca_eval/models_configs/phi-2-sft/configs.yaml sha256=yrXeRMGJvoHNRipUeLD7of06xI-d5H03gBKibgtFxFs 400
alpaca_eval/models_configs/phi-2-sft/prompt.txt sha256=f8Prz_H_9mcL5siIFjUYW296Ndy2dj-dfTuq-7QYFu4 40
alpaca_eval/models_configs/platolm-7b/configs.yaml sha256=-k4Nxe4QkuXc-fKoZsJbUWXEkn8yWs-VwJSXo9Nhjck 397
alpaca_eval/models_configs/platolm-7b/prompt.txt sha256=WXs8FSJnz_muStpA9uB5SnqKaJILFV-PfFR24AZ9K9c 197
alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml sha256=Sq2NY9tPJnS1kckOTVNoUgcG9FQwauNQrJp_FeNR69o 438
alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml sha256=XdKAajgP45JJEHde92D_7RhMKtIHFjy2DXTRLpERTx8 409
alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml sha256=mnQgP1d0EYViOjtcWj6DB8Pin6ShpqoW_T-W3Izcz50 409
alpaca_eval/models_configs/text_davinci_001/configs.yaml sha256=fK3G_pxpeHbSD3WE0knIGGZgdxBo3k12EhYZysexXkQ 211
alpaca_eval/models_configs/text_davinci_003/configs.yaml sha256=nNY1SiewhsPBSHliZkRP91609s2sGHUsyOnk5CRv_Mc 211
alpaca_eval/models_configs/text_davinci_003/prompt.txt sha256=ItEGOBsJHb4frai68-HdKRxNQqTsFLwpuxkpIlAKBgU 34
alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml sha256=RnG8Ra4wu8MHnGDYiZI3WqN0NEQk3sGWUNKssdMiK28 418
alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml sha256=JLe6_MlPzlk3DgYC1L0fGKRoYiACOCvTz3y4owYuXTg 473
alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt sha256=3tOd2J19_58LQPWdTrl3D2A-GlvQPHLs9J2bZz9tSNQ 37
alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml sha256=ALkxtCPzM_kchqJOKP5DTZPcRSlMj68F8SjB5CZ5W1E 414
alpaca_eval/models_configs/ultralm-13b/configs.yaml sha256=TIfJyJzBGgN2Bpreev2hRDcubPLMvmHtazSMBtwa6-g 401
alpaca_eval/models_configs/ultralm-13b/prompt.txt sha256=Sm-9tJ-a_a__SFOWvxTUdoPX9xzcoQ0Bmi7Q_VbO37A 271
alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml sha256=llWTdhIhfYA_yxh5xpsV1rA1Ehm13HyURgF_n-fpqHQ 560
alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt sha256=Sm-9tJ-a_a__SFOWvxTUdoPX9xzcoQ0Bmi7Q_VbO37A 271
alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml sha256=awCPNoIZpnlJojtUmk2JyCx_CSyBiM6QqkgiHiP2Abk 421
alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt sha256=Sm-9tJ-a_a__SFOWvxTUdoPX9xzcoQ0Bmi7Q_VbO37A 271
alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml sha256=VDzOt2VLaIhFSJtHIvwBMNzHj5UsrNSNeQP_kcOv7bk 575
alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt sha256=Sm-9tJ-a_a__SFOWvxTUdoPX9xzcoQ0Bmi7Q_VbO37A 271
alpaca_eval/models_configs/vicuna-13b/configs.yaml sha256=8Hym23QJExR043vS1uH4iiXjNJarh0wYcEogcnD9UkI 387
alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml sha256=CZq9E2298VCSs54tUvc-1lZPsoSeQuNC1xhUj1hTjgE 387
alpaca_eval/models_configs/vicuna-13b-v1.5/configs.yaml sha256=pmVnZWfskuamcOAY4tui1Bps4cW58AOUVQprbY2GU5g 388
alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml sha256=d0bZ6b5TPRZEBFS1qWZoONghW9wNNxbasxvUnF7h1f4 387
alpaca_eval/models_configs/vicuna-7b/configs.yaml sha256=3q2N5Vr09-0ImFh6Ux2IlUU8VU6U6UBu6McoikE2ZZ8 383
alpaca_eval/models_configs/vicuna-7b/prompt.txt sha256=xo9TqyfhIAGjoxRYOMyFxsIwZ1k2fq9lrnnjJ0LQRmk 185
alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml sha256=UrmUKNcTIj3rzqS1Ht3lomsqX3_RLCJZjobaEe6hJA0 383
alpaca_eval/models_configs/vicuna-7b-v1.5/configs.yaml sha256=VssFwCGzYi7R8Pd-AIqwp_h7buLqt80mChqJ4rmKD7Y 384
alpaca_eval/models_configs/wizardlm-13b/configs.yaml sha256=7cQAwmaRjSxhD80NfKFMtEhYZzsnwRT0XXbgeRNsvDA 394
alpaca_eval/models_configs/wizardlm-13b/prompt.txt sha256=xo9TqyfhIAGjoxRYOMyFxsIwZ1k2fq9lrnnjJ0LQRmk 185
alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml sha256=MfAQB3jv4-iQEkmxrUGi7gx6rL5XpSIcWiFcPhk0MIs 410
alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml sha256=-7Lqy467tkDNY4W0VC2eljPFPrcwp0HK4rDGWLJXoJ8 410
alpaca_eval/models_configs/wizardlm-70b/configs.yaml sha256=-aGYzXNyQtalQbxUlXJlWMV2DbVgaz_lWJm0Z5Haz-U 394
alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml sha256=MdN0EJuqwQss08z1KbypKZBleDyc-n-9HI7Af0nLRBg 391
alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml sha256=o9qwq57oR73RnyGCxqqkSsu6tqy1zGqH4W0M5xZEy1E 391
alpaca_eval/models_configs/xwinlm-70b-v0.3/configs.yaml sha256=R8C0eowkDNHFNfuppFqoDbM8Xz_ic8mNT-u20NLGars 391
alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml sha256=lc1jN5Iqdqu9LO85sdzcMl03G0v7hhfpCog4mVI09xo 388
alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt sha256=xo9TqyfhIAGjoxRYOMyFxsIwZ1k2fq9lrnnjJ0LQRmk 185
alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml sha256=NGVRx0X_BH8Yv6VBCkcEdKbQitWofuKUTKAQrbctwhE 409
alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt sha256=2w3khg7YIrWG7xWp6cYL9WEb8-zx7vYvsh8eozFlvIU 57
alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml sha256=yy0sde0x12o0Dn4SdFE1GPsh8N7tReeA4xtkbQKdKyw 405
alpaca_eval-0.6.2.dist-info/LICENSE sha256=bhdenb4mu0Leg2e_IhUwGnGz9AMkOi7vxWN4swdji-g 11409
alpaca_eval-0.6.2.dist-info/METADATA sha256=GZjj5ifR-hwf3w7_fmyWcxMMyFFPEExj78nay3HEfS8 87063
alpaca_eval-0.6.2.dist-info/WHEEL sha256=GJ7t_kWBFywbagK5eo9IoUwLW6oyOeTKmQ-9iHFVNxQ 92
alpaca_eval-0.6.2.dist-info/entry_points.txt sha256=80Fbhb475MjCZie0wJzpm3dJZXQ5_jXdIeumUSvXkHg 54
alpaca_eval-0.6.2.dist-info/top_level.txt sha256=k6m1kZMZ1fuDbyOuJKNqDIdgvnqsg-PcVO7-ejJXOAU 12
alpaca_eval-0.6.2.dist-info/RECORD — —

top_level.txt

alpaca_eval

entry_points.txt

[console_scripts]
alpaca_eval = alpaca_eval.main:main