Wheelodex » Projects » lighteval

lighteval

View on PyPI — Reverse Dependencies (1)

0.3.0 lighteval-0.3.0-py3-none-any.whl

Wheel Details

Project: lighteval
Version: 0.3.0
Filename: lighteval-0.3.0-py3-none-any.whl
Download: [link]
Size: 227379
MD5: bcce1e59b3249d2cd8906eedae1fd2da
SHA256: 634f85aaface0bba969ee7105098838dc93bed9eca0ad45f88812ccf17779999
Uploaded: 2024-03-29 16:52:00 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt

METADATA

Metadata-Version: 2.1
Name: lighteval
Version: 0.3.0
Summary: A lightweight and configurable evaluation package
Author-Email: Clémentine Fourrier <clementine[at]huggingface.com>, Nathan Habib <nathan.habib[at]huggingface.com>, Thomas Wolf <thom[at]huggingface.com>
Maintainer-Email: Clémentine Fourrier <clementine[at]huggingface.com>, Nathan Habib <nathan.habib[at]huggingface.com>
Project-Url: Homepage, https://github.com/huggingface/lighteval
Project-Url: Issues, https://github.com/huggingface/lighteval/issues
License: MIT License
Keywords: evaluation,nlp,llm
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Requires-Python: >=3.10
Requires-Dist: transformers (>=4.38.0)
Requires-Dist: huggingface-hub (>=0.22.0)
Requires-Dist: torch (>=2.0)
Requires-Dist: GitPython (>=3.1.41)
Requires-Dist: datasets (>=2.14.0)
Requires-Dist: termcolor (==2.3.0)
Requires-Dist: pytablewriter
Requires-Dist: colorama
Requires-Dist: aenum (==3.1.15)
Requires-Dist: nltk (==3.8.1)
Requires-Dist: scikit-learn
Requires-Dist: spacy (==3.7.2)
Requires-Dist: sacrebleu
Requires-Dist: rouge-score (==0.1.2)
Requires-Dist: sentencepiece (>=0.1.99)
Requires-Dist: protobuf (==3.20.*)
Requires-Dist: pycountry
Requires-Dist: accelerate; extra == "accelerate"
Requires-Dist: peft (==0.3.0); extra == "adapters"
Requires-Dist: lighteval[accelerate,quality,tests]; extra == "dev"
Requires-Dist: langdetect; extra == "extended-tasks"
Requires-Dist: openai; extra == "extended-tasks"
Requires-Dist: nanotron; extra == "nanotron"
Requires-Dist: tensorboardX; extra == "nanotron"
Requires-Dist: optimum (==1.12.0); extra == "optimum"
Requires-Dist: ruff (==v0.2.2); extra == "quality"
Requires-Dist: pre-commit; extra == "quality"
Requires-Dist: bitsandbytes (>=0.41.0); extra == "quantization"
Requires-Dist: auto-gptq (>=0.4.2); extra == "quantization"
Requires-Dist: pytest (==7.4.0); extra == "tests"
Requires-Dist: text-generation (==0.6.0); extra == "tgi"
Provides-Extra: accelerate
Provides-Extra: adapters
Provides-Extra: dev
Provides-Extra: extended_tasks
Provides-Extra: nanotron
Provides-Extra: optimum
Provides-Extra: quality
Provides-Extra: quantization
Provides-Extra: tests
Provides-Extra: tgi
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 27594 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.43.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
lighteval/__init__.py sha256=5NEYneDuYWDp83SJx108iOr1b-T08TkewQevIIeJK4E 1206
lighteval/data.py sha256=bE_TuTYSgPhwL3KmwNYH1OqAsP2ZCTgIGil67Bsfyt8 11000
lighteval/evaluator.py sha256=pENVCqveMuNd9rHzJnfSunqGv0lLlzVd7GwHMfJ6x0M 7476
lighteval/few_shot_manager.py sha256=eI-iTw6iaJoxWy2xPzqx7abOqXp2qE1FjwxXPEGa9uQ 15418
lighteval/main_accelerate.py sha256=UOj6DOHS8XuVgsqwg4ygWu9sgOCNVHiW-f59G-zh6M8 6305
lighteval/main_nanotron.py sha256=rt19KOc3pbEz0DDZrVnwq0y-b2DT-74WWw3-1Fi9KI0 8087
lighteval/utils.py sha256=R-CKba1d7cQpp4TGdxUdZ4zh9_g3062F8UT9zS5v9ew 6879
lighteval/utils_parallelism.py sha256=AtGwc5lC0lkeNlpoHhxFngQEI3C5KcAQTUddxk8Xgsw 6246
lighteval/logging/evaluation_tracker.py sha256=JDx8aMEOUXAw9Au9FbBIYzsVc6208_ucj5PznOypSW8 29723
lighteval/logging/hierarchical_logger.py sha256=bFL16LURifzxpGqyIEH9V8mBBKAbYlZZ9mczFWr2M8w 5345
lighteval/logging/info_loggers.py sha256=SG7AK3Iw78gwnE53d3ftj8m1a5twWcGgWoVBwd-zCws 28116
lighteval/metrics/__init__.py sha256=hxB1vR63-UKE2_gRky2zmBHUT0dcepl6k2H2VpBWThk 6322
lighteval/metrics/metrics.py sha256=35Yrt6049lP9L9p9P3K0C2jB4Mx61ywSjWvoRgb8hUo 20775
lighteval/metrics/metrics_corpus.py sha256=Cl0AaqFVKYQrHLjk-Vd_BSC_fXGkDzU9I2Gi9z6LbmI 6119
lighteval/metrics/metrics_sample.py sha256=FYMGjcR1OLalz-ITBke9iQrMwnX75uw4qHOvkteCyuQ 27113
lighteval/metrics/normalizations.py sha256=GKVNiuKBlxH6YikO21qxTdSPSALMUHHZdsho80J6Ic8 10044
lighteval/metrics/sample_preparator.py sha256=I92v0NZGiDvAgNZFaVjV_gE1ABjFRfajRoCFpaveuXc 5628
lighteval/metrics/stderr.py sha256=dxR6mjQhuuuS2lHGPpCFjc583OLiQqR6FLBprddon0c 4387
lighteval/metrics/utils.py sha256=RRaAlnBW1GU7R4eYDo6Z4WsKicWLATOSRwZblOr-drA 3338
lighteval/metrics/harness_compatibility/drop.py sha256=nnKeu-9nHN5aihriYD45yfiQT05PnYinvr-V_x4dUuU 6045
lighteval/metrics/harness_compatibility/truthful_qa.py sha256=OyJe4QxOTtIMf4ENqh0u9H_E23f7TQFWZnFPzCZXC0E 2580
lighteval/metrics/imports/bert_scorer.py sha256=loUa4kd3xSjIf0zJQ1nurJcYUQGl6oRHolFtff3E8sY 18340
lighteval/metrics/imports/data_stats_metric.py sha256=1T3qzV0s9Oomz5b58I-1IO20OoFDbgsldvGX_FS6DB8 5714
lighteval/metrics/imports/data_stats_utils.py sha256=eca-eXrrcyjZwcJbW0bmSYAY3jt-n827gKbIsTJnW58 6116
lighteval/metrics/imports/summac.py sha256=3JLdMvw1yrMce6OTwL-J5NAvyvzxh4-ri2FEpeJrl48 11679
lighteval/models/abstract_model.py sha256=lNoTNFi2n6Dj90ko_61ANhPMglUmzOQnoT4hLJI6cLs 7152
lighteval/models/adapter_model.py sha256=K9-yWpcnF776o8yBfZY7cdQxLJSnXJtlDOsok65uPKA 3526
lighteval/models/base_model.py sha256=Xhf2xrGlIa8ENyo8xybzWCIvHK9o3oDMIjOT-XZcPgU 50885
lighteval/models/delta_model.py sha256=wVqw01pIPPPCGK7bL--pXOBDC-BBXw83dDlG8i3Zxsc 3459
lighteval/models/endpoint_model.py sha256=lCpsFk6HhKDtsPYqWD1Wpd4PO1yQyc0mMj_B64QPeHA 16735
lighteval/models/model_config.py sha256=ipjpEV20HP1HYUcZlPYtkUW32iyKiaRrvTR-7EiQNnM 14693
lighteval/models/model_loader.py sha256=g3yCIH8BCvWmWLa03w7o0jAf7Ljbn5pxq7KSqqz-aEo 5595
lighteval/models/model_output.py sha256=-tjQXSXo5-pfvGgm81-NCnB2voTpxaAIw_RTNDh4Wjo 2893
lighteval/models/nanotron_model.py sha256=vkvmNopCWwZaRiFOhT14QeolOSgO3GApIy8v73KFuQQ 63820
lighteval/models/tgi_model.py sha256=gpZVaeGcoRfTexixtxOLKUx3JG5TId_Tz77Jhm8Kikw 5606
lighteval/models/utils.py sha256=Bv54TD6baarS50hTPQyYC4yHuDhcn5in_0_OPGpJeZQ 4513
lighteval/tasks/lighteval_task.py sha256=aa19n05P9X3X9ubrVuepuGxpWK8JG_8Q9ymUvKS1gC8 30962
lighteval/tasks/registry.py sha256=plXeuuRBUhBiLIHyKXWttE7y9TyT_L-i1rUOtUKLQmI 11547
lighteval/tasks/requests.py sha256=ry_baa_53rL5M5CshIYxvZ-XPpR10yv2TjTty1TRQXA 7143
lighteval/tasks/tasks_prompt_formatting.py sha256=PmrjIBBnh30Dzjut1qmVqBcmANhJCZIvSKRRUrsRzhI 102906
lighteval/tasks/tasks_table.jsonl sha256=D-ED3fd_sCPP33hd1Zsr1qCKB1lQUZR1ks4uS3D08xY 534260
lighteval/tasks/extended/__init__.py sha256=5G2Tn1Nae_xj23cjSz7ui017XTZ20FrBq5ofAkxYtOs 1517
lighteval/tasks/extended/ifeval/instructions.py sha256=jZgpr8Jg6gx27IS5GF6aovVLQ-Wi1zFhinuN-tF8gUA 56053
lighteval/tasks/extended/ifeval/instructions_registry.py sha256=iRVMuVdoCBc3HyTHDxPkxi9hKOyZhWkEuxWSpa1Z4eM 7258
lighteval/tasks/extended/ifeval/instructions_utils.py sha256=08GaBGzAFUuwipF1fO70nORGh5799vtH4TdDHJdqvu8 25894
lighteval/tasks/extended/ifeval/main.py sha256=9xygcBe5MYURiFsKKY9xIWAtwIJae8x1BYpjyK3upNM 5887
lighteval/tasks/extended/mt_bench/judges.py sha256=B4uP3PQhAKx_BjrBVg2cwfCivNdDOXDOzIWYtiL5w8U 9371
lighteval/tasks/extended/mt_bench/main.py sha256=kZqVVUo0_I8nFQzIrlJcVKKREWglp2O2EzxyxrbnOmE 4728
lighteval/tasks/extended/tiny_benchmarks/main.py sha256=fKPDQgfaN0sP2bp4ZW_52N_TwGFcZujvjV1fEGG7SU8 11331
lighteval-0.3.0.dist-info/LICENSE sha256=tPk5wOXOUTsipCsjMpS1bCJqJ5Nudwj1HtE3xgLo6w8 1069
lighteval-0.3.0.dist-info/METADATA sha256=RVW6NuF8LD1NwUapWb5OEDR378Gqe1QwlgeCd7zTiMU 29915
lighteval-0.3.0.dist-info/WHEEL sha256=GJ7t_kWBFywbagK5eo9IoUwLW6oyOeTKmQ-9iHFVNxQ 92
lighteval-0.3.0.dist-info/top_level.txt sha256=dvkN9L0K1BpVFmb-YCakjCmC13DtEVvsyMi5V12jdvg 10
lighteval-0.3.0.dist-info/RECORD — —

top_level.txt

lighteval