Wheelodex » Projects » scandeval

scandeval

View on PyPI — Reverse Dependencies (0)

12.10.0 scandeval-12.10.0-py3-none-any.whl

Wheel Details

Project: scandeval
Version: 12.10.0
Filename: scandeval-12.10.0-py3-none-any.whl
Download: [link]
Size: 124134
MD5: 6ffe04f1e93e208f2c54fcd130ccb642
SHA256: dc3b341450518f880976822727bfd12ed6b948b51336284d9dbda8792f84ee98
Uploaded: 2024-05-08 11:37:51 +0000

dist-info

METADATA · WHEEL · RECORD · entry_points.txt

METADATA

Metadata-Version: 2.1
Name: ScandEval
Version: 12.10.0
Summary: Evaluation of pretrained language models on mono- or multilingual language tasks.
Author: Dan Saattrup Nielsen
Author-Email: dan.nielsen[at]alexandra.dk
Maintainer: Dan Saattrup Nielsen
Maintainer-Email: dan.nielsen[at]alexandra.dk
Home-Page: https://scandeval.github.io
Project-Url: Repository, https://github.com/ScandEval/ScandEval
License: MIT
Classifier: License :: OSI Approved :: MIT License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Requires-Python: >=3.10,<3.12
Requires-Dist: accelerate (<0.27.0,>=0.26.0)
Requires-Dist: auto-gptq (<0.8.0,>=0.7.1); extra == "quantization" or extra == "all"
Requires-Dist: autoawq (<0.3.0,>=0.2.5); extra == "quantization" or extra == "all"
Requires-Dist: bert-score (<0.4.0,>=0.3.13); extra == "generative" or extra == "openai" or extra == "all" or extra == "all" or extra == "cpu-all" or extra == "cpu-all"
Requires-Dist: bitsandbytes (<0.44.0,>=0.43.1); (sys_platform != "darwin" or platform_machine != "arm64") and (extra == "generative" or extra == "openai" or extra == "all")
Requires-Dist: click (<9.0.0,>=8.1.3)
Requires-Dist: datasets (<3.0.0,>=2.15.0)
Requires-Dist: demjson3 (<4.0.0,>=3.0.6); extra == "generative" or extra == "openai" or extra == "all" or extra == "cpu-all"
Requires-Dist: evaluate (<0.5.0,>=0.4.1)
Requires-Dist: flax (<0.9.0,>=0.8.1); extra == "jax" or extra == "all" or extra == "cpu-all"
Requires-Dist: gradio (<5.0.0,>=4.26.0); extra == "human-evaluation" or extra == "all" or extra == "cpu-all"
Requires-Dist: jax (<0.5.0,>=0.4.24); extra == "jax" or extra == "all" or extra == "cpu-all"
Requires-Dist: jaxlib (<0.5.0,>=0.4.24); extra == "jax" or extra == "all" or extra == "cpu-all"
Requires-Dist: levenshtein (<0.25.0,>=0.24.0); extra == "openai" or extra == "human-evaluation" or extra == "all" or extra == "cpu-all"
Requires-Dist: numpy (<2.0.0,>=1.23.0)
Requires-Dist: openai (<2.0.0,>=1.11.1); extra == "openai" or extra == "all" or extra == "cpu-all"
Requires-Dist: optimum (<2.0.0,>=1.19.1); extra == "quantization" or extra == "all"
Requires-Dist: outlines (<0.0.35,>=0.0.34); extra == "generative" or extra == "openai" or extra == "all" or extra == "cpu-all"
Requires-Dist: pandas (<3.0.0,>=2.2.0)
Requires-Dist: protobuf (<3.21.0,>=3.20.0)
Requires-Dist: pydantic (<3.0.0,>=2.6.0)
Requires-Dist: pyinfer (<0.0.4,>=0.0.3)
Requires-Dist: python-dotenv (<2.0.0,>=1.0.1)
Requires-Dist: rouge-score (<0.2.0,>=0.1.2); extra == "generative" or extra == "openai" or extra == "all" or extra == "all" or extra == "cpu-all" or extra == "cpu-all"
Requires-Dist: sacremoses (<0.2.0,>=0.1.1)
Requires-Dist: sentencepiece (<0.2.0,>=0.1.96)
Requires-Dist: seqeval (<2.0.0,>=1.2.2)
Requires-Dist: termcolor (<3.0.0,>=2.0.0)
Requires-Dist: torch (<3.0.0,>=2.3.0)
Requires-Dist: transformers (<4.41.0,>=4.40.0)
Requires-Dist: vllm (<0.5.0,>=0.4.2); sys_platform != "darwin" and (extra == "generative" or extra == "openai" or extra == "all")
Provides-Extra: all
Provides-Extra: cpu-all
Provides-Extra: generative
Provides-Extra: human-evaluation
Provides-Extra: jax
Provides-Extra: openai
Provides-Extra: quantization
Description-Content-Type: text/markdown
[Description omitted; length: 6129 characters]

WHEEL

Wheel-Version: 1.0
Generator: poetry-core 1.9.0
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
scandeval/__init__.py sha256=jfaMmM8ch66sI7HqC6KXacIRyEaB8TuvDvx_Tbh5VWs 1091
scandeval/benchmark_config_factory.py sha256=Dcm5RU_B4FUhnwX7nrbbvCwG6GItuP1ZfyQ03neMfh0 14797
scandeval/benchmark_dataset.py sha256=CAG7ekxCKPgQrnavAChHz4yojVpMSYvZoE8R3jnBiQ4 27576
scandeval/benchmarker.py sha256=FconbAVZCGo18TLXlvZ2ds6Hr6Wn2p80ytjWobaF96k 37429
scandeval/callbacks.py sha256=RXjJdcuBB01n3BB896GkgUcmusV6sbzOt6WDRUJ60Rs 1818
scandeval/cli.py sha256=G9wOulCCiuQSnfxZRcOr-ExWKMIuk5GNrfGA6-kUTYU 10672
scandeval/config.py sha256=IsNmfXY7DSmpDnEg_0miQtZ-xyQ9YdeXVaXbFx2WG5k 9720
scandeval/dataset_configs.py sha256=i1Bl8bC5LfCdp4xlmNbBV-3x0CEX08TlM8uv0ZiI5P8 39587
scandeval/dataset_factory.py sha256=ylkT4qrs8lTr2JAPzD-26-8E6xPgTB1SIAbOVs-QmLs 2117
scandeval/enums.py sha256=oo2UKC5iTujlH0Bdyb22hgAcuDzOgyMCq_TU_07JL64 1728
scandeval/exceptions.py sha256=xphfCgIs-oJduNA7WX0DjdPAIXktx7uNDvvSleAZXHw 5866
scandeval/finetuning.py sha256=FCn13t6WNmyMzownu7XjSdNK_6srWYLSqkEb-rKRWmY 15461
scandeval/generation.py sha256=fkpstU0fKVVTFdNZ9hpyRZeE5tRP1gAtbMLpWX72WkU 21395
scandeval/human_evaluation.py sha256=lTs1IdB5FxEu9mugRoM7FAnBMpcvKVNIYbhuXmdrOQY 25700
scandeval/languages.py sha256=zpVzBvwqNtyXyR-bO3P54XdOSfQpiEFxqLcvpL7t7x8 7904
scandeval/model_cache.py sha256=qX60jiniZJwvfcyVwCV-XRTPfDnDv4Cvf9ImTpkNJSg 10103
scandeval/model_config.py sha256=OTMQUZ68_4iW0zrhNmfR3dPlUyG9v8iszukx_diUdS0 2622
scandeval/model_loading.py sha256=KsF5RjM-WzetM8EzL8QQmHkelVRQKBI4vynXw5KN7QA 2105
scandeval/model_setups/__init__.py sha256=uSbUckBTLwgRs8z954tHpELlaFze6Qlci1EefmVX1E4 557
scandeval/model_setups/fresh.py sha256=qNBwEXmXVgh6NTFo1N7x5EHxr8Pv0ORzfDn4T-4Jnrc 6085
scandeval/model_setups/hf.py sha256=yxrXbBediRBvRB__k2OwvBVRH0E1tpBjhysUf_XZ7C4 25017
scandeval/model_setups/local.py sha256=lfOoHSxw6YewBmuU1NbqONpoqkI3wGozDb6dxm-R7vc 5127
scandeval/model_setups/openai.py sha256=OY8PElDW1QM3HphIvmAOF7RVgPB5XtgL6Zl9Eb0PReI 8458
scandeval/model_setups/utils.py sha256=pBnqJKsApmHN2bBwg_XUCu1FdHRb2QSenc7eMzTw_t0 8201
scandeval/named_entity_recognition.py sha256=iGyIhGEkRIHgIhJfuYzXtLsymig1HilnyKStL7l5sbU 27286
scandeval/openai_models.py sha256=x_038O6txT4L__tlC7o69emZel9vq4DjhBcsFzxaFyM 19270
scandeval/protocols.py sha256=k5hC49UKmWauYkmYs1w7Y35UijYBT7KOszL-t0Q7xMM 6474
scandeval/question_answering.py sha256=ofMc1Rh4E3RAeh_VzzYMgxgRZ0yt2ClmkiOU0RWYXR8 22481
scandeval/question_answering_trainer.py sha256=u3XQshZpRZBJBMbm3xGeZUwXUjBwbBujPR9WCPSivEQ 12247
scandeval/scores.py sha256=ylwikyKKbUShDEcY9yruKSJf-18Y8OZHXcOfMx2snZo 4875
scandeval/sequence_classification.py sha256=eyLUwuqBG2BacbgEnQBLVYlZDxeZwosCg6PDYdqDL4c 15481
scandeval/speed_benchmark.py sha256=LxkviHinOhyiP-YHYKylapLm6Ekzbg9tP5kyvaB6Hb8 6072
scandeval/structured_generation_utils.py sha256=IK_uAu8bHFDEtarSt_BQhW2EFJzxqo-gHNiY3kf-pZM 2824
scandeval/tasks.py sha256=BHnZgz2Re2M-QAvHwDGhYw1vHKBFA88Fy1HsvfHiEbE 5487
scandeval/text_to_text.py sha256=0UZ23f2JI2M4nv09jpnvAbHixdvG_EwkYxnGfWPql5s 10703
scandeval/types.py sha256=XMd3-71WTFfWHpiDFdFElFsjxp2Btjl22HEoqHSAZqs 1290
scandeval/utils.py sha256=IETV6Sfe8zQmYp5NehG4dPWNrnhCFDD2x06cWAFcB3s 26704
scandeval/vllm_models.py sha256=zeVayvmuj2Lk5TlxvwfinCZVQl6qE_d-8CBPj5WIpsw 14909
scandeval-12.10.0.dist-info/LICENSE sha256=oZp5fpOSQ7w-vFui8QNwrBIosrO7cnpArItdbvn52Ao 1082
scandeval-12.10.0.dist-info/METADATA sha256=u14PAnaJyGpchbY1qVXRlCdOp-J62eZ6bNNuPjqxtpI 9441
scandeval-12.10.0.dist-info/WHEEL sha256=sP946D7jFCHeNz5Iq4fL4Lu-PrWrFsgfLXbbkciIZwg 88
scandeval-12.10.0.dist-info/entry_points.txt sha256=Hv5SSGhINx3o3pRpibuyvpt-wolpv6kWzSftHa6YxJo 100
scandeval-12.10.0.dist-info/RECORD — —

entry_points.txt

[console_scripts]
human_evaluate = scandeval.human_evaluation:main
scandeval = scandeval.cli:benchmark