Wheelodex » Projects » fmeval

fmeval

View on PyPI — Reverse Dependencies (0)

1.0.2 fmeval-1.0.2-py3-none-any.whl

Wheel Details

Project: fmeval
Version: 1.0.2
Filename: fmeval-1.0.2-py3-none-any.whl
Download: [link]
Size: 132926
MD5: 2cd14f715fe2a11457c544dbf88702f3
SHA256: a6c3e9637c2b4ceaf40818255cc7433fb8e06e8ef76451e595c6471026c49b5a
Uploaded: 2024-04-25 21:03:41 +0000

dist-info

METADATA · WHEEL · RECORD

METADATA

Metadata-Version: 2.1
Name: fmeval
Version: 1.0.2
Summary: Amazon Foundation Model Evaluations
Author: Amazon FMEval Team
Author-Email: amazon-fmeval-team[at]amazon.com
License: Apache-2.0
Classifier: Development Status :: 1 - Planning
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Natural Language :: English
Classifier: Programming Language :: Python
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Requires-Python: >=3.10,<4.0
Requires-Dist: IPython
Requires-Dist: aiohttp (<4.0.0,>=3.9.2)
Requires-Dist: bert-score (<0.4.0,>=0.3.13)
Requires-Dist: evaluate (<0.5.0,>=0.4.0)
Requires-Dist: grpcio (<2.0.0,>=1.60.0)
Requires-Dist: ipykernel (<7.0.0,>=6.26.0)
Requires-Dist: jiwer (<4.0.0,>=3.0.3)
Requires-Dist: markdown
Requires-Dist: matplotlib (<4.0.0,>=3.8.3)
Requires-Dist: mypy-boto3-bedrock (<2.0.0,>=1.33.2)
Requires-Dist: nltk (<4.0.0,>=3.8.1)
Requires-Dist: pandas (==2.1.4)
Requires-Dist: pyarrow
Requires-Dist: pyfunctional (==1.4.3)
Requires-Dist: ray (==2.9.1)
Requires-Dist: rouge-score (<0.2.0,>=0.1.2)
Requires-Dist: sagemaker (<3.0.0,>=2.199.0)
Requires-Dist: scikit-learn (<2.0.0,>=1.3.1)
Requires-Dist: semantic-version (==2.10.0)
Requires-Dist: testbook (<0.5.0,>=0.4.2)
Requires-Dist: torch (!=2.0.1,!=2.1.0,>=2.0.0)
Requires-Dist: transformers (<5.0.0,>=4.36.0)
Requires-Dist: urllib3 (==1.26.18)
Description-Content-Type: text/markdown
[Description omitted; length: 13423 characters]

WHEEL

Wheel-Version: 1.0
Generator: poetry-core 1.9.0
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
fmeval/COMMIT_HASH sha256=hkFlmHZiGHktQUCNjhond_N5wh1KaAFHQW7bJi-Wvik 41
fmeval/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
fmeval/constants.py sha256=g3LAxWxAUVjfUGi2n8MxfykZ2cMSCfdJpo6_ylxJsms 4966
fmeval/data_loaders/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
fmeval/data_loaders/data_config.py sha256=jZyFS6DmZ8QEgAMiIdnhHumGpIRj7WT3YPmiUpUu7O0 2685
fmeval/data_loaders/data_sources.py sha256=Vm6LSCrE_BG144KQKXYV23xjMyydClxBv3PyW4Ux9Ck 3400
fmeval/data_loaders/jmespath_util.py sha256=eYLHQnJY4woIJjm2UH1STnkIvQHfe7gl7sPlVROudOc 1907
fmeval/data_loaders/json_data_loader.py sha256=uPzYBJJAaCPuibKnitXCAmef5-yBNHFEqy9i6g0dVTo 4292
fmeval/data_loaders/json_parser.py sha256=x-ZHGXu_HToLVLEjAt1uYYdt6c5n3XOaKIGjImPGU1w 12342
fmeval/data_loaders/util.py sha256=y_XW6D-ICjGuNqFdAHr_OBMpRjzOR0b15glQqgOgbY0 8073
fmeval/eval.py sha256=tfDa4njg7gUqneStKF8QK9fXxmDM41eHRC1k4YFO0EM 1424
fmeval/eval_algo_mapping.py sha256=UG9LCEw3LnPwnJyf4WmO4UuAIAA8cwUGVYqWK5IWzDE 2085
fmeval/eval_algorithms/__init__.py sha256=SdErgrIAe56QwaqqBhRg825j5O7RhCZrClwnwaY2FAI 13115
fmeval/eval_algorithms/classification_accuracy.py sha256=WiLCPTLOsI49jTy6RJvK32d27VoNStIFKI4qHlFhgKQ 17889
fmeval/eval_algorithms/classification_accuracy_semantic_robustness.py sha256=oc_6lVYLJqmJ3R2FD9bzipR3opdhKLif25K6QVq9XRg 11684
fmeval/eval_algorithms/eval_algorithm.py sha256=oLiJiKLcjIBTgVLge-Ztjg6l0gBqr3Dy_FBL_KrjRZ0 3358
fmeval/eval_algorithms/factual_knowledge.py sha256=QPNXIOfDlmkRt5fEjWLi7HGwyuH56wfdWUeQS2R2ylg 9356
fmeval/eval_algorithms/general_semantic_robustness.py sha256=kOgNBH1wgdf_Ykk87et-d0HgnYkBRjJ6_pSPn6nrIXE 18176
fmeval/eval_algorithms/helper_models/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
fmeval/eval_algorithms/helper_models/helper_model.py sha256=nDzy4EgwRKhoTv4h1RkrHzKuASewl3wShIdLMY5zhqs 7777
fmeval/eval_algorithms/prompt_stereotyping.py sha256=UZugJZ0dXl2YxPvv3AGYh7uaMoSDYlN1YTFw9wj6iaY 11552
fmeval/eval_algorithms/qa_accuracy.py sha256=EfRAo-b3wXX3luvwoDofecZ5BiFc1zoYICFMVITtXaA 17442
fmeval/eval_algorithms/qa_accuracy_semantic_robustness.py sha256=cAg08Zv5kI-NjpEbE0V6aUyLPaIqy8AsjovB0_AMMGw 11451
fmeval/eval_algorithms/qa_toxicity.py sha256=CPTnUL4QLhD8ZX5KOHWJUudkIWcg98m3aYj5ZtGMbh8 1614
fmeval/eval_algorithms/semantic_perturbation_utils.py sha256=Tb68-Wh7twtiGpXcjpfb8SlNp38EfOwofhLCJQ1uuMg 8044
fmeval/eval_algorithms/semantic_robustness_utils.py sha256=EkPjXshdm12gEijqIM_O8RIQjZC6NWOgHTvGY8TbJ00 5758
fmeval/eval_algorithms/summarization_accuracy.py sha256=n0PNuR4HT-kpJ0Yv2sYtl_S9MOByBZM93AYIN70fWxQ 12738
fmeval/eval_algorithms/summarization_accuracy_semantic_robustness.py sha256=YCiCCcxVGswSNpkwkyzWGfhmvO7BbWh7C-vcvR8omB4 13328
fmeval/eval_algorithms/summarization_toxicity.py sha256=RX1iwwMKIVl977u6HzgI0EUXrFQwGJBhqAarq8ryyKc 1671
fmeval/eval_algorithms/toxicity.py sha256=mbI943E1rvWtEvt1lwzZ6uPj6jOh839r8asz_cGPZus 8379
fmeval/eval_algorithms/util.py sha256=bSvf5x0jvAZITLcj6R6wy_-6_HH9JnjPN3tAJ0UVMI4 22881
fmeval/exceptions.py sha256=rH3AXS8jrqz87EmTJEmP1woQsm8jKjajr_vLmiRlx74 361
fmeval/model_runners/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
fmeval/model_runners/bedrock_model_runner.py sha256=WIaOGKIcmvBdmDmYa5EDMcf-iD6NLThxvyWRCfYhnZM 3725
fmeval/model_runners/composers/__init__.py sha256=bMvsYeG_1s_nkK3Xq3zvYhXb2OQVPRIxkSacYcQKXho 1803
fmeval/model_runners/composers/composers.py sha256=af-kt0nD8pD8KKqJnVN57M1X8O9kDiGAuh9qpfUV3fc 3432
fmeval/model_runners/composers/jumpstart_composer.py sha256=i2OI-q4Nk8nmzTJj1Cs01SklA0Aq80IpDVLSrigp4vk 1144
fmeval/model_runners/composers/template.py sha256=0FbsIxyce2nw3YdELrDDnKgdwz7UGjP7e9Gz_VK8NwA 1381
fmeval/model_runners/extractors/__init__.py sha256=hcL0dFcgSVl4fXZv1LCD1mYko3XkNOMFMwaXn42ieoo 1415
fmeval/model_runners/extractors/extractor.py sha256=4MF-ddkJSpuMgjgQ3kEvR2oF5EeJXN6jL0QI5ZOavrs 801
fmeval/model_runners/extractors/json_extractor.py sha256=qM-sZxHLsdgxxYdJ1FV4UcFDwTLph87XBg4MxCg5wR0 3945
fmeval/model_runners/extractors/jumpstart_extractor.py sha256=MvcWsQ_Ba3ChyM_54ueoO9Zo0Ku2cu1WHzed_qNV9dE 6419
fmeval/model_runners/model_runner.py sha256=_qRNZI1WsBinNwZ-qGBDbIfKzfk_X-0zChH1caZPo1U 2123
fmeval/model_runners/sm_jumpstart_model_runner.py sha256=pxRxWyZFZ5FIjVtcW-8kdbpEt9ftjcMNG5M0hHV1CxM 4754
fmeval/model_runners/sm_model_runner.py sha256=QFbKXNYDZcylY7as6YHDOFmgShBQR6TFvWZAwVTCpBE 4344
fmeval/model_runners/util.py sha256=ADunfEHQ-XJSfTa8TNgw1UWTtb13EfO1P1U3lRaUoUA 4555
fmeval/perf_util.py sha256=h_vw4yZXvRDmoQVRhnTYf5VmuWZtjzQgbip_uOBOm54 579
fmeval/reporting/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
fmeval/reporting/cells.py sha256=LKCv8hoUGuIc639KsNqyq0MSXcU_HwicdmYH_cJeDX4 11536
fmeval/reporting/constants.py sha256=4sHRHAXp40N6Zp6lZ2fSukUES8MzHsa5qZdlrS5d-wo 18277
fmeval/reporting/eval_output_cells.py sha256=UZIpRfiw6slOsVx1EXK04e9wDPIa8RP7EfUIyXcgtJA 20645
fmeval/reporting/util.py sha256=6bYcVJ6ErTrVT91J9vJ0dyDEotpX6CHbNZB9O5nq7XI 3932
fmeval/transforms/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
fmeval/transforms/batched_transform.py sha256=ZgGGstVZ2p8EDq65rye6QBuLwVFOXu7oTvE-G28zcG0 1404
fmeval/transforms/common.py sha256=6njUK3s0eiAsLed-jHHbtEQPxCp7DJVN8nOKb0yJpHY 7049
fmeval/transforms/semantic_perturbations.py sha256=etmFWOlOYJWu4sINy268GUI8YV3S7Ispj4z5hM30ClM 12300
fmeval/transforms/semantic_robustness_metrics.py sha256=lEv6vHVzDvUOqHTDIeS6RfFaoYXcSkXKqvYwwKzrcOU 6241
fmeval/transforms/summarization_accuracy_metrics.py sha256=KUAYevzgSLTjbVwddtogavfT1tPPAcEAVqsxkAag8Ag 11718
fmeval/transforms/transform.py sha256=brePXgZJTVRzldiCpD96ayEuVb5tOHXbauYzz6fDyWY 4437
fmeval/transforms/transform_pipeline.py sha256=UUZtxSrmqMqEH6su28TDz-8GCmgG0IaQ2E5iOIfcDdE 4572
fmeval/transforms/util.py sha256=9aQPqL7LEYCh5co-0QCrSxsePwRo9j3Co-S5frwtTIE 4684
fmeval/util.py sha256=tSKO9_T9bL2v77naWtNRs0OAAm5CFDuOXdUgbo-7JJY 4707
fmeval-1.0.2.dist-info/LICENSE sha256=CeipvOyAZxBGUsFoaFqwkx54aPnIKEtm9a5u2uXxEws 10142
fmeval-1.0.2.dist-info/METADATA sha256=-mf0DpydZ2i5Uvsr17hYYFWdMGUQjp4h1vXnZfQn3yc 15009
fmeval-1.0.2.dist-info/NOTICE sha256=1CkO1kwu3Q_OHYTj-d-yiBJA_lNN73a4zSntavaD4oc 67
fmeval-1.0.2.dist-info/WHEEL sha256=sP946D7jFCHeNz5Iq4fL4Lu-PrWrFsgfLXbbkciIZwg 88
fmeval-1.0.2.dist-info/RECORD — —