benchllm

View on PyPIReverse Dependencies (0)

0.3.0 benchllm-0.3.0-py3-none-any.whl

Wheel Details

Project: benchllm
Version: 0.3.0
Filename: benchllm-0.3.0-py3-none-any.whl
Download: [link]
Size: 28545
MD5: c037a13cbde26abac88a0f92c767bbc9
SHA256: 5b516146921ff05a305035a8eb0c5cc9eb9f6f71c8e8ebe82d48b326278f9287
Uploaded: 2023-07-20 12:56:36 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: benchllm
Version: 0.3.0
Summary: Tool for testing LLMs
Author: Simon Edwardsson
Author-Email: simon[at]v7labs.com
Home-Page: https://github.com/v7labs/benchllm
License: MIT
Classifier: License :: OSI Approved :: MIT License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3
Requires-Python: >=3.10,<3.12
Requires-Dist: faiss-cpu; extra == "examples"
Requires-Dist: langchain; extra == "examples"
Requires-Dist: openai
Requires-Dist: pydantic (<2.0.0,>=1.10.9)
Requires-Dist: pypdf; extra == "examples"
Requires-Dist: pytest; extra == "dev" or extra == "test"
Requires-Dist: pywebio
Requires-Dist: pyyaml (>=5.1)
Requires-Dist: tiktoken; extra == "examples"
Requires-Dist: typer[all]
Requires-Dist: types-pyyaml; extra == "dev"
Provides-Extra: dev
Provides-Extra: examples
Provides-Extra: test
Description-Content-Type: text/markdown
[Description omitted; length: 10006 characters]

WHEEL

Wheel-Version: 1.0
Generator: poetry-core 1.4.0
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
benchllm/__init__.py sha256=ldr333Xa6hUvxeG92cG6DwxPP_mqYeVrjovieWioqrc 1398
benchllm/cache.py sha256=XSHdkOAszTLw9mqQLGXiU7APEhapOsGgS4_ZTvFlkFY 3821
benchllm/cli/__init__.py sha256=NwYFqQvbwbUwHeubH5f7xAEaopCArSYJScIEbVV7HOg 285
benchllm/cli/commands/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
benchllm/cli/commands/add_test.py sha256=1g57RVARbzb0YP9e2yGfhfCinu-nxso1cgv5xyJxb9U 969
benchllm/cli/commands/evaluate.py sha256=JQXsurTtY5wMo-cvleYFEplb9wBpEzB527Ty9UunT3M 1053
benchllm/cli/commands/list_tests.py sha256=t3PgNbBnbLSToIHRMctiyeFhiaYcUFxHUOzZmJI5qa8 1283
benchllm/cli/commands/run_suite.py sha256=VPpEevS_81QY_O9iZvAfsOnYlhHf39yPdrxnFwIHiM4 1634
benchllm/cli/evaluator/__init__.py sha256=2KSghDJMwssNMhl2QtMc5nmNY71JIK5IcLTDf02q8Eg 136
benchllm/cli/evaluator/interactive.py sha256=VqkaqjUEu3K3RPQmT1oKINVEKrFzza0oCLLTnQSAELo 1653
benchllm/cli/evaluator/web.py sha256=u5Y9Vk3BEsaSRPywJYUT7GY5BhaftQvuF_elkyKGihA 2089
benchllm/cli/listener.py sha256=CVaemZXiA-9JDONbkV_9r6hWj7Tiqy3MiXVkUxbkJFE 7483
benchllm/cli/main.py sha256=3GGPcJ-tPStxSTirrnnejHLsnpBL5pbQVL1PUYgNuJU 3790
benchllm/cli/utils.py sha256=BOEetAkdIy2CEu0_Ei2vH0iGMoG36hdckOgQ6KpM9CQ 1619
benchllm/data_types.py sha256=mj5vAFAWS3_7KEEzZVG330JlyBkgV8B9IPeUrCuFHKI 2241
benchllm/evaluator/__init__.py sha256=L-YWEh-hc7ZUri_6gmoMl86PjR364Af-ndJMiweELlc 340
benchllm/evaluator/embedding.py sha256=cnPDPTvHfJ0C3JvIjA3hlJiVAQPuQsNHpzNkag-a4v4 1471
benchllm/evaluator/evaluator.py sha256=FCQCXZLS6xeyrLemDU1P2Iihc41d6H8ZQwQq5hm5-bE 4679
benchllm/evaluator/semantic.py sha256=nSRLqfreVwMYRYq6X1PbyejAXij42_cAnGoH-rIoxHM 1143
benchllm/evaluator/string_match.py sha256=J1UVfbDpYXdWSzyvPbzzRq0Ye5I-exu8qZtNvlwSboY 1167
benchllm/input_types.py sha256=x8JnXd48PHFAsOcGGF0KMu6vSvST0TX0zCEbjelmHS0 276
benchllm/listener.py sha256=WbtVv-Dvaf-21Wa3JL-L19sdCBwCHlkOzJUnzGhhax4 1086
benchllm/similarity.py sha256=3D4NP2gbiym7TeAD8-aKk975e0iZOtMYdxpaH82C3NM 1601
benchllm/singleton.py sha256=NawrVoDv8EKoANdUtUsD29d6NWlx4IyJzN1LPmI_djg 780
benchllm/tester.py sha256=7QXvCT6LqYFgz7oW8xE2_1GS5vcz5627GhuGoTUDTMU 10746
benchllm/utils.py sha256=LxRiiahoaIbCh0RdzPCQe1MdAL_qHVxox45gPi5ZZzs 4474
benchllm-0.3.0.dist-info/LICENSE sha256=XoVbXu1z9RQsksd5tTn1gO2w1f6yZjemZHam5NaYZTY 1059
benchllm-0.3.0.dist-info/WHEEL sha256=vVCvjcmxuUltf8cYhJ0sJMRDLr1XsPuxEId8YDzbyCY 88
benchllm-0.3.0.dist-info/METADATA sha256=zp-26wj7cpchD-IQ1LnuyH6cg6Z2slUlGXvW9Ge4yU4 11084
benchllm-0.3.0.dist-info/entry_points.txt sha256=eHRmCcSFelNL-F6Esf7FgMD0lkpRpbJ4Jb8s6pwV1wM 48
benchllm-0.3.0.dist-info/RECORD

entry_points.txt

bench = benchllm.cli.main:main