continuous-eval

View on PyPIReverse Dependencies (0)

0.3.7 continuous_eval-0.3.7-py3-none-any.whl

Wheel Details

Project: continuous-eval
Version: 0.3.7
Filename: continuous_eval-0.3.7-py3-none-any.whl
Download: [link]
Size: 54382
MD5: 97df817f56257bffe0cd86681c1deb8e
SHA256: 4f4ef3e52ee661d308598b55aeb77d373aea490b71df1ad649c2868b01dcd593
Uploaded: 2024-04-25 01:40:28 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: continuous-eval
Version: 0.3.7
Summary: Open-Source Evaluation for GenAI Application Pipelines.
Author: Yi Zhang
Author-Email: yi[at]relari.ai
License: Apache-2.0
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Requires-Python: >=3.9,<4.0
Requires-Dist: anthropic (<0.8.0,>=0.7.7); extra == "anthropic"
Requires-Dist: appdirs (<2.0.0,>=1.4.4)
Requires-Dist: boto3 (<2.0.0,>=1.34.70); extra == "bedrock"
Requires-Dist: chromadb (<0.5.0,>=0.4.21); extra == "generators"
Requires-Dist: cohere (<5.0,>=4.54); extra == "cohere"
Requires-Dist: google-generativeai (<0.4.0,>=0.3.1); extra == "gemini"
Requires-Dist: imbalanced-learn (<0.12.0,>=0.11.0)
Requires-Dist: langchain-community (<0.0.30,>=0.0.29); extra == "langchain" or extra == "generators"
Requires-Dist: mapie (<0.8.0,>=0.7.0)
Requires-Dist: munkres (<2.0.0,>=1.1.4)
Requires-Dist: nltk (<4.0.0,>=3.8.1)
Requires-Dist: openai (<2.0.0,>=1.3.7)
Requires-Dist: pandas (<3.0.0,>=2.1.4)
Requires-Dist: pinecone-client (<3.0.0,>=2.2.4); extra == "generators"
Requires-Dist: protobuf (<5.0.0,>=4.23.4)
Requires-Dist: python-dotenv (<2.0.0,>=1.0.0)
Requires-Dist: pyyaml (<7.0.0,>=6.0.1)
Requires-Dist: requests (<3.0.0,>=2.31.0)
Requires-Dist: rouge (<2.0.0,>=1.0.1)
Requires-Dist: sentence-transformers (<3.0.0,>=2.2.2); extra == "semantic"
Requires-Dist: sentencepiece (<0.3.0,>=0.2.0)
Requires-Dist: tenacity (<9.0.0,>=8.2.3)
Requires-Dist: thefuzz (<0.23.0,>=0.22.1)
Requires-Dist: tiktoken (<0.6.0,>=0.5.2); extra == "generators"
Requires-Dist: torch (<3.0.0,>=2.1.1); extra == "semantic"
Requires-Dist: tqdm (<5.0.0,>=4.66.1)
Requires-Dist: transformers (<5.0.0,>=4.35.2); extra == "semantic"
Requires-Dist: unstructured (<0.12.0,>=0.11.6); extra == "generators"
Provides-Extra: anthropic
Provides-Extra: bedrock
Provides-Extra: cohere
Provides-Extra: gemini
Provides-Extra: generators
Provides-Extra: langchain
Provides-Extra: semantic
Description-Content-Type: text/markdown
[Description omitted; length: 9138 characters]

WHEEL

Wheel-Version: 1.0
Generator: poetry-core 1.8.1
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
continuous_eval/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
continuous_eval/classifiers/__init__.py sha256=vju5nKRUciCCdM9ueVKb2MmpUtvvSzZff05MaI4A6qg 64
continuous_eval/classifiers/ensemble.py sha256=DqUs8P0CFlb7w-2b0ZWwERJ_mz0JJjw-kM74H42p4yc 3058
continuous_eval/classifiers/utils.py sha256=HPiqAe5ovUwDCXd3fM_GYSXafjl-MVo3x4E8LM8WHKY 652
continuous_eval/data_downloader.py sha256=De_MIWqByV4U1JzDMRtXa2aWgofGzWHYtfhCGDJ3CIA 3031
continuous_eval/datatypes.py sha256=oTuHrvcaSnGPK--rsPttTP4frhbtmGcMQw6AqoaZQWE 3609
continuous_eval/eval/__init__.py sha256=EDCVHd-eXESy6nsGcayrK2i5ICpQ2YhkOP7F3hrkqo4 251
continuous_eval/eval/dataset.py sha256=R5HelEsH0XNfazkOpPBigahHEU4D51o90Mf0PJcS6To 6234
continuous_eval/eval/manager.py sha256=vVzyDl14OEhmlCYlHdKIZ-pB2C3yQc7KgKNGFvnVfSA 9394
continuous_eval/eval/modules.py sha256=KFJtDeaGeH0KLliKWzp9xGnTJ-ONnslxy3i5lE8vSyQ 1627
continuous_eval/eval/pipeline.py sha256=IM2xii7r84-LPdmxteqqZ188CGlqh5i9fA3bmaJgAi0 4539
continuous_eval/eval/result_types.py sha256=ZHWtn-Z9o687w8xwH6yC8CFYNP6Xf-hXVJcuk2eyerc 4420
continuous_eval/eval/tests.py sha256=_2bdIxGHCZI19Mt2aZk6dM5a9VGvnh2SNWi7PnMcr0c 1380
continuous_eval/eval/types.py sha256=ezA0zSzq409E4MoxiRDNM8_Zsm-JQ_Qrn7y4yFGz8Vg 122
continuous_eval/eval/utils.py sha256=xxL3e1bVeb7X2Wn6-xDeo5nuWbaPZqHeUbgafazrnNo 1107
continuous_eval/generators/__init__.py sha256=zZWxr8KwTPAkH7HB6aqtvTD5FR-BjXw8hJCs1z7Pmnk 69
continuous_eval/generators/simple.py sha256=_oq_ygZySfemEgDxUorZINtI8GwME-dFV5PFY_0poQQ 12800
continuous_eval/llm_factory.py sha256=YwP73QM1I6oFPyHyZg5HCDA060kIF1wfrs6w-h5qMxc 10016
continuous_eval/llms/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
continuous_eval/llms/bedrock.py sha256=ISbwhBzbCupDt4Qj_7WqEoswH79_NTvKscFkD6xFvJM 780
continuous_eval/metrics/__init__.py sha256=FHXdlaQTVvuvX7kjwrNyRah-_8OgI8NNQKr-WvZbPIo 48
continuous_eval/metrics/_utils/simple_tokenizer.py sha256=4CytFsfPBTTw97jzqQGi0tdhcKpGMJJVQMBu1R67lEQ 1732
continuous_eval/metrics/base.py sha256=J3WkAzgE8dHMtyfollRNsclSufadSDaJmTPItm-mXak 2471
continuous_eval/metrics/classification/__init__.py sha256=ogseSWBt3vFKSYcpNgqH749rM4vRuMCprJMqivoj_hM 91
continuous_eval/metrics/classification/classification.py sha256=YpN3MKquWDUzbPK157iVDhOZe3h4HUlc8bjf5cDQtfs 2233
continuous_eval/metrics/code/python/__init__.py sha256=-cfwxFXIld6Um8pW1fcfFRsW-ZCNZTE7guiz5JpAPlw 111
continuous_eval/metrics/code/python/code_deterministic_metrics.py sha256=lK0ek5YPmzylqYJJVQ8wu-425GV7wmAv5QQXpK9WikM 11635
continuous_eval/metrics/generation/text/__init__.py sha256=3odPYt_ZOi5izEyn4Rd41yBPC7om67qMwlBDLHQX8kg 678
continuous_eval/metrics/generation/text/bert.py sha256=AQFeUEI5gGtMovvvjoAo1AVyvx_4iXRbwbU3-oEdlbo 3109
continuous_eval/metrics/generation/text/custom.py sha256=9Gjo-GdKQ50pbSeJBvue3HJBZxVxU-LTiLcYLm8jzyU 2879
continuous_eval/metrics/generation/text/deterministic.py sha256=_4fBC1HotKO8w1-0QzcH4TU1xkKIjJ3We-_1Cimu_to 4814
continuous_eval/metrics/generation/text/llm_based.py sha256=VdoNvrxRDpdODh3vS6B01hK-2TpnTXJmPQy7mXlreWE 11472
continuous_eval/metrics/generation/text/semantic.py sha256=ic7jp0QffSE2UMvm6oi5CHuGGNjObk5gJ3F88H2vlas 5741
continuous_eval/metrics/generation/text/utils.py sha256=1OBciJOheYvYpCgN8p0l_40WE-qx6fsT2HyG5U1Y-CE 2865
continuous_eval/metrics/retrieval/__init__.py sha256=5JxHih8TsTGCVBbQpeu54hOPawOk_f_hJDrXL88ZuNI 437
continuous_eval/metrics/retrieval/llm_based.py sha256=VrrxMHVQ2U0w0x94BYRNaaEiLGIc6y1iNzJ1eFs1hFg 6541
continuous_eval/metrics/retrieval/matching_strategy.py sha256=QTGYWVM3ZOVQh_EOJbiJzXYS6FTHJUtBDkJu1CQ8PIo 1918
continuous_eval/metrics/retrieval/precision_recall_f1.py sha256=XrUYWiIUrE2ii339LFppk4wJZ1ykrefucK4jv749ans 2470
continuous_eval/metrics/retrieval/ranked.py sha256=XF1_T-y5bg825jp2a3OU8oQ4_kwSTAwswcq_VW_zOBI 3394
continuous_eval/metrics/tools/match.py sha256=3u988dmANffvmyQXunM4fX0aixgzAWFa5q6XxbMXBSQ 1500
continuous_eval/utils/telemetry.py sha256=2qVQz3gHeLevMmGLCe_-XNf-6JW2HlyMNFEWLb_Tpiw 4013
continuous_eval-0.3.7.dist-info/LICENSE sha256=xx0jnfkXJvxRnG63LTGOxlggYnIysveWIZ6H3PNdCrQ 11357
continuous_eval-0.3.7.dist-info/METADATA sha256=gRrYV4VsR2DOk8mTV71V1yn3GprM3C5Nss7uPB0KDrI 11375
continuous_eval-0.3.7.dist-info/WHEEL sha256=FMvqSimYX_P7y0a7UY-_Mc83r5zkBZsCYPm7Lr0Bsq4 88
continuous_eval-0.3.7.dist-info/RECORD