Wheelodex » Projects » athina

athina

View on PyPI — Reverse Dependencies (0)

1.2.19 athina-1.2.19-py3-none-any.whl

Wheel Details

Project: athina
Version: 1.2.19
Filename: athina-1.2.19-py3-none-any.whl
Download: [link]
Size: 159047
MD5: d70908c98c19188f2f469695e9ee2738
SHA256: 50743d2f15648cd68c50e6e758ca23c9fbeb32c5f4c86f6c932c9e7e4d459c96
Uploaded: 2024-05-16 19:33:38 +0000

dist-info

METADATA · WHEEL · RECORD · entry_points.txt

METADATA

Metadata-Version: 2.1
Name: athina
Version: 1.2.19
Summary: Python SDK to configure and run evaluations for your LLM-based application
Author: Shiv Sakhuja
Author-Email: shiv[at]athina.ai
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Requires-Python: >=3.9,<4.0
Requires-Dist: colorlog (<7.0.0,>=6.7.0)
Requires-Dist: datasets (<3.0.0,>=2.16.0)
Requires-Dist: langchain (>=0.0.350)
Requires-Dist: langchain-openai (<0.0.4,>=0.0.3)
Requires-Dist: llama-index (<0.10.0,>=0.9.40)
Requires-Dist: openai (<2.0.0,>=1.3.4)
Requires-Dist: pandas
Requires-Dist: pydantic (<3.0,>=2.0)
Requires-Dist: python-dotenv (<2.0.0,>=1.0.0)
Requires-Dist: pyyaml (<7.0.0,>=6.0.1)
Requires-Dist: ragas (<0.0.23,>=0.0.22)
Requires-Dist: requests (<3.0.0,>=2.31.0)
Requires-Dist: retrying (<2.0.0,>=1.3.4)
Requires-Dist: timeout-decorator (<0.6.0,>=0.5.0)
Description-Content-Type: text/markdown
[Description omitted; length: 8584 characters]

WHEEL

Wheel-Version: 1.0
Generator: poetry-core 1.9.0
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
athina/__init__.py sha256=Vven4AvS4Ny8S8Iw7TLQBb5ArNfe8dKtltWH-Wn0Az8 169
athina/cli/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/cli/cli.py sha256=ykOxZ5K-1KcWafwvwd-qpU70yExYd_MkejJWVwRQwvM 5390
athina/constants/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/constants/messages.py sha256=d4TrTc-_BVkT5L-RmbaBYkbZsrZsN3udN8wmXFle_G4 517
athina/datasets/__init__.py sha256=p0SwTw1dn5qpkLuMn5ub_0K1SmV-EED-_rj4Z-HAISE 72
athina/datasets/conversations.json sha256=hLqrOfrVSI6c9sgUFTHfy0YHOH9fPhu7_Km0trS7Q_M 218970
athina/datasets/dataset.py sha256=uKqRKQjZdrCy1FwotHJrm5hPPjJ0Mli1C3SvqfXzEEg 3230
athina/datasets/summarization_sample.py sha256=JjdyEDPAux1WZ-SAwXE_I6d3FkNhxYySrdnkw-spr-k 3355
athina/datasets/yc_query_mini.py sha256=e9LORb04FKooptz3sDUdJfUgCNdREmKJpif_0sKXWVQ 2675
athina/errors/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/errors/exceptions.py sha256=0Ov2pcjw8Xxrg2Xfo0TGzC1Pelz9vqu9oXvxd-wvBrw 801
athina/evals/__init__.py sha256=2bkFsPBNVkoNImnesKLCn_8Yh11yB2nDHDCGSHd4GcA 4069
athina/evals/base_evaluator.py sha256=3TQI0ZM0p8BJGE_tmNUMFtf-3-CGOqlqMwp-1czSzhw 8354
athina/evals/conversation/conversation_coherence/evaluator.py sha256=DgYm1CMrUUtfRHOcKjSCVhrxH53FTXEUmHl_5ISXNls 4259
athina/evals/conversation/conversation_coherence/prompt.py sha256=Ng-W1WX448kFvYIkA3N3tkgwy5TYA9IpVvpgA8w317A 1198
athina/evals/conversation/conversation_resolution/evaluator.py sha256=eh9Nr18Io-tNAqKBb40tzYhTl0FQUtbR93xMfWRfVVI 4414
athina/evals/conversation/conversation_resolution/prompt.py sha256=TIk6PGQtMNKWiEPium7PsAEDWgq6yolv3Z_Lwl08XrY 1104
athina/evals/eval_type.py sha256=rglt47K0hspLRbhAyJ1bLSSrfaHyiHFzIv7LDu0E-iw 2579
athina/evals/function/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/function/function_evaluator.py sha256=6mHLsAVSMe82QEJZzpk9kpUG3-mdY__wHSDo5lfBfV4 3780
athina/evals/function/functions.py sha256=l6n1KoFairKKMFVKsaYqqHPCy7kXAsZZirq2GPTWLEk 18806
athina/evals/function/wrapper.py sha256=hoQ_DcJSoTTtaMlndEl6uom3AhyStEvNrPATvzrxrfo 10216
athina/evals/grounded/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/grounded/grounded_evaluator.py sha256=HiZn6Zw34qGqCa-MT1QfMCuXEtvahHAkuUQULpOKvik 4298
athina/evals/grounded/similarity.py sha256=j5zVb5AGAV7KARcO0dCruk0ObvZU059z55d80kVPVtg 4178
athina/evals/grounded/wrapper.py sha256=Q31iNmPhlCEwkcZtCrurXi92sc9T4yzIVUcaO18jPaQ 1708
athina/evals/guardrails/gibberish_text/evaluator.py sha256=MZgmt8SmrX7dMEa8YfVFLS_hkEpKF9nt4CXoTnWEWLU 3041
athina/evals/guardrails/sensitive_topics/evaluator.py sha256=iG4-8hXAdpc1zgW88ez8ybpL_bcCoL8XY411a1x8vAA 3797
athina/evals/guardrails/sfw/evaluator.py sha256=M-jCAM3aL_HUcS-dztUP-bg4COu8AHvNM5WkQXmv2oY 2965
athina/evals/llm/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/llm/context_contains_enough_information/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/llm/context_contains_enough_information/evaluator.py sha256=EDNZp5nprDzJgK1Vgm1rCtaAUhDao2svRTemyJegVFQ 3004
athina/evals/llm/context_contains_enough_information/examples.py sha256=KcPAR-4w9z6XXG5ijJw1POkMo7YjrPzwetHb9Fvv3zQ 1867
athina/evals/llm/custom_prompt/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/llm/custom_prompt/evaluator.py sha256=wOh3LZFXn74qqFjZpI3JoIaW1M-LYq6s2vIN0iQcdYU 2483
athina/evals/llm/does_response_answer_query/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/llm/does_response_answer_query/evaluator.py sha256=K32mFpsZ0rlLf-p-wXgrGycC1HVJnteEw3TdQdPQmkI 2632
athina/evals/llm/does_response_answer_query/examples.py sha256=2rBMhCmxbrmO6F8RuzkN4Bic_8Lnzan8ctbW3mTB0zs 1186
athina/evals/llm/example.py sha256=01_7F8JBCUK7omvRzM2NoHQ9DoGN06RFkEEEh1rcPh4 1238
athina/evals/llm/faithfulness/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/llm/faithfulness/evaluator.py sha256=buxGhT7c7V33SJHMAIwy-kFQxim9sQSVUdfcwAQq0Ss 2599
athina/evals/llm/faithfulness/examples.py sha256=qX15BXpEPHsMj6SpyAAYl8DhWoXkjCXAZrQ7f9TT0Fk 1335
athina/evals/llm/grading_criteria/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/llm/grading_criteria/evaluator.py sha256=W7bJJHjztxtdKUE2T-M6VIGyiuNyTBehd9ETKXcdQdk 2209
athina/evals/llm/groundedness/evaluator.py sha256=KxcnFq0RmrFuf_Pr8UjKTPOwZAP95W44j6eoIgQ-pC4 5821
athina/evals/llm/groundedness/prompt.py sha256=wDo78uDRtxO0Pgzxoip_T6f-bznZLejsirjpxs2FAvI 1601
athina/evals/llm/llm_evaluator.py sha256=crjXS00pKWdO6iZ2PfINwC8VjLZyuzkwcyVNPK2-QF8 4982
athina/evals/llm/summary_accuracy/evaluator.py sha256=cJuzLH3V-wBNNx8b4xI7c7woRkx7wLwIz2ySA05eNs8 10915
athina/evals/ragas/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/ragas/answer_correctness/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/ragas/answer_correctness/evaluator.py sha256=z2pAJu2kiaF83T-SkkCPOKW8RiVyNiiK7F-JyRY0T8Y 2383
athina/evals/ragas/answer_relevancy/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/ragas/answer_relevancy/evaluator.py sha256=rceIG02LIv2X4xchAbJgEQevqIkaYl3YI1C3jTJciMo 2441
athina/evals/ragas/answer_semantic_similarity/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/ragas/answer_semantic_similarity/evaluator.py sha256=PO9W6P-zpDaKKtO91VNUs2gqGmL-Q1M_V4yLC3yqBmc 2440
athina/evals/ragas/coherence/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/ragas/coherence/evaluator.py sha256=962vTpWnjEQ7zmvftCpZv5QNmfp25iXjUTDcal_xOhM 2187
athina/evals/ragas/conciseness/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/ragas/conciseness/evaluator.py sha256=ydD49fqYXOiPdovE119ZdnbMZb-I7gfMYpUmY3uiuzs 2223
athina/evals/ragas/context_precision/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/ragas/context_precision/evaluator.py sha256=_SP81quCcdtKvwsW0Uy6bJBlh14luSORm9KQibHmzHA 2521
athina/evals/ragas/context_recall/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/ragas/context_recall/evaluator.py sha256=R8wFOeaeT0JSovEtXKuozreSPrRmP0Vq-QS9yAaMo1Y 2316
athina/evals/ragas/context_relevancy/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/ragas/context_relevancy/evaluator.py sha256=Dtj-em67LbA8R07m_1vRTL-Ow3eu8by5LpR45vVkhUA 2159
athina/evals/ragas/faithfulness/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/ragas/faithfulness/evaluator.py sha256=HBNB_ayLdK7WG0uIhMCRlgkeSCPoNgsOjUT5y2xsKXk 2370
athina/evals/ragas/harmfulness/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/ragas/harmfulness/evaluator.py sha256=6AWRngzApS18vqSuE9YqHZCFvoHRDBrfk40T28j2M0M 2164
athina/evals/ragas/maliciousness/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/ragas/maliciousness/evaluator.py sha256=GxXrWoe6oV-UgHc-etIDbRjYpvVsZkIovHNM1_VDPQU 2127
athina/evals/ragas/ragas_evaluator.py sha256=yv-s1gGfZ_EcimXITF0-97h035-A8d0YX2Csc9e71wM 3298
athina/evals/safety/content_moderation/evaluator.py sha256=-oFVoEm5MOSIWUJq381T5VSCArQ8GQBvc-RLEUjZUfU 5154
athina/evals/safety/pii_detection/evaluator.py sha256=gAat9Z5_J25_Y36pIBsEEn6QSUrHcPxy6zfeOH4yk_s 3387
athina/evals/safety/prompt_injection/evaluator.py sha256=NLNsfP1MLIVSX6jTTvEP0OJWkE6dhyjBsU7H575Lt5g 4370
athina/guard/exception.py sha256=sBia39bL6dUqh2gol7vCzMA2BWuFAdDwMQ9KZObjB7M 106
athina/guard/guard.py sha256=Jl4fuqzXgnNP8wGSxGxuU0r2Y0HGBnpf2VtrxvuA51c 1404
athina/helpers/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/helpers/athina_logging_helper.py sha256=SnfFwzKjhbXU-f9-jwupmK5vneYPKv5P_jc9lLBW8uU 5739
athina/helpers/config.py sha256=0Jfs_Q0JyT2hsUdsaROnCnqI1_y1wGgG8vxD__UcSF0 1351
athina/helpers/constants.py sha256=8CjbzQLEebvIvk_UXizp1E-19o6CfDVCVwwxwhOWPEI 122
athina/helpers/dataset_helper.py sha256=QHU5ZALU029ZX9WaOB4cYLdoUqV_4wPwmIO0x981Ms4 790
athina/helpers/eval_helper.py sha256=htPNscTQGvJc_2XB3t9APx1ajdQTNd8L3gPCEQF09kA 172
athina/helpers/function_eval_util.py sha256=m9ixtk6siwLuA-fkCzkVqpH8diEgzFENTSNjbzZqaNo 642
athina/helpers/get_evaluator.py sha256=GPU13b5UrkY-SDlokNxDzOVQgcExsgTtCMDSeovy3Tg 4591
athina/helpers/json.py sha256=iHJTzHCi0BpmiZLVcDBR5DR0NQrDYhDYyCi79Oje9zg 1190
athina/helpers/kwparser.py sha256=hR0F-c-Qman2BZDFZ3OFgPP9QIXK4IA622EYFef5mZc 403
athina/helpers/loader_helper.py sha256=IWSGTaf9T3-qG8Ty1EYLALau0nMLR1ItsdRRCM-zm00 894
athina/helpers/logger.py sha256=Lw2igupmAQzTAe9ko1rewiGDwiDCsOBiw8eiSk7HJpE 3051
athina/helpers/package_helper.py sha256=GI0XAx8DvQqwoVpNYqSLggLWiGOnoCG81tdnkvzEbw8 265
athina/helpers/run_helper.py sha256=TVYyQOAjoYAG1b-UmtDTSwCjEhdxPjWhy_7XmUbWlFE 5296
athina/interfaces/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/interfaces/athina.py sha256=U9bhm6ne5aFBdEu0uGgLFXsEOEQiy0RMfSQ9MYxBcF8 3905
athina/interfaces/data.py sha256=LIf9YAAmHXnzXPNRrX4ptJEF7ax_jeW1abTmzdl_llw 132
athina/interfaces/model.py sha256=-uHvNk8kqmh2u397xZ3aFZGp-5yeDfLnuOhJwwDBJUE 2065
athina/interfaces/openai.py sha256=HBpVXmSy5AsLaaXKDgs6w39kzF4E55Pp_0-hwy1-RFU 100
athina/interfaces/result.py sha256=C42A06yxEtVAUBUIpnicqEHQfR2ma3xDWYkEu0WBMIM 2944
athina/keys/__init__.py sha256=EAwG5ZQ0z-OGNXCnHccU5wJrqd4WKf12Q45RQ3TPzEg 126
athina/keys/athina_api_key.py sha256=DmY20qgJmrDiLQejcrLuGhkAkkM-KBUAG1JymPvSYiw 322
athina/keys/openai_api_key.py sha256=KWLbryn5UdKzs3ZEegkvKyl-QkGjzd21iwOWnyReRg8 236
athina/llms/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/llms/abstract_llm_service.py sha256=73YES1AmXqFnY4SBOdf-0kVchxfeV5z9MzBZjKjrhsc 1398
athina/llms/openai_service.py sha256=oNN6zQwMQp3fRNL4ihoSzeqWL8iQ5yCxxdwtP3dcku0 3342
athina/llms/question_answerer.py sha256=6DAAGW9YOwT0aMF5wmaW5GMgPN4l5G7gqyoX2QtjUIM 337
athina/llms/question_answerer_bulk.py sha256=j9XxwDAwMHo5nlgGjl6yv95enk5SzFJU-wKNmwpsd_k 2874
athina/llms/question_answerer_cot.py sha256=4xtijybnZhMgKVlZ9Pvn6dj_BYy2tYR_uDYxKMBdcsA 3675
athina/llms/question_answerer_with_retrieval.py sha256=UxdKL3ZA049po6rXhiK2UJ2wipV73LDXup-OD6j3k1Y 6674
athina/llms/question_generator.py sha256=urgJnpLlOo9rAR0KvDjtIk22w8Daqlxt__DY4_ldcas 2402
athina/loaders/__init__.py sha256=qY2dXk7PyWV8jHUB4keH3yJu4XaF5Dff4ave13flcxY 323
athina/loaders/base_loader.py sha256=YBsXnH2vLyltB6A9o-Gmo2FCouAvmEPJy-jCA-55Rgk 2326
athina/loaders/conversation_loader.py sha256=gdYMJQenkWvbiZhzXIN8b9cdvECVJ2sBVdzhsdK0WrU 2179
athina/loaders/loader.py sha256=XniB3L6i1xFNtdKoKbY_GEge6xb9QQLmSnQpjwOItdg 6507
athina/loaders/response_loader.py sha256=eMvdHdeN9ytnQksHKHOXI3u1QzRzirTlcH-EadOk9KM 3597
athina/loaders/summary_loader.py sha256=egj09ngxGKWc3r-S0MwqBYLyMPlP91gpbN3-LrYy8wQ 2970
athina/loaders/text_loader.py sha256=i5ZwTJ9m0SuQNStOSA9RAqe69JQMX17dxUdqpVTv8pA 2380
athina/metrics/agreement_score.py sha256=5tCT5wFrOVoSmU9XjgMrmeDSUIy1aKqnA0UOr7B46lY 1854
athina/metrics/contradiction_score.py sha256=W4gKXyTQUvcsUzRpSJKqS761JomJcFGusgJ0AaicbnA 2448
athina/metrics/groundedness.py sha256=EypZc_CYw_LMKfmL_z1-Mc5h8f3A7G9gUzWbcSkZVks 1342
athina/metrics/hallucination_score.py sha256=OKbjKmfyb2aMrZ_LUgc-cpN_JPGUDc6-3hnNk-wgmqg 2209
athina/metrics/metric.py sha256=xHiTNgXaNZ24AeaZnS4qDwOFF6NHY97zMt_8QWT7nmU 246
athina/metrics/metric_type.py sha256=DIUzAiDsIQY9hS-2fkKx9IeMFBY5gFl5jIwJ9EGJ5Vs 3000
athina/metrics/passed.py sha256=kIAzvqvjk1xqq0mQ0M0hw_kEok7sfaQANQB_g2IbOUo 393
athina/metrics/ragas_metric.py sha256=Ur2vq0lnJHZ2nGODXzi4acAx3oyIr12wpmN4p-r11Yw 275
athina/metrics/similarity_score.py sha256=YgNQqFhTqMNJ7jZyNcsG8JvMrvd9txG4PAHICDjtDnY 509
athina/runner/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/runner/run.py sha256=8ICxb9NcslKFBHWzzEtprxxjcBAVt8iamClRbdZDKW0 6940
athina/runner/run_wrapper.py sha256=QYwyET2ihAFGOUxjH7LoJl2BDUguID-ykP9d5WwHG4M 341
athina/scripts/guardrails.py sha256=KF5ZidTq5sOS-fc_bFDTlPEmGbIGWHAGuLg9C-vvNLg 1781
athina/services/athina_api_service.py sha256=wh6jckbwXNj7ba5Y-pwzMlqSj1rU41r5MEjhQ1649Tc 13804
athina-1.2.19.dist-info/METADATA sha256=fG_ll54uR3Xo8VZOq0NwRZ-kyRgIv4bw2CVlAqdtDAc 9672
athina-1.2.19.dist-info/WHEEL sha256=sP946D7jFCHeNz5Iq4fL4Lu-PrWrFsgfLXbbkciIZwg 88
athina-1.2.19.dist-info/entry_points.txt sha256=1Tzv6b93drY0K80MYyVAUlG-LDhNvRr_hmAP3zUpQ-g 99
athina-1.2.19.dist-info/RECORD — —

entry_points.txt

[console_scripts]
athina = athina.cli.cli:main
install_guardrails = athina.scripts.guardrails:install