Wheelodex » Projects » athina

athina

View on PyPI — Reverse Dependencies (0)

1.2.14 athina-1.2.14-py3-none-any.whl

Wheel Details

Project: athina
Version: 1.2.14
Filename: athina-1.2.14-py3-none-any.whl
Download: [link]
Size: 157788
MD5: 2ce2f4956c4c927220ed36ca1b4152ae
SHA256: 8f7d14894033bad4b44b3695e1ba61c166ea688847a487248ba28627e3fb78c1
Uploaded: 2024-04-19 07:16:22 +0000

dist-info

METADATA · WHEEL · RECORD · entry_points.txt

METADATA

Metadata-Version: 2.1
Name: athina
Version: 1.2.14
Summary: Python SDK to configure and run evaluations for your LLM-based application
Author: Shiv Sakhuja
Author-Email: shiv[at]athina.ai
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Requires-Python: >=3.9,<4.0
Requires-Dist: colorlog (<7.0.0,>=6.7.0)
Requires-Dist: datasets (<3.0.0,>=2.16.0)
Requires-Dist: langchain (>=0.0.350)
Requires-Dist: langchain-openai (<0.0.4,>=0.0.3)
Requires-Dist: llama-index (<0.10.0,>=0.9.40)
Requires-Dist: openai (<2.0.0,>=1.3.4)
Requires-Dist: pandas
Requires-Dist: python-dotenv (<2.0.0,>=1.0.0)
Requires-Dist: pyyaml (<7.0.0,>=6.0.1)
Requires-Dist: ragas (<0.0.23,>=0.0.22)
Requires-Dist: requests (<3.0.0,>=2.31.0)
Requires-Dist: retrying (<2.0.0,>=1.3.4)
Requires-Dist: timeout-decorator (<0.6.0,>=0.5.0)
Description-Content-Type: text/markdown
[Description omitted; length: 8584 characters]

WHEEL

Wheel-Version: 1.0
Generator: poetry-core 1.9.0
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
athina/__init__.py sha256=Vven4AvS4Ny8S8Iw7TLQBb5ArNfe8dKtltWH-Wn0Az8 169
athina/benchmark/eval_performance_calculator.py sha256=ndkb6TCy-DYx1V3LRDZdFER8Bi81Xbcttb8LJKu7bjA 2938
athina/cli/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/cli/cli.py sha256=ykOxZ5K-1KcWafwvwd-qpU70yExYd_MkejJWVwRQwvM 5390
athina/constants/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/constants/messages.py sha256=d4TrTc-_BVkT5L-RmbaBYkbZsrZsN3udN8wmXFle_G4 517
athina/datasets/__init__.py sha256=p0SwTw1dn5qpkLuMn5ub_0K1SmV-EED-_rj4Z-HAISE 72
athina/datasets/conversations.json sha256=hLqrOfrVSI6c9sgUFTHfy0YHOH9fPhu7_Km0trS7Q_M 218970
athina/datasets/dataset.py sha256=3r67qtYohpqqEfa2Rm4JobSYCuFL_LW9hiwf6T6nDEk 2971
athina/datasets/summarization_sample.py sha256=JjdyEDPAux1WZ-SAwXE_I6d3FkNhxYySrdnkw-spr-k 3355
athina/datasets/yc_query_mini.py sha256=e9LORb04FKooptz3sDUdJfUgCNdREmKJpif_0sKXWVQ 2675
athina/errors/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/errors/exceptions.py sha256=0Ov2pcjw8Xxrg2Xfo0TGzC1Pelz9vqu9oXvxd-wvBrw 801
athina/evals/__init__.py sha256=2bkFsPBNVkoNImnesKLCn_8Yh11yB2nDHDCGSHd4GcA 4069
athina/evals/base_evaluator.py sha256=-0Df3gHeHt6PUdIDVDDQwh5QjwAz5OdzVlwbiEQKYLg 7508
athina/evals/conversation/conversation_coherence/evaluator.py sha256=skmVTBJrAXyzeYLrHMEa0e7IMjm_m4qXgRFaJMzizRE 4253
athina/evals/conversation/conversation_coherence/prompt.py sha256=Ng-W1WX448kFvYIkA3N3tkgwy5TYA9IpVvpgA8w317A 1198
athina/evals/conversation/conversation_resolution/evaluator.py sha256=CTQlJIrNW2td_uMzxmDrKFAAJtA4RzEhtc7mSbjyhGQ 4408
athina/evals/conversation/conversation_resolution/prompt.py sha256=TIk6PGQtMNKWiEPium7PsAEDWgq6yolv3Z_Lwl08XrY 1104
athina/evals/eval_type.py sha256=rglt47K0hspLRbhAyJ1bLSSrfaHyiHFzIv7LDu0E-iw 2579
athina/evals/function/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/function/function_evaluator.py sha256=6ydaa4DfIVxQtRwm50-kLHq3qzBybKjLpMSrRgtQBsY 3599
athina/evals/function/functions.py sha256=l6n1KoFairKKMFVKsaYqqHPCy7kXAsZZirq2GPTWLEk 18806
athina/evals/function/wrapper.py sha256=hoQ_DcJSoTTtaMlndEl6uom3AhyStEvNrPATvzrxrfo 10216
athina/evals/grounded/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/grounded/grounded_evaluator.py sha256=ykwrtp5MYYygXTd_yWCV7Um0RxabmvtR2clWgmjhATc 4026
athina/evals/grounded/similarity.py sha256=j5zVb5AGAV7KARcO0dCruk0ObvZU059z55d80kVPVtg 4178
athina/evals/grounded/wrapper.py sha256=Q31iNmPhlCEwkcZtCrurXi92sc9T4yzIVUcaO18jPaQ 1708
athina/evals/guardrails/gibberish_text/evaluator.py sha256=HMS16KXPFbCFFY3jqY0Cm3R_YTHcAeLx82Mj3YuD0wo 2961
athina/evals/guardrails/sensitive_topics/evaluator.py sha256=ASIh2aFJ6gEvNQrmyXKgOA-xTXTj_5yJLaUlHg8cXuY 3727
athina/evals/guardrails/sfw/evaluator.py sha256=sP5qZgcOAGo9Mem6qJKHkkIiKJrADMdY8exBmWe_M6Y 2885
athina/evals/llm/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/llm/context_contains_enough_information/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/llm/context_contains_enough_information/evaluator.py sha256=AEbaF8X0vfJ-g5sllFXfKkO1HyKGkBLUofaoF4teIP0 2671
athina/evals/llm/context_contains_enough_information/examples.py sha256=KcPAR-4w9z6XXG5ijJw1POkMo7YjrPzwetHb9Fvv3zQ 1867
athina/evals/llm/custom_prompt/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/llm/custom_prompt/evaluator.py sha256=W_MiRI6EDFQ7nr05eiqNtZANtEpfjXOaW0jWn8u4DWk 2362
athina/evals/llm/does_response_answer_query/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/llm/does_response_answer_query/evaluator.py sha256=K32mFpsZ0rlLf-p-wXgrGycC1HVJnteEw3TdQdPQmkI 2632
athina/evals/llm/does_response_answer_query/examples.py sha256=2rBMhCmxbrmO6F8RuzkN4Bic_8Lnzan8ctbW3mTB0zs 1186
athina/evals/llm/example.py sha256=01_7F8JBCUK7omvRzM2NoHQ9DoGN06RFkEEEh1rcPh4 1238
athina/evals/llm/faithfulness/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/llm/faithfulness/evaluator.py sha256=buxGhT7c7V33SJHMAIwy-kFQxim9sQSVUdfcwAQq0Ss 2599
athina/evals/llm/faithfulness/examples.py sha256=qX15BXpEPHsMj6SpyAAYl8DhWoXkjCXAZrQ7f9TT0Fk 1335
athina/evals/llm/grading_criteria/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/llm/grading_criteria/evaluator.py sha256=KnALbk0XADDcaREx_cH5lw1xoDdPgGdfAShcRUCTS-k 2080
athina/evals/llm/groundedness/evaluator.py sha256=KxcnFq0RmrFuf_Pr8UjKTPOwZAP95W44j6eoIgQ-pC4 5821
athina/evals/llm/groundedness/prompt.py sha256=wDo78uDRtxO0Pgzxoip_T6f-bznZLejsirjpxs2FAvI 1601
athina/evals/llm/llm_evaluator.py sha256=crjXS00pKWdO6iZ2PfINwC8VjLZyuzkwcyVNPK2-QF8 4982
athina/evals/llm/summary_accuracy/evaluator.py sha256=cJuzLH3V-wBNNx8b4xI7c7woRkx7wLwIz2ySA05eNs8 10915
athina/evals/ragas/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/ragas/answer_correctness/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/ragas/answer_correctness/evaluator.py sha256=z2pAJu2kiaF83T-SkkCPOKW8RiVyNiiK7F-JyRY0T8Y 2383
athina/evals/ragas/answer_relevancy/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/ragas/answer_relevancy/evaluator.py sha256=rceIG02LIv2X4xchAbJgEQevqIkaYl3YI1C3jTJciMo 2441
athina/evals/ragas/answer_semantic_similarity/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/ragas/answer_semantic_similarity/evaluator.py sha256=PO9W6P-zpDaKKtO91VNUs2gqGmL-Q1M_V4yLC3yqBmc 2440
athina/evals/ragas/coherence/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/ragas/coherence/evaluator.py sha256=962vTpWnjEQ7zmvftCpZv5QNmfp25iXjUTDcal_xOhM 2187
athina/evals/ragas/conciseness/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/ragas/conciseness/evaluator.py sha256=ydD49fqYXOiPdovE119ZdnbMZb-I7gfMYpUmY3uiuzs 2223
athina/evals/ragas/context_precision/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/ragas/context_precision/evaluator.py sha256=_SP81quCcdtKvwsW0Uy6bJBlh14luSORm9KQibHmzHA 2521
athina/evals/ragas/context_recall/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/ragas/context_recall/evaluator.py sha256=R8wFOeaeT0JSovEtXKuozreSPrRmP0Vq-QS9yAaMo1Y 2316
athina/evals/ragas/context_relevancy/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/ragas/context_relevancy/evaluator.py sha256=Dtj-em67LbA8R07m_1vRTL-Ow3eu8by5LpR45vVkhUA 2159
athina/evals/ragas/faithfulness/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/ragas/faithfulness/evaluator.py sha256=HBNB_ayLdK7WG0uIhMCRlgkeSCPoNgsOjUT5y2xsKXk 2370
athina/evals/ragas/harmfulness/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/ragas/harmfulness/evaluator.py sha256=6AWRngzApS18vqSuE9YqHZCFvoHRDBrfk40T28j2M0M 2164
athina/evals/ragas/maliciousness/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/evals/ragas/maliciousness/evaluator.py sha256=GxXrWoe6oV-UgHc-etIDbRjYpvVsZkIovHNM1_VDPQU 2127
athina/evals/ragas/ragas_evaluator.py sha256=yv-s1gGfZ_EcimXITF0-97h035-A8d0YX2Csc9e71wM 3298
athina/evals/safety/content_moderation/evaluator.py sha256=-oFVoEm5MOSIWUJq381T5VSCArQ8GQBvc-RLEUjZUfU 5154
athina/evals/safety/pii_detection/evaluator.py sha256=gAat9Z5_J25_Y36pIBsEEn6QSUrHcPxy6zfeOH4yk_s 3387
athina/evals/safety/prompt_injection/evaluator.py sha256=NLNsfP1MLIVSX6jTTvEP0OJWkE6dhyjBsU7H575Lt5g 4370
athina/guard/exception.py sha256=sBia39bL6dUqh2gol7vCzMA2BWuFAdDwMQ9KZObjB7M 106
athina/guard/guard.py sha256=Jl4fuqzXgnNP8wGSxGxuU0r2Y0HGBnpf2VtrxvuA51c 1404
athina/helpers/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/helpers/athina_logging_helper.py sha256=BAZxLUJVM5G6x9IB7knJdZFQfGo1Z4k2Fbmjar5bi10 4446
athina/helpers/config.py sha256=0Jfs_Q0JyT2hsUdsaROnCnqI1_y1wGgG8vxD__UcSF0 1351
athina/helpers/constants.py sha256=8CjbzQLEebvIvk_UXizp1E-19o6CfDVCVwwxwhOWPEI 122
athina/helpers/eval_helper.py sha256=htPNscTQGvJc_2XB3t9APx1ajdQTNd8L3gPCEQF09kA 172
athina/helpers/function_eval_util.py sha256=m9ixtk6siwLuA-fkCzkVqpH8diEgzFENTSNjbzZqaNo 642
athina/helpers/get_evaluator.py sha256=GPU13b5UrkY-SDlokNxDzOVQgcExsgTtCMDSeovy3Tg 4591
athina/helpers/json.py sha256=iHJTzHCi0BpmiZLVcDBR5DR0NQrDYhDYyCi79Oje9zg 1190
athina/helpers/kwparser.py sha256=hR0F-c-Qman2BZDFZ3OFgPP9QIXK4IA622EYFef5mZc 403
athina/helpers/loader_helper.py sha256=IWSGTaf9T3-qG8Ty1EYLALau0nMLR1ItsdRRCM-zm00 894
athina/helpers/logger.py sha256=Lw2igupmAQzTAe9ko1rewiGDwiDCsOBiw8eiSk7HJpE 3051
athina/helpers/package_helper.py sha256=GI0XAx8DvQqwoVpNYqSLggLWiGOnoCG81tdnkvzEbw8 265
athina/helpers/run_helper.py sha256=TVYyQOAjoYAG1b-UmtDTSwCjEhdxPjWhy_7XmUbWlFE 5296
athina/interfaces/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/interfaces/athina.py sha256=U9bhm6ne5aFBdEu0uGgLFXsEOEQiy0RMfSQ9MYxBcF8 3905
athina/interfaces/data.py sha256=LIf9YAAmHXnzXPNRrX4ptJEF7ax_jeW1abTmzdl_llw 132
athina/interfaces/model.py sha256=OVf8dH-dUxIqoZr93aeIaLW07DH0m8Pan0iZsBDeKPg 1768
athina/interfaces/openai.py sha256=HBpVXmSy5AsLaaXKDgs6w39kzF4E55Pp_0-hwy1-RFU 100
athina/interfaces/result.py sha256=C42A06yxEtVAUBUIpnicqEHQfR2ma3xDWYkEu0WBMIM 2944
athina/keys/__init__.py sha256=EAwG5ZQ0z-OGNXCnHccU5wJrqd4WKf12Q45RQ3TPzEg 126
athina/keys/athina_api_key.py sha256=DmY20qgJmrDiLQejcrLuGhkAkkM-KBUAG1JymPvSYiw 322
athina/keys/openai_api_key.py sha256=KWLbryn5UdKzs3ZEegkvKyl-QkGjzd21iwOWnyReRg8 236
athina/llms/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/llms/abstract_llm_service.py sha256=73YES1AmXqFnY4SBOdf-0kVchxfeV5z9MzBZjKjrhsc 1398
athina/llms/openai_service.py sha256=oNN6zQwMQp3fRNL4ihoSzeqWL8iQ5yCxxdwtP3dcku0 3342
athina/llms/question_answerer.py sha256=6DAAGW9YOwT0aMF5wmaW5GMgPN4l5G7gqyoX2QtjUIM 337
athina/llms/question_answerer_bulk.py sha256=j9XxwDAwMHo5nlgGjl6yv95enk5SzFJU-wKNmwpsd_k 2874
athina/llms/question_answerer_cot.py sha256=4xtijybnZhMgKVlZ9Pvn6dj_BYy2tYR_uDYxKMBdcsA 3675
athina/llms/question_answerer_with_retrieval.py sha256=UxdKL3ZA049po6rXhiK2UJ2wipV73LDXup-OD6j3k1Y 6674
athina/llms/question_generator.py sha256=urgJnpLlOo9rAR0KvDjtIk22w8Daqlxt__DY4_ldcas 2402
athina/loaders/__init__.py sha256=qY2dXk7PyWV8jHUB4keH3yJu4XaF5Dff4ave13flcxY 323
athina/loaders/base_loader.py sha256=BrF2T1HaC3MqeooTchKa0vT3I_rIaDoFLqgxQUTyV_0 2126
athina/loaders/conversation_loader.py sha256=eWPDtZQTwru_DePt3y6x8E90sAWeCxkPoATqv6qFFcA 2173
athina/loaders/loader.py sha256=lc_LShFUJeiz5RATp6A1z9PBs_q70_xnQYwEY3q9ciw 4355
athina/loaders/response_loader.py sha256=x8FoNn8vs3O1KeJPldHOf2xAn1G7rfGXy1kHhtcsh3k 3501
athina/loaders/summary_loader.py sha256=egj09ngxGKWc3r-S0MwqBYLyMPlP91gpbN3-LrYy8wQ 2970
athina/loaders/text_loader.py sha256=i5ZwTJ9m0SuQNStOSA9RAqe69JQMX17dxUdqpVTv8pA 2380
athina/metrics/agreement_score.py sha256=5tCT5wFrOVoSmU9XjgMrmeDSUIy1aKqnA0UOr7B46lY 1854
athina/metrics/contradiction_score.py sha256=W4gKXyTQUvcsUzRpSJKqS761JomJcFGusgJ0AaicbnA 2448
athina/metrics/groundedness.py sha256=EypZc_CYw_LMKfmL_z1-Mc5h8f3A7G9gUzWbcSkZVks 1342
athina/metrics/hallucination_score.py sha256=OKbjKmfyb2aMrZ_LUgc-cpN_JPGUDc6-3hnNk-wgmqg 2209
athina/metrics/metric.py sha256=xHiTNgXaNZ24AeaZnS4qDwOFF6NHY97zMt_8QWT7nmU 246
athina/metrics/metric_type.py sha256=DIUzAiDsIQY9hS-2fkKx9IeMFBY5gFl5jIwJ9EGJ5Vs 3000
athina/metrics/passed.py sha256=kIAzvqvjk1xqq0mQ0M0hw_kEok7sfaQANQB_g2IbOUo 393
athina/metrics/ragas_metric.py sha256=Ur2vq0lnJHZ2nGODXzi4acAx3oyIr12wpmN4p-r11Yw 275
athina/metrics/similarity_score.py sha256=YgNQqFhTqMNJ7jZyNcsG8JvMrvd9txG4PAHICDjtDnY 509
athina/runner/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
athina/runner/run.py sha256=Ko_vgpeKVvk0NkvmktvyuTIqgSt3YQUzC4LVGzV578w 5510
athina/runner/run_wrapper.py sha256=QYwyET2ihAFGOUxjH7LoJl2BDUguID-ykP9d5WwHG4M 341
athina/scripts/guardrails.py sha256=KF5ZidTq5sOS-fc_bFDTlPEmGbIGWHAGuLg9C-vvNLg 1781
athina/services/athina_api_service.py sha256=OGeAGVc1CQP0CSGbR_ugVeqnL_Avst5nQovfEO3ebDg 12648
athina-1.2.14.dist-info/METADATA sha256=RZJdqlBFzxeu1TIG9mvUHPQLRUz8I1KP-3ZyrSCs_1I 9635
athina-1.2.14.dist-info/WHEEL sha256=sP946D7jFCHeNz5Iq4fL4Lu-PrWrFsgfLXbbkciIZwg 88
athina-1.2.14.dist-info/entry_points.txt sha256=1Tzv6b93drY0K80MYyVAUlG-LDhNvRr_hmAP3zUpQ-g 99
athina-1.2.14.dist-info/RECORD — —

entry_points.txt

[console_scripts]
athina = athina.cli.cli:main
install_guardrails = athina.scripts.guardrails:install