judyeval

View on PyPIReverse Dependencies (0)

2.1.0 judyeval-2.1.0-py3-none-any.whl

Wheel Details

Project: judyeval
Version: 2.1.0
Filename: judyeval-2.1.0-py3-none-any.whl
Download: [link]
Size: 85363
MD5: b4f9d9589fb25a9a48fd2771552a8313
SHA256: f6206f09f50402750b13fa7e82c5cd8c5a801100c90987a061077f0be6cb7dae
Uploaded: 2024-02-25 22:43:40 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: judyeval
Version: 2.1.0
Summary: Judy is a python library and framework to evaluate the text-generation capabilities of Large Language Models (LLM) using a Judge LLM.
Author: Linden Hutchinson
Author-Email: linden.hutchinson[at]tesserent.com
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Requires-Python: >=3.10,<4.0
Requires-Dist: black (<24.0.0,>=23.10.1)
Requires-Dist: click (<9.0.0,>=8.1.7)
Requires-Dist: datasets (<3.0.0,>=2.14.5)
Requires-Dist: easyllm (<0.6.0,>=0.5.0)
Requires-Dist: flask (<4.0.0,>=3.0.0)
Requires-Dist: numpy (==1.24.4)
Requires-Dist: openai (<2.0.0,>=1.3.7)
Requires-Dist: platformdirs (<4.0.0,>=3.11.0)
Requires-Dist: pytest (<8.0.0,>=7.4.2)
Requires-Dist: python-dotenv (<2.0.0,>=1.0.0)
Requires-Dist: sqlitedict (<3.0.0,>=2.1.0)
Description-Content-Type: text/markdown
[Description omitted; length: 4878 characters]

WHEEL

Wheel-Version: 1.0
Generator: poetry-core 1.8.1
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
judy/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
judy/api/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
judy/cache/__init__.py sha256=NSofTJ0OLOHu3zhH3iztlnm6s4t8iYl48ABgdHmCfaQ 32
judy/cache/cache.py sha256=fmNRn6Anxof8xbU8akbkUHoLwp2DsRhZTzWt-TjK-d0 4665
judy/cli/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
judy/cli/install.py sha256=cYEEZkx1zzt3xzO1KsMZathv49vByeIihIeTJHPkvGM 784
judy/cli/manager.py sha256=iNfTlEl1n0qpa1R66WCu04Ur-ihKSnLTkWnfFuB8lMs 14097
judy/cli/pipeline.py sha256=97aVv60EotoEYcVJP5j4hPjEWMTnMtPhnWUYYsXnuDM 16671
judy/cli/run.py sha256=UwgwQXDUmLpkxinHMUMlmxMU8v5atZ27PEnBr6miEmc 11237
judy/config/__init__.py sha256=2IPQjZmApX_nqCBn4Y-KwBbeDmi58kw85ksOi6ER1rs 3987
judy/config/data_models.py sha256=c993TCk0rGh21EdAD9EVoObU4yxh3fBLeiID0mIG1qQ 4166
judy/config/files/example_dataset_config.yaml sha256=TqMLU_qtW_PCGzH36AMalqSxNOx7Fb8Ofwc2fQoNKU0 3815
judy/config/files/example_eval_config.yaml sha256=0JEnCW9OfL5PbIhW1A6Zo5mDwLZVE3DZ5C70DqCXRRM 24791
judy/config/files/example_run_config.yaml sha256=mB-BcR-I1GJ0AIAvz9yzDz9q7Ue9K21Lu86x8B_7v60 564
judy/config/logging.py sha256=dOcAFBWIyzo2bg0IS8g9lr0exKsnh2oBrg8CNz-htEI 1008
judy/config/settings.py sha256=J7wZnbgZMqa0i74-4nUVQyO1M3yaa58eh5jQ-GvqZyw 2178
judy/config/validator.py sha256=GIHoVthrnR8lrAqfR-e9oV3A8bpmn0q_i0R7cIh4668 3518
judy/dataset/__init__.py sha256=ThSYanQbi5ETS5fZYn6x3qRrwLx9rn8Ij-9Xc_-uP5M 44
judy/dataset/base.py sha256=SOpLaJi62rbPtJ-ktyVTU-SJW9KDTTNNwSXvb88tvTo 291
judy/dataset/data_models.py sha256=_sIdgojxKRDdS46mKXQESo4TOAD7LMzhnX2fhPSdgD4 936
judy/dataset/formatters.py sha256=Nfbkrw2p6RIPoFHXU7VSiS2psTgN_SLiVn68CPVMLdU 8042
judy/dataset/loader.py sha256=Ed3hm71HeuIHj87_jiuHEyPKeTAnh3SMOXOCg9FXews 4310
judy/evaluation/__init__.py sha256=5VEh-GaBcCYHKoxi_ZhCLD_t7aHB7DsyYmfgKDeq8ZA 77
judy/evaluation/evaluator.py sha256=rjno2O82oVqqRkOqYHh53Ur_Huk_3diaFbCaqMC-A84 5730
judy/evaluation/prompt_builder.py sha256=94_C5gygbHHNrYdmZeF62J9MZdyAOofn6xcZ6mepDeI 3049
judy/evaluation/prompts.py sha256=9KZx2qozlwVD_kpm0Ia9CxNnEvx6bLC8Uq6LkdSpJeQ 10139
judy/responders/__init__.py sha256=5OXJCG7SuNwA36eoNGR8fRp2G4zxl_BPI7sgSB3JwlU 1392
judy/responders/base_responder.py sha256=7hw6S8lqRJ3dTLBThn3CmwHn5bFK_8F1Q119WH1j0P0 3013
judy/responders/data_models.py sha256=n9odCMGkglrxDsBR3H-rCp0RhSq-qdkhf0u_TF38R7I 448
judy/responders/disinfo_reiteration_responder.py sha256=o6tSGNvjgUGsej6ccblLHaa_zFniwDL_x0TDJB_5xHI 1725
judy/responders/disinfo_wedging_responder.py sha256=gHzSayFK63Bu5UmKl8wl-QAEfaW_BWIv45ymHyQMq4M 1709
judy/responders/mt_q_responder.py sha256=ewterd2402mDpXLFDvCvA71EbWYnoYpXr4HQdNsyRTE 1832
judy/responders/mt_qac_responder.py sha256=SwlIfjxRTL7oRF3nD-6gkzhNQ6685k3gLE1v0otEPoU 2968
judy/responders/st_q_responder.py sha256=yG1ZOwNzpqmj5Z5pj8Ppt96csb9iVyP_QZAQC_arxGk 1426
judy/responders/st_qa_responder.py sha256=0dJXpXzn-zXYUPyUxD_n3PorxzkJURpu2JRVrdoTz_g 1478
judy/responders/st_qac_responder.py sha256=oeOMAlmMShZC2bg1f4kuQtFtRHS38hb1V5bxeSJqTi0 1938
judy/responders/st_qam_responder.py sha256=qAZxvFSqOpJZKCat_Zy5vbU09YGq9o6erq8JIjjB68M 1319
judy/responders/summ_responder.py sha256=qHWx6dkXw48z1cNTJvlUAJFj4x8aKFlzZsWEonmeJO0 1543
judy/utils/__init__.py sha256=kpAZ8ngR3q6ERZXJeKIKZ8eDqVN3prQinGaCEoVtcd8 205
judy/utils/llm.py sha256=ycatKcxQFEnN9CoZ83Xs3pvYaypQzBExmIZHng-A3rg 5441
judy/utils/request_retry.py sha256=MhOdDWSC0_7H_BsQFZeV1zXNn3zJAfakZ30YHRucr7A 1905
judy/utils/utils.py sha256=S81A_IIRyYFmTn75Jf97ahx4a3byma2La-Re2UwPoYs 3855
judy/web_app/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
judy/web_app/breadcrumb.py sha256=N4ZszyNrZReqtAgkw5tgNq0RjkZ1fbhonC3HWGOr9eY 1271
judy/web_app/config.py sha256=uOmmS6__FgxzALZQI2n98A1CAa45HVzjQiCYC8yei-o 40
judy/web_app/main.py sha256=QrQXXckYnWLuPf39GIuQloFLR-r7QhK9Ly6UmcKdtRY 1025
judy/web_app/static/styles.css sha256=lsmIlIVJaIDQ_iSbfuyKgIIGiNaQ3fE5bTts7GW3ShA 3106
judy/web_app/templates/about_page.html sha256=o2hj6Ip_KdusbHZvX3NvNUN0FLwxU5NjSvHLbCwCJRA 1073
judy/web_app/templates/base.html sha256=sMmoiBgQzHPEI7LZ9_nbM5-JtgSPbf_KKFaOefh_Eoc 3758
judy/web_app/templates/card_page.html sha256=VU1T_rnauGhM6mfqSLdae3G9gaSoRVsr1N2jxMbAYtM 772
judy/web_app/templates/heatmap_macro.html sha256=03BoWkE23B1wN_3se8Ok4dWBkqaKpTRvERSIh9yG9lQ 4881
judy/web_app/templates/info_card.html sha256=Ku1WvfaxnhforgXvpxBjWFvFYVtvGZV1Mw126kDr8U8 1128
judy/web_app/templates/model_page.html sha256=sllKBgWv4IEg4-zbDrhCOgM7Tv7gAxFDjytuT6FE1BQ 1950
judy/web_app/templates/raw_results.html sha256=qDTIEb7F0-QdEGm3TG4pKFTr1dBO8UvC7HPbutvHliI 12302
judy/web_app/templates/run_dashboard.html sha256=p8Bs4WGvsR6MpfncTX225f52D-wtBeyJqBYsN4kGW4w 6778
judy/web_app/templates/run_page.html sha256=pVUIPQyMQFf8oarqc9Hl4q9sXJuEDAARr76cIDwhcmU 2305
judy/web_app/templates/table_macro.html sha256=Qw-w8JHWd8N1-SV8xwXH_sRNqQ6UzsDgfPuFTcT1auo 1237
judy/web_app/utils.py sha256=mmvKUGcMF0znXcMaPCy0BJW2tGYf6ruOgNxXInuCCPs 12047
judy/web_app/views.py sha256=Wj8rZS6zO13I-JuyFhNgOk4jdE3biyFYc9jwtulA5RU 10570
judyeval-2.1.0.dist-info/LICENSE sha256=IwGE9guuL-ryRPEKi6wFPI_zOhg7zDZbTYuHbSt_SAk 35823
judyeval-2.1.0.dist-info/METADATA sha256=EixVwFa1KZ1Gr7rxdlRKRYcgY3u4_S3ZMNzIjh67k2Q 5860
judyeval-2.1.0.dist-info/WHEEL sha256=FMvqSimYX_P7y0a7UY-_Mc83r5zkBZsCYPm7Lr0Bsq4 88
judyeval-2.1.0.dist-info/entry_points.txt sha256=pQgtDDjME2rRYFQSwcj6HJg6skTUXVenxCg4G8L6n4c 46
judyeval-2.1.0.dist-info/RECORD

entry_points.txt

judy = judy.cli.run:judy_cli