Wheelodex » Projects » lm-polygraph

lm-polygraph

View on PyPI — Reverse Dependencies (0)

0.0.1.dev1 lm_polygraph-0.0.1.dev1-py3-none-any.whl

Wheel Details

Project: lm-polygraph
Version: 0.0.1.dev1
Filename: lm_polygraph-0.0.1.dev1-py3-none-any.whl
Download: [link]
Size: 208736
MD5: 3d5f9d78fef14b28aa51a2e2f7f92058
SHA256: bbb6c7ba05fa43234f249e2b63811881f223570cd90a67a4dc37f06578f8019b
Uploaded: 2024-03-02 21:35:43 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt

METADATA

Metadata-Version: 2.1
Name: lm_polygraph
Version: 0.0.1.dev1
Summary: Uncertainty Estimation Toolkit for Transformer Language Models
Author-Email: "List of contributors: https://github.com/IINemo/lm-polygraph/graphs/contributors" <artemshelmanov[at]gmail.com>
Project-Url: Homepage, https://github.com/IINemo/lm-polygraph
Project-Url: Bug Tracker, https://github.com/IINemo/lm-polygraph/issues
Project-Url: Repository, https://github.com/IINemo/lm-polygraph
Project-Url: Documentation, https://lm-polygraph.readthedocs.io
License: Copyright (c) 2023 MBZUAI Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software. THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
Keywords: NLP,deep learning,transformer,pytorch,uncertainty estimation
Classifier: Development Status :: 3 - Alpha
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Education
Classifier: Intended Audience :: Science/Research
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Requires-Python: >=3.10
Requires-Dist: datasets (>=2.14.2)
Requires-Dist: rouge-score (>=0.0.4)
Requires-Dist: nlpaug (>=1.1.10)
Requires-Dist: scikit-learn
Requires-Dist: tqdm (>=4.64.1)
Requires-Dist: matplotlib (>=3.6)
Requires-Dist: pandas (>=1.3.5)
Requires-Dist: torch (>=1.13.0)
Requires-Dist: bs4
Requires-Dist: transformers (<=4.36)
Requires-Dist: nltk (>=3.6.5)
Requires-Dist: sacrebleu (>=1.5.0)
Requires-Dist: sentencepiece (>=0.1.97)
Requires-Dist: hf-lfs (==0.0.3)
Requires-Dist: pytest (>=4.4.1)
Requires-Dist: pytreebank (>=0.2.7)
Requires-Dist: setuptools (>=60.2.0)
Requires-Dist: numpy (>=1.23.5)
Requires-Dist: dill (>=0.3.5.1)
Requires-Dist: scipy (>=1.9.3)
Requires-Dist: flask (>=2.3.2)
Requires-Dist: protobuf (>=4.23)
Requires-Dist: fschat (>=0.2.3)
Requires-Dist: hydra-core (>=1.3.2)
Requires-Dist: einops
Requires-Dist: accelerate
Requires-Dist: bitsandbytes
Requires-Dist: openai (==0.28.0)
Requires-Dist: wget
Requires-Dist: sentence-transformers
Requires-Dist: bert-score
Description-Content-Type: text/markdown
License-File: LICENSE.md
[Description omitted; length: 13669 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.42.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
lm_polygraph/__init__.py sha256=Vl9x-j9n1lD6dcbMfMpqFMW8zEYzwaMLbjkLStW94kA 148
lm_polygraph/app/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
lm_polygraph/app/parsers.py sha256=R6mC_NSAnmImJJ3U4f97kd6BkkCSb9zVEA1A3uHH6XA 6580
lm_polygraph/app/service.py sha256=euO55N8DaYPqUziDzrWbKilQaLYcuzMiODqPcgXvkZw 1879
lm_polygraph/app/service_helpers.py sha256=9fgYuWIS2Qf8Ye8O9Dtt7yysZP1sjQEG1oPd_o8_w08 12441
lm_polygraph/app/service_modal.py sha256=l8KVnX5Mq356xGFL9HAMCabc1FLeC1n0daYTldE8AFs 1327
lm_polygraph/app/test_service.py sha256=o2h70707KhdAkgwDg9r4kQ5eL59eYQBaqkyWUcVpmRU 730
lm_polygraph/app/client/example_requests.json sha256=qtdF5bH5EkedeasWl5fPuPJ0Hypbu9K6SyK18WyzdJ0 1452
lm_polygraph/app/client/favicon.ico sha256=ikaEFbR4Pt-R8U4elGrB8N3C1o8_9ViIeGr2Bs_gb5w 4286
lm_polygraph/app/client/index.html sha256=bhJjg_WioeyVOjr8K2BprsX5DRrXiwkeL1bTtAT4d2o 5871
lm_polygraph/app/client/assets/css/highlight.min.css sha256=-94KwJIdhsNWxBUy5zGciHojvRuP8ABgyrRHJJ8Dx88 1144
lm_polygraph/app/client/assets/css/index.css sha256=RMwi1A7BTM9erzGwNk2G60so3RxBJ7Lb5ZThwqDNtR8 7859
lm_polygraph/app/client/assets/img/ai.svg sha256=GN4U76zWFvUAB_XLsgogdSVzpPZR3G4JYMCX6sh5yP0 11954
lm_polygraph/app/client/assets/img/me.png sha256=6w5-3fYCPtytLYhKJBaEvI6DR8_qAgBIl2d3iN9ffJE 4005
lm_polygraph/app/client/assets/img/settings.svg sha256=YrZAWt08A8quwGzNEyf9bCokiMzdCMez6hFqnqPD-8c 1060
lm_polygraph/app/client/assets/js/highlight.min.js sha256=nxnOvB1EQa4fD_xpakJii5-GX-XZne2h8ejNW-yHiIg 120762
lm_polygraph/app/client/assets/js/index.js sha256=CQJejlfAAALfcDrF48nIFtz2LCI5dMDuvr8HCg92dss 14797
lm_polygraph/app/client/assets/js/select.js sha256=RwvJTnUimOFKXbgssAsni32-91n7phDyFB59UvCkKVI 5573
lm_polygraph/app/client/assets/js/showdown.min.js sha256=Rw7nbQBUsjXxoPDmdF7EyJe1ykAmEsY_BAmINMNFVGs 75208
lm_polygraph/estimators/__init__.py sha256=N2T2fC5tRuCXIM32OMnnnsPXK6YNHngoo0RLTexMCro 1542
lm_polygraph/estimators/common.py sha256=2KUapCCYBpQSXBHVMdPJkcXGmdpXLAYDnSDeQvPwkBc 2471
lm_polygraph/estimators/conditional_pointwise_mutual_information.py sha256=NOM7OyudT51s0YwELZNguK-PB1FMTxT2MVnV__lKJy4 4658
lm_polygraph/estimators/deg_mat.py sha256=5HMOLXEt8Fl3Ib7Atd1HiamY55fHMyh2hykwYhWGBe8 3944
lm_polygraph/estimators/eccentricity.py sha256=Kz03sL12EOU5BoZn9u6iBHpg_yI5LS6rHxc4u_Jz-zQ 4723
lm_polygraph/estimators/eig_val_laplacian.py sha256=gC1O3uE5y_x3TxFurlm7P49ivnhh4vaoZTZrG4xaUNs 4020
lm_polygraph/estimators/ensemble_sequence_measures.py sha256=g3kKKU_XaVcv2JgyQek4Y07KfZyAc-mBRM_7GnlIoZ4 3606
lm_polygraph/estimators/ensemble_token_measures.py sha256=xTs70kllNJzyUftzDQwFMYj_IZZi4r8_88P6-ImGFDA 4177
lm_polygraph/estimators/estimator.py sha256=oiPVmTzV7N_IFqQ8KRG1a9H-U8V39LmlRvWF7jrEyvg 2021
lm_polygraph/estimators/lexical_similarity.py sha256=GjuwE4gb0AtVCXEYmGy6XeubGzZUF2pAKpVPUKKKoiM 3006
lm_polygraph/estimators/mahalanobis_distance.py sha256=11y8B7rGb1ctgkfqNwha6W9Qlzaqi9QI3Qk3qjhlixQ 6717
lm_polygraph/estimators/max_probability.py sha256=mWeHNnCOfW65rVrMl6RVBLdcqYKeAykuR8pfJE2CV2M 2366
lm_polygraph/estimators/monte_carlo_normalized_sequence_entropy.py sha256=L_NlLJMsoMkMAc7qe8G7PvcIjCnFlvqyPQ-b0iqPVW4 1802
lm_polygraph/estimators/monte_carlo_sequence_entropy.py sha256=PQnt_-QcPfB6Io_iMW-USfpxPfV-Ak_TobxpWDAO5YE 1479
lm_polygraph/estimators/num_sem_sets.py sha256=pqHMRRJPev4rUsxca3HV6Bt4i_9_MBSmOaemlBys96Q 4115
lm_polygraph/estimators/p_true.py sha256=V5kK6vnv_N_V5XmCHeDznPDSoZpv8hyNGiLxQBb45WM 1402
lm_polygraph/estimators/p_true_sampling.py sha256=oHkmr3tJKa2T-n90aUW_c5suU1ykoJz2d6TxZNSvbZA 1549
lm_polygraph/estimators/perplexity.py sha256=hfLY7gORVVrK4Op48hD25d0z77ToZMMMDd4i_-JiK88 443
lm_polygraph/estimators/pointwise_mutual_information.py sha256=XRFhu1TglpojihBYtXsuStQgEzbp1PcmpfI6a89I9LU 3109
lm_polygraph/estimators/ppl_md.py sha256=uSc1lbp1CGoqBseHS-C-dDpDrKMviqYesjoggUY--QM 4045
lm_polygraph/estimators/rde.py sha256=H4U_ajQpzrXRS3svWFkvrINQLRV8yFJ25KNROQ1KCEw 6146
lm_polygraph/estimators/relative_mahalanobis_distance.py sha256=hXEwfuT11hXIQfaGQQ5Z74dDuyMcqmElkoxRpHx2V1U 4711
lm_polygraph/estimators/semantic_entropy.py sha256=HhJrIo5ZiB-phhXPTJ9ReOk0qkmVzbxSTJ4k8UttxJQ 4786
lm_polygraph/estimators/semantic_entropy_token.py sha256=6hEtIk6t6qeJlmBxnew1F3Mbu74VNUV28CpDGL71s2M 4465
lm_polygraph/estimators/token_entropy.py sha256=JZO0mQnospZwQ0Rrw-mAiJbHTAbaCEesnbqU2-Cmvos 2055
lm_polygraph/generation_metrics/__init__.py sha256=OCSmXo6XXTQXBpytwPkUOxD4nKPIOEFD-ttxtAyD0hg 183
lm_polygraph/generation_metrics/accuracy.py sha256=PqV7P868jzOQ5kmFkr-Dil1J2mYNrhC8EZcrF_heyeA 1460
lm_polygraph/generation_metrics/bart_score.py sha256=3eOxpIGd_Up1Ed1Z5A2-yYzYzGZSJJ6VX2agL6IZ-zQ 1290
lm_polygraph/generation_metrics/bert_score.py sha256=SNKyclctPNF-mN_qwP7Wx58grHhGUK8FPeE1CwJHpdA 1917
lm_polygraph/generation_metrics/generation_metric.py sha256=-TwNt1MGRHPhJhT6_YL-MQT1H0945cYddVJvJrIj1Ns 2710
lm_polygraph/generation_metrics/model_score.py sha256=nhvQ4jLqbMuojhJvgySmQxKzYcxdIgxWjmnOlg8kIWk 2737
lm_polygraph/generation_metrics/rouge.py sha256=C1vBm0pvj6_tlQhKCVRRVGvY_s-Ow86TYar6Wg9B3Cc 1857
lm_polygraph/generation_metrics/sbert.py sha256=uI4zNwZ7KH3Nsh4EgbPEHeFhQjDayvMt_Y4yG4L9znY 1457
lm_polygraph/stat_calculators/__init__.py sha256=dnye71_rJ47AjiYtAR_kU-JE2wphxWbV_i9Dkz3P9_Q 1490
lm_polygraph/stat_calculators/bart_score.py sha256=x59VJPsePRqpCnXoYxIQ_NH9fmWdakwdsIf9QqTTlws 5343
lm_polygraph/stat_calculators/embeddings.py sha256=1_KoiMMoie6mis5vsCUeqwFMy4zHyQB-1OySh3DQ4hw 7725
lm_polygraph/stat_calculators/ensemble_token_data.py sha256=Ssxtx-dangAzhquz8OKVzy2TBvYHweLunZMZ0H8vCic 4510
lm_polygraph/stat_calculators/entropy.py sha256=GeUtF_NZW0J0uX5Oa1aAh-1X9DhGmytyVWCV4doQtVk 1609
lm_polygraph/stat_calculators/greedy_lm_probs.py sha256=STo1Pw5ud52Q7SRZMnqU4lZqpG5h1wEPaPI8N9TtQqA 4175
lm_polygraph/stat_calculators/greedy_probs.py sha256=ESTqz345sOXlC1u1I6mWSdSQPcJ62Ez9wCMJ_9hs2u8 7197
lm_polygraph/stat_calculators/model_score.py sha256=BHaGfdKzdTKmkPknm-DV4JFrpe8PEgKFfeqpwjd0OHQ 3718
lm_polygraph/stat_calculators/prompt.py sha256=LO4dNmXIOqUiWENcVA0grFqxqrSjvGVlJ270D38_wYI 3462
lm_polygraph/stat_calculators/sample.py sha256=uQn_pq1UoCWy8XlOGCz9P6UEtsBUt58ozjHk7RoMl7Y 6577
lm_polygraph/stat_calculators/semantic_matrix.py sha256=ZyGMOkdNvVqUP7PeFPXW6wWsGE6mHiNpisI3J0VreSk 4750
lm_polygraph/stat_calculators/stat_calculator.py sha256=ZJ5jj-4Vomgmci5pRpaVn-rUbUjpWYVWzEm0WcL6lA0 3492
lm_polygraph/ue_metrics/__init__.py sha256=H4NLBIQ4c568A9HSxNuTkvPdmeuNzFU6BjgGGFu2Ef8 273
lm_polygraph/ue_metrics/kendalltau.py sha256=LGNtyuNzC92k-b545zXJDD8Rwm9gV-47Ac8tqLuXJuE 1055
lm_polygraph/ue_metrics/pred_rej_area.py sha256=wAUhstaUwIdPoB9D3PHA6c3kUWtUveiBOZunCV5LJcQ 1498
lm_polygraph/ue_metrics/rev_pairs_prop.py sha256=19njQDb5vzNrNrq-tI5X9IYt6BRKPo7wAwtDeKmEQYs 1364
lm_polygraph/ue_metrics/risk_cov_curve.py sha256=9GAxbwUEHC0_TixOt7irW-S9uvvAlnHjd183lDshmfQ 1440
lm_polygraph/ue_metrics/roc_auc.py sha256=248TVH_y418TCEs1Hss1H8HfKqGpQDbcYDCSolZ1Eqk 613
lm_polygraph/ue_metrics/spearmanr.py sha256=iTJ2CEibR7qepE-U0gQhdG-TiEkOJs7qGGv6jtE538o 1103
lm_polygraph/ue_metrics/ue_metric.py sha256=9ry3jajk5WWfpa6SA9hLyOPNOJRPaUM9TQU1hcfKZ40 2241
lm_polygraph/utils/__init__.py sha256=sS0sZ5UFa4egddiYa_XWZP7xChK6Xo7z435NyJocrhc 130
lm_polygraph/utils/dataset.py sha256=-2rN1OJqFSKm_bul_IvorECbBDeoKd7p5603y_vKZbU 8026
lm_polygraph/utils/generation_parameters.py sha256=d0Vb82215zfqq-eetsjTzhf4H6-XJx2W6g0UhK9ZB_A 1730
lm_polygraph/utils/manager.py sha256=cuY17CSFmnS4glBtt4yenAOqFQ-p6fEOsmwvzn1hblA 27601
lm_polygraph/utils/model.py sha256=Wf8SD5mTqEYlSDNufo-55ZP4BC-5scIGIdtGbtMx0F0 17292
lm_polygraph/utils/normalize.py sha256=v81bfDxRrut3iZoJPS3_ga-F1bu_YplAs4kzv25X2cg 2750
lm_polygraph/utils/ood_detection.py sha256=GKrzC1AlyJx1-d9LfVcOntjFPggR4Htb8oWSErt5xR4 765
lm_polygraph/utils/processor.py sha256=QSbsd8KJ8hmUe2vhyo7xLRsg4AR9FXnVgHfx2i_ARCE 3505
lm_polygraph/utils/token_restoration.py sha256=L077QkFiihl5XF6m7UItye3kGNA3R86yFJZmDg8R_XI 11935
lm_polygraph/utils/ensemble_utils/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
lm_polygraph/utils/ensemble_utils/dropout.py sha256=t2fYuCEsMjshNbxV3-GVQ0xpWSOztnW1Ai-jiZOpKio 2934
lm_polygraph/utils/ensemble_utils/ensemble_beam.py sha256=55s_yYqQDMl_QEUNfxhgCD_13hwgSg2m6DqiG2X5f-4 30422
lm_polygraph/utils/ensemble_utils/ensemble_generator.py sha256=NcTDSWTr72Dnuzc0BpBmxZKsIhn7Pyi2M0_L0KRiJZA 8064
lm_polygraph/utils/ensemble_utils/ensemble_greedy.py sha256=hcsjGd7ndUsY6SI5SYpMF1dsEv3J51n3QEhMRWct-fY 27189
lm_polygraph/utils/ensemble_utils/ensemble_sample.py sha256=QKlOpAqDulK_uV43-QCRs4jEZjpZix13blp_X_aHcbo 28588
lm_polygraph/utils/prompt_templates/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
lm_polygraph/utils/prompt_templates/llama.py sha256=opUl0dOLhK4D5G6CbtCgtmbXmAEmimNUZV8cv9w1VnA 1996
lm_polygraph/utils/prompt_templates/vicuna.py sha256=FWuJ_6LJF_8lB6N2Hvkz54bwQzxM6ToqUJ9ltswuVGs 575
lm_polygraph-0.0.1.dev1.data/scripts/polygraph_eval sha256=i2nHdu-aEQYijjTcGPq78JyFpPYoqrQhckgo7AWPoto 13051
lm_polygraph-0.0.1.dev1.data/scripts/polygraph_eval_ood sha256=zAbK22edzibtKwvCmPE47hRnVwpa0-MUn4DYRf5P7xU 1052
lm_polygraph-0.0.1.dev1.data/scripts/polygraph_normalize sha256=-ylLdI-DJX0W_pMNasVQwJl86qvVIPtZTgps2vtXsTA 6144
lm_polygraph-0.0.1.dev1.data/scripts/polygraph_server sha256=l5yQwa27ixsWecbL4f1brTKyUyc5OllPbWCirwn5ssg 680
lm_polygraph-0.0.1.dev1.dist-info/LICENSE.md sha256=pCITdFklmt4cqBgLO0o2Z1fCazPfOaUNeDJ_PzUHaZ4 1050
lm_polygraph-0.0.1.dev1.dist-info/METADATA sha256=D5skN3CV0zmAKK8TI5JniC11nxk4PMCT87_c5QX93yM 17052
lm_polygraph-0.0.1.dev1.dist-info/WHEEL sha256=oiQVh_5PnQM0E3gPdiz09WCNmwiHDMaGer_elqB3coM 92
lm_polygraph-0.0.1.dev1.dist-info/top_level.txt sha256=toVU82LR7w56du-3OPOZnJmn9CP6eeCGDlGyntuvqao 13
lm_polygraph-0.0.1.dev1.dist-info/RECORD — —

top_level.txt

lm_polygraph