Reverse Dependencies of pytrec-eval

The following projects have a declared dependency on pytrec-eval:

• bcqa — A Benchmark for Complex Heterogeneous Question answering
• beir — A Heterogeneous Benchmark for Information Retrieval
• capreolus — A toolkit for end-to-end neural ad hoc retrieval
• clddp — A package for training and doing inference with contrastive learning with multiple GPUs (Pytorch-DDP).
• compare-qrels — Qualitatively compare the qrels results of two IR systems.
• crfm-helm — Benchmark for language models
• dexter-cqa — A Benchmark for Complex Heterogeneous Question answering
• diffir — Tool for visually diffing the difference between two TREC run files.
• OpenNIR-XPM — OpenNIR: A Complete Neural Ad-Hoc Ranking Pipeline (Experimaestro version)
• patapsco — Cross Language Information Retrieval pipeline
• python-terrier — Terrier IR Python API
• repro-eval — A tool to quantify the replicability and reproducibility of system-oriented IR experiments.
• unitxt — Load any mixture of text to text data in one line of code
• useb — Heterogenous, Task- and Domain-Specific Benchmark for Unsupervised Sentence Embeddings used in the TSDAE paper.