Reverse Dependencies of sentencepiece
The following projects have a declared dependency on sentencepiece:
- incognitoGPT — no summary
- indic-punct — Punctuation and inverse text normalization for Indic languages and English
- indobenchmark-toolkit — Indobenchmark toolkit for supporting IndoNLU and IndoNLG
- infercode — Map any code snippet into vector
- inflecteur — python inflector for French language : control gender, tense and number
- infuz — no summary
- inltk — Natural Language Toolkit for Indian Languages (iNLTK)
- inranker — no summary
- insightly-outliers — Individual work for the discipline of configuration management and software evolution at the university of Brasília - Gama for semester 2022.2
- instruction-ner — Unofficial implementation of InstructionNER
- interbase-code — Projeto GCES
- intrepppid — Protein-protein interaction prediction model that leverages orthology data
- ipex-llm — Large Language Model Develop Toolkit
- irisml-tasks-llava — Irisml adapter tasks for LLAVA models
- iva-applications — no summary
- iva-mt — A machine translation library utilizing m2m100 models, equipped with features for generating diverse verb variants via VerbNet and Conditional Beam Search to enrich Virtual Assistant training sets.
- ivystar — python tools package of ivystar
- jac-misc — no summary
- jac-nlp — no summary
- jailbreakbench — An Open Robustness Benchmark for Jailbreaking Language Models
- jiant — State-of-the-art Natural Language Processing toolkit for multi-task and transfer learning built on PyTorch.
- joeynmt — Minimalist NMT for educational purposes
- jptranstokenizer — Japanese tokenizer with transformers library
- jshbtf0302 — State-of-the-art Natural Language Processing for TensorFlow 2.0 and PyTorch
- junkdetect — Junk Not-Junk Detector
- jury — Evaluation toolkit for neural language generation.
- kani — kani (カニ) is a lightweight and highly hackable framework for chat-based language models with tool usage/function calling.
- kbert — TensorFlow2.0 with Keras For BERT
- keras-nlp — Industry-strength Natural Language Processing extensions for Keras.
- keras-nlp-nightly — Industry-strength Natural Language Processing extensions for Keras.
- keytotext — Text Generation Using Keywords
- keywords-en — keywords extract
- KhamYo — Thai abbreviation to full text library
- khmerpunctuate — Punctuation Restoration for Khmer language
- kimchima — The collections of tools for ML model development.
- kobert-transformers — Transformers library for KoBERT, DistilKoBERT
- kogito — A Python NLP Commonsense Knowledge Inference Toolkit
- kogitune — The Kogitune 🦊 LLM Project
- konoha — A tiny sentence/word tokenizer for Japanese text written in Python
- kosmos-2 — kosmos-2 - Pytorch
- KosmosX — Transformers at zeta scales
- kotan — no summary
- langanisa — A langchain, transformers, and attention_sinks wrapper for longform response generation.
- langchain-llm — langchain llm wrapper
- langcheck — Simple, Pythonic building blocks to evaluate LLM-based applications
- langml — A Keras-based and TensorFlow-backend language model toolkit.
- langport — A large language model serving platform.
- languru — The general purpose LLM app stacks.
- laser-encoders — LASER Language-Agnostic SEntence Representations is a toolkit to calculate multilingual sentence embeddings and to use them for document classification, bitext filtering and mining
- laserdato — A small example package
- lazy-text-predict — Text classification automl
- legrad-torch — LeGrad
- lib-metabase-gces — A library that helps developers visualize data made in the GCES course at UnB.
- libpup — no summary
- lighteval — A lightweight and configurable evaluation package
- lightning-flash — Your PyTorch AI Factory - Flash enables you to easily configure and run complex AI recipes.
- lightning-transformers — Lightning Transformers.
- lingo-llm — Lingo: Make the LLM Better for Everyone
- lisa-on-cuda — no summary
- litGPT — Hackable implementation of state-of-the-art open-source LLMs
- litie — Pytorch-lightning Code Blocks for Information Extraction
- llama-index-core — Interface between LLMs and your data
- llama-index-embeddings-ipex-llm — llama-index embeddings ipex-llm integration
- llama-index-legacy — Interface between LLMs and your data
- llama-recipes — Llama-recipes is a companion project to the Llama 2 model. It's goal is to provide examples to quickly get started with fine-tuning for domain adaptation and how to run inference for the fine-tuned models.
- llama2-wrapper — Use llama2-wrapper as your local llama2 backend for Generative Agents / Apps
- llamatune — Haven's Tuning Library for LLM finetuning
- llava-torch — Towards GPT-4 like large language and visual assistant.
- llm-explorer — A Lakehouse LLM Explorer. Wrapper for spark, databricks and langchain processes
- llm-foundry — LLM Foundry
- llm-quantkit — cli tool for downloading and quantizing LLMs
- llm-rs — Unofficial python bindings for llm-rs. 🐍❤️🦀
- llm-rs-cuda — Unofficial python bindings for llm-rs.
- llm-rs-metal — Unofficial python bindings for llm-rs. 🐍❤️🦀
- llm-rs-opencl — Unofficial python bindings for llm-rs. 🐍❤️🦀
- llm-serve — An LLM inference solution to quickly deploy productive LLM service
- llm-server — no summary
- llm-toolkit — LLM Finetuning resource hub + toolkit
- llm-vm — An Open-Source AGI Server for Open-Source LLMs
- llmchatbot — LLM-based Chatbot
- llmlite — A library helps to chat with all kinds of LLMs consistently.
- llmproxy — no summary
- llmtuner — Easy-to-use LLM fine-tuning framework
- llmuses — Eval-Scope: Lightweight LLMs Evaluation Framework
- lm-eval — A framework for evaluating language models
- lm-polygraph — Uncertainty Estimation Toolkit for Transformer Language Models
- lmflow-benchmark — LMFlow: Large Model Flow.
- lmflow-deploy — LMFlow: Large Model Flow.
- lmflow-diffusion — LMFlow: Large Model Flow.
- lmflow-eval — LMFlow: Large Model Flow.
- lmflow-evaluate — LMFlow: Large Model Flow.
- lmflow-evaluator — LMFlow: Large Model Flow.
- lmflow-finetune — LMFlow: Large Model Flow.
- lmflow-finetuner — LMFlow: Large Model Flow.
- lmflow-inference — LMFlow: Large Model Flow.
- lmflow-inferencer — LMFlow: Large Model Flow.
- lmflow-pretrain — LMFlow: Large Model Flow.
- lmflow-pretrainer — LMFlow: Large Model Flow.
- lmflow-vision — LMFlow: Large Model Flow.
- LMTuner — No More Complications, Effortless LLM Training with LMTuner