Awesome-LLM-Routing 🥋

So many LLMs, each with different strengths. LLM/Model-Routing holds the promise to combine all of them and answer queries by finding the most compatible, affordable and brisk expert.

Below, we provide a curated list of research papers and studies discussing LLM routing techniques, as well as projects and companies offering LLM and model routing solutions.

Table of Contents

• Research Papers
• Companies/Startups
• Other Open Source Projects
• Other Awesome Repos
• Contributing

Research Papers

Note: if a paper has both an arXiv and a conference/journal proceedings version, then we only show its proceedings version.

• Date: refers to the date of the associated publication (arXiv/proceedings).
• Affiliation: refers to the authors' company, university and/or research labs affiliations.
• Paper: provides the link to the proceedings or arXiv paper version.
• Citations: the number of citations for each paper and the published conference.
• GitHub: paper's repository.

Date	Affiliation	Paper	Citations	GitHub
05-2023	Stanford University	Frugalgpt: How to use large language models while reducing cost and improving performance
09-2023	Broad Institute, MIT (CSAIL), MIT-IBM Watson AI Lab, University of Michigan	Large language model routing with benchmark datasets
03-2024	Martian, UC Berkeley, UC San Diego	ROUTERBENCH: A Benchmark for Multi-LLM Routing System		GitHub
05-2024	MBZUAI	Harnessing the Power of Multiple Minds: Lessons Learned from LLM Routing		GitHub
06-2024	University of British Columbia, Microsoft, Hippocratic AI	Hybrid LLM: Cost-Efficient and Quality-Aware Query Routing
07-2024	UC Berkeley, Anyscale, Canva	RouteLLM: Learning to Route LLMs with Preference Data		GitHub
08-2024	TensorOpera	PolyRouter: A Multi-LLM Querying System
11-2025	Carnegie Mellon University	An Empirical Study on Strong-Weak Model Collaboration for Repo-level Code Generation		GitHub
01-2026	Nanjing University	MMR-Bench: A Comprehensive Benchmark for Multimodal LLM Routing		GitHub
06-2026	Nanjing University et al.	From Sampled Outcomes to Capability Distributions: Rethinking Supervision for LLM Routing		GitHub
06-2026	Nanjing University	RouteJudge: An Open Platform for Reproducible and Preference-Aware LLM Routing		Project · GitHub
08-2026	Nanjing University	ORBIT: An Optimal Routing and Budgeted Inference Toolbox		GitHub
09-2026	Nanjing University	When LLM Routers Overpay: Strong-Model Over-Selection under Loose Budgets
09-2026	Nanjing University	Pretrain Once, Route Anywhere: Towards a Foundation Model for LLM Routing		GitHub
09-2026	Nanjing University et al.	Routing Should Pay for Itself: Sparse Supervision for Economical LLM Routing		GitHub

Companies/Startups

(by alphabetic order)

Name	Platform / App / Chat Arena	Docs	GitHub Repo
APIClaw	Platform	Docs
Anyscale	Platform	Docs	GitHub
Aurelio AI	Course	Docs	GitHub
FerryAPI	Platform	Docs
Langchain	Platform	Docs	GitHub
Martian	Platform	Docs	GitHub
NeutrinoAI	Platform	Docs	GitHub
NotDiamond	Platform	Docs	GitHub
Open Router	Platform	Docs	GitHub
Requesty	Platform	Docs	GitHub
Standard Compute	Platform	Docs
TensorOpera	Platform	Docs	GitHub
Unify	Platform	Docs	GitHub
Weave	Weave Router	Quickstart	GitHub
XiuRouter	Platform	Docs

Other Open Source Projects

Name	Description	GitHub Repo
LLM-PQR	Provider-neutral model selection CLI using measured quality, reliability, latency, cost, capabilities, and hard privacy constraints.	GitHub
Bifrost	Go-native, OpenAI-compatible gateway with multi-provider routing, load balancing, and automatic failover.	GitHub
rust-norion	Rust-based inference control layer prototype focused on adaptive routing, memory, reflection, device/backend adaptation, benchmark gates, and auditable self-evolution workflows.	GitHub
ORBIT	Standardized LLM routing research and budget-aware evaluation toolbox with a common interface for routers and benchmarks.	GitHub
RouteFM	Pretrained, identity-free router that adapts to new candidate pools through behavioral context without retraining.	GitHub
RouteJudge	Public platform for reproducible, preference-aware pairwise evaluation of LLM routing systems.	GitHub

Other Awesome Repos

• Hannibal046/Awesome-LLM on Large Language Models
• KennethanCeyer/awesome-llm on Large Language Models

Contributing

Contributions are welcome! Please open a pull request to add or update relevant LLM-routing resources, following the existing format. If you find this list useful, consider starring and sharing the repository.