Niche
Inference & Serving: 14 open-source systems measured weekly
Evidaxis measures 14 systems in Inference & Serving every week. In snapshot 2026-w45 (2026-11-07) the niche median is ≈52.8 commits per week, 48 citations to date (on the 7 systems with a citation count) and ≈14.5 direct dependents (on the 8 systems with a dependents reading). Systems at 2× the niche median or more: 4. Rising: none.
Systems
Default order: system name, A to Z. Click a column to reorder. Order is not a rank.
What the columns mean: commits per week · citations to date · verified dependents · not measured, count only · medals · Rising
| Measured line | ||||||
|---|---|---|---|---|---|---|
| AIBrix | 41.9 commits/week, 7 citations to date (count only), verified dependents not measured. | 41.9 | 7count only | not measured | 5,182 | |
| FlashInfer | 242.8 commits/week, 48 citations to date (count only), verified dependents not measured. | 242.8 | 48count only | not measured | 6,867 | |
| KTransformers | 4.4 commits/week, 15 citations to date (count only), verified dependents not measured. | 4.4 | 15count only | not measured | 19,659 | |
| llama.cpp | 162.9 commits/week, citations not measured, verified dependents not measured. | 162.9 | not measured | not measured | 133,585 | |
| llm-d | 35.9 commits/week, citations not measured, verified dependents not measured. | 35.9 | not measured | not measured | 5,162 | |
| LMCache | 56.8 commits/week, 27 citations to date (count only), 4 verified direct dependents (count only). | 56.8 | 27count only | 4count only | 12,302 | |
| LMDeploy | 11.2 commits/week, citations not measured, verified dependents not measured. | 11.2 | not measured | not measured | 8,134 | |
| Mooncake | 67.4 commits/week, 96 citations to date (count only), verified dependents not measured. | 67.4 | 96count only | not measured | 6,995 | 2.0× citations |
| Nano-vLLM | 0 commits/week, citations not measured, verified dependents not measured. | 0 | not measured | not measured | 16,327 | |
| Ollama | 26.1 commits/week, citations not measured, 1,114 verified direct dependents. | 26.1 | not measured | 1,114 | 186,153 | 76× dependents |
| SGLang | 678.6 commits/week, 267 citations to date (count only), 14 verified direct dependents. | 678.6 | 267count only | 14 | 38,537 | 5.5× citations |
| TensorRT-LLM | 212.8 commits/week, citations not measured, 0 verified direct dependents (count only). | 212.8 | not measured | 0count only | 15,031 | |
| vLLM | 855.8 commits/week, 2,093 citations to date (count only), 155 verified direct dependents. | 855.8 | 2,093count only | 155 | 96,482 | 43× citations |
| Xinference | 48.8 commits/week, citations not measured, verified dependents not measured. | 48.8 | not measured | not measured | 9,646 |
2×, 10× and 100× are that multiple of this niche median, on citations or verified dependents (bronze, silver, gold).
Rising means at least two of the three measures are rising together in this niche on this snapshot; it describes the recorded series, not a forecast.