Niche
Inference & Serving: 13 open-source systems measured weekly
Evidaxis measures 13 systems in Inference & Serving every week. In snapshot 2026-w39 (2026-09-26) the niche median is 32 commits per week, 13 citations to date (on the 5 systems with a citation count) and 8 direct dependents (on the 8 systems with a dependents reading). Systems at 2× the niche median or more: 3. Rising: none.
Systems
Default order: system name, A to Z. Click a column to reorder. Order is not a rank.
What the columns mean: commits per week · citations to date · verified dependents · not measured, count only · medals · Rising
| Measured line | ||||||
|---|---|---|---|---|---|---|
| AIBrix | 22.2 commits/week, citations not measured, verified dependents not measured. | 22.2 | not measured | not measured | 5,113 | |
| KTransformers | 4.3 commits/week, 9 citations to date (count only), 1 verified direct dependents (count only). | 4.3 | 9count only | 1count only | 19,537 | |
| llama.cpp | 132.6 commits/week, citations not measured, verified dependents not measured. | 132.6 | not measured | not measured | 129,606 | |
| llm-d | 32 commits/week, citations not measured, verified dependents not measured. | 32 | not measured | not measured | 4,661 | |
| LMCache | 40.2 commits/week, 2 citations to date (count only), 3 verified direct dependents (count only). | 40.2 | 2count only | 3count only | 11,912 | |
| LMDeploy | 13.1 commits/week, citations not measured, verified dependents not measured. | 13.1 | not measured | not measured | 8,099 | |
| Mooncake | 64.3 commits/week, 13 citations to date (count only), verified dependents not measured. | 64.3 | 13count only | not measured | 6,664 | |
| Nano-vLLM | 0 commits/week, citations not measured, verified dependents not measured. | 0 | not measured | not measured | 15,631 | |
| Ollama | 23.6 commits/week, citations not measured, 1,078 verified direct dependents. | 23.6 | not measured | 1,078 | 181,771 | 134× dependents |
| SGLang | 499.5 commits/week, 102 citations to date (count only), 13 verified direct dependents. | 499.5 | 102count only | 13 | 36,455 | 7.8× citations |
| TensorRT-LLM | 191.2 commits/week, citations not measured, 0 verified direct dependents (count only). | 191.2 | not measured | 0count only | 14,719 | |
| vLLM | 536.9 commits/week, 1,587 citations to date (count only), 150 verified direct dependents. | 536.9 | 1,587count only | 150 | 92,723 | 122× citations |
| Xinference | 29.2 commits/week, citations not measured, verified dependents not measured. | 29.2 | not measured | not measured | 9,592 |
2×, 10× and 100× are that multiple of this niche median, on citations or verified dependents (bronze, silver, gold).
Rising means at least two of the three measures are rising together in this niche on this snapshot; it describes the recorded series, not a forecast.