Niche
Inference & Serving: 14 open-source systems measured weekly
Evidaxis measures 14 systems in Inference & Serving every week. In snapshot 2026-w41 (2026-10-10) the niche median is ≈37.1 commits per week, 12 citations to date (on the 6 systems with a citation count) and ≈14.5 direct dependents (on the 8 systems with a dependents reading). Systems at 2× the niche median or more: 3. Rising: none.
Systems
Default order: system name, A to Z. Click a column to reorder. Order is not a rank.
What the columns mean: commits per week · citations to date · verified dependents · not measured, count only · medals · Rising
| Measured line | ||||||
|---|---|---|---|---|---|---|
| AIBrix | 28.6 commits/week, citations not measured, verified dependents not measured. | 28.6 | not measured | not measured | 5,132 | |
| FlashInfer | 89.3 commits/week, 4 citations to date (count only), verified dependents not measured. | 89.3 | 4count only | not measured | 6,592 | |
| KTransformers | 4.3 commits/week, 11 citations to date (count only), verified dependents not measured. | 4.3 | 11count only | not measured | 19,598 | |
| llama.cpp | 138.8 commits/week, citations not measured, verified dependents not measured. | 138.8 | not measured | not measured | 130,913 | |
| llm-d | 34.6 commits/week, citations not measured, verified dependents not measured. | 34.6 | not measured | not measured | 4,801 | |
| LMCache | 39.6 commits/week, 2 citations to date (count only), 4 verified direct dependents (count only). | 39.6 | 2count only | 4count only | 12,006 | |
| LMDeploy | 11 commits/week, citations not measured, verified dependents not measured. | 11 | not measured | not measured | 8,104 | |
| Mooncake | 59.2 commits/week, 13 citations to date (count only), verified dependents not measured. | 59.2 | 13count only | not measured | 6,772 | |
| Nano-vLLM | 0 commits/week, citations not measured, verified dependents not measured. | 0 | not measured | not measured | 15,786 | |
| Ollama | 22.2 commits/week, citations not measured, 1,097 verified direct dependents. | 22.2 | not measured | 1,097 | 182,835 | 75× dependents |
| SGLang | 518.2 commits/week, 120 citations to date (count only), 14 verified direct dependents. | 518.2 | 120count only | 14 | 37,031 | 10× citations |
| TensorRT-LLM | 184.5 commits/week, citations not measured, 0 verified direct dependents (count only). | 184.5 | not measured | 0count only | 14,799 | |
| vLLM | 582.3 commits/week, 1,669 citations to date (count only), 152 verified direct dependents. | 582.3 | 1,669count only | 152 | 93,625 | 139× citations |
| Xinference | 29.6 commits/week, citations not measured, verified dependents not measured. | 29.6 | not measured | not measured | 9,609 |
2×, 10× and 100× are that multiple of this niche median, on citations or verified dependents (bronze, silver, gold).
Rising means at least two of the three measures are rising together in this niche on this snapshot; it describes the recorded series, not a forecast.