{"title":"Inference & Serving: systems measured by Evidaxis, snapshot 2026-09-26","license":"CC0-1.0","license_url":"https://creativecommons.org/publicdomain/zero/1.0/","note":"Released to the public domain under CC0 1.0. Same rows and columns as the niche table on the hub page, all systems, alphabetical by name. Order is not a rank.","niche":{"key":"inference-serving","slug":"inference-serving","label":"Inference & Serving","assigned":true,"field":{"slug":"ai-infrastructure","label":"AI Infrastructure"},"url":"https://evidaxis.org/ai/cohorts/inference-serving/"},"snapshot":{"snapshot_id":"9d2fe956adbc","snapshot_date":"2026-09-26","period":"2026-w39","methodology_version":"m3"},"n_systems":13,"niche_medians":{"commits":{"value":32,"n":13},"citations":{"value":13,"n":5},"dependents":{"value":8,"n":8}},"answer":"Evidaxis measures 13 systems in Inference & Serving every week. In snapshot 2026-w39 (2026-09-26) the niche median is 32 commits per week, 13 citations to date (on the 5 systems with a citation count) and 8 direct dependents (on the 8 systems with a dependents reading). Systems at 2× the niche median or more: 3. Rising: none.","columns":{"measured_line":"The measured line shown in the table, generated from the readings.","commits_per_week":"GitHub commits per week averaged over the trailing 12 weeks.","citations_to_date":"OpenAlex citing works indexed to date, all years including the current one.","citations_state":"scored, count_only (a count without a scored trend) or not_measured.","verified_direct_dependents":"deps.dev direct dependents, shown only when the package identity is verified.","verified_dependents_state":"scored, count_only or not_measured (not_measured when no verified package).","direct_dependents_reading":"The deps.dev direct dependents reading used for the niche median, whether or not the package identity is verified.","stars_recorded_not_scored":"GitHub stargazers; recorded, not scored.","medal_multiple":"Multiple of the niche median (2, 10 and 100 are the bronze, silver and gold thresholds); blank without a medal.","medal_measure":"citations or dependents.","rising":"true when at least two of the three measures are rising together in this niche on this snapshot; blank for systems without a niche."},"systems":[{"entity_id":"e_4249BQNHNVB","name":"AIBrix","url":"https://evidaxis.org/e/e_4249BQNHNVB/","niche":"Inference & Serving","measured_line":"22.2 commits/week, citations not measured, verified dependents not measured.","commits_per_week":22.2,"citations_to_date":null,"citations_state":"not_measured","verified_direct_dependents":null,"verified_dependents_state":"not_measured","direct_dependents_reading":null,"stars_recorded_not_scored":5113,"medal_multiple":null,"medal_measure":null,"medal_tier":null,"rising":false,"snapshot_id":"9d2fe956adbc","snapshot_date":"2026-09-26"},{"entity_id":"e_MMGH765AVAA","name":"KTransformers","url":"https://evidaxis.org/e/e_MMGH765AVAA/","niche":"Inference & Serving","measured_line":"4.3 commits/week, 9 citations to date (count only), 1 verified direct dependents (count only).","commits_per_week":4.3,"citations_to_date":9,"citations_state":"count_only","verified_direct_dependents":1,"verified_dependents_state":"count_only","direct_dependents_reading":1,"stars_recorded_not_scored":19537,"medal_multiple":null,"medal_measure":null,"medal_tier":null,"rising":false,"snapshot_id":"9d2fe956adbc","snapshot_date":"2026-09-26"},{"entity_id":"e_Z7YDNC4F139","name":"llama.cpp","url":"https://evidaxis.org/e/e_Z7YDNC4F139/","niche":"Inference & Serving","measured_line":"132.6 commits/week, citations not measured, verified dependents not measured.","commits_per_week":132.6,"citations_to_date":null,"citations_state":"not_measured","verified_direct_dependents":null,"verified_dependents_state":"not_measured","direct_dependents_reading":68,"stars_recorded_not_scored":129606,"medal_multiple":null,"medal_measure":null,"medal_tier":null,"rising":false,"snapshot_id":"9d2fe956adbc","snapshot_date":"2026-09-26"},{"entity_id":"e_KR3M8ESKAEW","name":"llm-d","url":"https://evidaxis.org/e/e_KR3M8ESKAEW/","niche":"Inference & Serving","measured_line":"32 commits/week, citations not measured, verified dependents not measured.","commits_per_week":32,"citations_to_date":null,"citations_state":"not_measured","verified_direct_dependents":null,"verified_dependents_state":"not_measured","direct_dependents_reading":null,"stars_recorded_not_scored":4661,"medal_multiple":null,"medal_measure":null,"medal_tier":null,"rising":false,"snapshot_id":"9d2fe956adbc","snapshot_date":"2026-09-26"},{"entity_id":"e_V05C8HCBBV2","name":"LMCache","url":"https://evidaxis.org/e/e_V05C8HCBBV2/","niche":"Inference & Serving","measured_line":"40.2 commits/week, 2 citations to date (count only), 3 verified direct dependents (count only).","commits_per_week":40.2,"citations_to_date":2,"citations_state":"count_only","verified_direct_dependents":3,"verified_dependents_state":"count_only","direct_dependents_reading":3,"stars_recorded_not_scored":11912,"medal_multiple":null,"medal_measure":null,"medal_tier":null,"rising":false,"snapshot_id":"9d2fe956adbc","snapshot_date":"2026-09-26"},{"entity_id":"e_1ER3NPA3Y77","name":"LMDeploy","url":"https://evidaxis.org/e/e_1ER3NPA3Y77/","niche":"Inference & Serving","measured_line":"13.1 commits/week, citations not measured, verified dependents not measured.","commits_per_week":13.1,"citations_to_date":null,"citations_state":"not_measured","verified_direct_dependents":null,"verified_dependents_state":"not_measured","direct_dependents_reading":null,"stars_recorded_not_scored":8099,"medal_multiple":null,"medal_measure":null,"medal_tier":null,"rising":false,"snapshot_id":"9d2fe956adbc","snapshot_date":"2026-09-26"},{"entity_id":"e_N2RFM19TP1D","name":"Mooncake","url":"https://evidaxis.org/e/e_N2RFM19TP1D/","niche":"Inference & Serving","measured_line":"64.3 commits/week, 13 citations to date (count only), verified dependents not measured.","commits_per_week":64.3,"citations_to_date":13,"citations_state":"count_only","verified_direct_dependents":null,"verified_dependents_state":"not_measured","direct_dependents_reading":0,"stars_recorded_not_scored":6664,"medal_multiple":null,"medal_measure":null,"medal_tier":null,"rising":false,"snapshot_id":"9d2fe956adbc","snapshot_date":"2026-09-26"},{"entity_id":"e_D5HEA3Z5ZYZ","name":"Nano-vLLM","url":"https://evidaxis.org/e/e_D5HEA3Z5ZYZ/","niche":"Inference & Serving","measured_line":"0 commits/week, citations not measured, verified dependents not measured.","commits_per_week":0,"citations_to_date":null,"citations_state":"not_measured","verified_direct_dependents":null,"verified_dependents_state":"not_measured","direct_dependents_reading":null,"stars_recorded_not_scored":15631,"medal_multiple":null,"medal_measure":null,"medal_tier":null,"rising":false,"snapshot_id":"9d2fe956adbc","snapshot_date":"2026-09-26"},{"entity_id":"e_TRJN6D7V12H","name":"Ollama","url":"https://evidaxis.org/e/e_TRJN6D7V12H/","niche":"Inference & Serving","measured_line":"23.6 commits/week, citations not measured, 1,078 verified direct dependents.","commits_per_week":23.6,"citations_to_date":null,"citations_state":"not_measured","verified_direct_dependents":1078,"verified_dependents_state":"scored","direct_dependents_reading":1078,"stars_recorded_not_scored":181771,"medal_multiple":134,"medal_measure":"dependents","medal_tier":"gold","rising":false,"snapshot_id":"9d2fe956adbc","snapshot_date":"2026-09-26"},{"entity_id":"e_77AC6K7XEWB","name":"SGLang","url":"https://evidaxis.org/e/e_77AC6K7XEWB/","niche":"Inference & Serving","measured_line":"499.5 commits/week, 102 citations to date (count only), 13 verified direct dependents.","commits_per_week":499.5,"citations_to_date":102,"citations_state":"count_only","verified_direct_dependents":13,"verified_dependents_state":"scored","direct_dependents_reading":13,"stars_recorded_not_scored":36455,"medal_multiple":7.8,"medal_measure":"citations","medal_tier":"bronze","rising":false,"snapshot_id":"9d2fe956adbc","snapshot_date":"2026-09-26"},{"entity_id":"e_9SWWW2SWASG","name":"TensorRT-LLM","url":"https://evidaxis.org/e/e_9SWWW2SWASG/","niche":"Inference & Serving","measured_line":"191.2 commits/week, citations not measured, 0 verified direct dependents (count only).","commits_per_week":191.2,"citations_to_date":null,"citations_state":"not_measured","verified_direct_dependents":0,"verified_dependents_state":"count_only","direct_dependents_reading":0,"stars_recorded_not_scored":14719,"medal_multiple":null,"medal_measure":null,"medal_tier":null,"rising":false,"snapshot_id":"9d2fe956adbc","snapshot_date":"2026-09-26"},{"entity_id":"e_R372CCSVG44","name":"vLLM","url":"https://evidaxis.org/e/e_R372CCSVG44/","niche":"Inference & Serving","measured_line":"536.9 commits/week, 1,587 citations to date (count only), 150 verified direct dependents.","commits_per_week":536.9,"citations_to_date":1587,"citations_state":"count_only","verified_direct_dependents":150,"verified_dependents_state":"scored","direct_dependents_reading":150,"stars_recorded_not_scored":92723,"medal_multiple":122,"medal_measure":"citations","medal_tier":"gold","rising":false,"snapshot_id":"9d2fe956adbc","snapshot_date":"2026-09-26"},{"entity_id":"e_8A2A58V55P6","name":"Xinference","url":"https://evidaxis.org/e/e_8A2A58V55P6/","niche":"Inference & Serving","measured_line":"29.2 commits/week, citations not measured, verified dependents not measured.","commits_per_week":29.2,"citations_to_date":null,"citations_state":"not_measured","verified_direct_dependents":null,"verified_dependents_state":"not_measured","direct_dependents_reading":null,"stars_recorded_not_scored":9592,"medal_multiple":null,"medal_measure":null,"medal_tier":null,"rising":false,"snapshot_id":"9d2fe956adbc","snapshot_date":"2026-09-26"}]}