.svg){kind=logo}
The following sections list every released version of Agentic Inference Server, newest first. Each section comes from the monthly OCP® Release Notes page named in its Released line.
Agentic Inference Server 1.1.0
Released: November 2026
|
US1 |
US2 |
EU1 |
|---|---|---|
|
— |
— |
— |
New features
-
MLFlow support for main model
-
Drafter/speculative decoding integration, with MLFlow support for drafter model
-
Auth/authz implementation
Improvements
-
Expanded hardware/runtime compatibility, and adjusted per-hardware configs
-
Overall throughput improvement, which reduces cost
-
~0.2 req/s throughput improvement for Q&A (0.6->0.8 for bs=1, 1.2->1.5 for bs=5
-
0.6-3 req/s throughput improvement for Router (2.7->3.3 for bs=1, 20.5->23.4 for bs=20)
-
-
Overall latency improvement, which improves CX (reported numbers for autoregressive; expect even lower ITL with speculative decoding)
-
1100->900ms P50 TTFS, 12.6->9.5 avg ITL for Q&A cc=1
-
620->560ms P50 TTFS, 26.4->21.3 avg ITL for Router cc=20
-