live wire
▸Red Hat ships important MicroShift 4.16.73 security updateRed Hat Product Errata▸AI · Red Hat maps local AI Inference serving and load tests on RHEL (Oct. 15)Red Hat Emerging Technologies▸PLATFORM · IBM guide maps Secure Execution VMs onto OpenShift Virtualization for LinuxONEIBM Community▸AI · vLLM maps Nemotron 3.5 Super VL across Hopper, Blackwell and Red Hat DSpark (Oct. 15)vLLM Recipes▸AI · AWS contributes push-based KV transfer to vLLM, reporting 3x better TTFT under loadAWS Machine Learning Blog▸AI · AWS contributes bidirectional KV transfer to vLLM, cutting multi-turn TTFT up to 3.3xAWS Machine Learning Blog▸AI · vLLM Semantic Router adds d3-turbo with box and video-tracking decisionsvLLM Semantic Router▸IDENTITY · Keycloak DevDay 2027 opens call for deep technical talks through Oct. 24Keycloak▸AI · vLLM Recipes maps Muse Spark Open to single-node Blackwell and AMD deployment (Oct. 16)vLLM▸PLATFORM · Clang 23 bytecode interpreter cuts allocations and expands constant-expression supportRed Hat Developer▸PLATFORM · RHEL becomes first-party on OCI; OpenShift subscriptions reach Oracle MarketplaceRed Hat▸AI · vLLM-Omni merges native MOSS-Image serving with parallelism and offloadvLLM▸AI · vLLM adds System One endpoint for Decision 3.0 multimodal routing models (Oct. 15)vLLM▸SECURITY · Red Hat rates OpenShift AI 3.4.5 update Critical; advisory lists hundreds of CVEsRed Hat Product Security▸Red Hat ships important MicroShift 4.16.73 security updateRed Hat Product Errata▸AI · Red Hat maps local AI Inference serving and load tests on RHEL (Oct. 15)Red Hat Emerging Technologies▸PLATFORM · IBM guide maps Secure Execution VMs onto OpenShift Virtualization for LinuxONEIBM Community▸AI · vLLM maps Nemotron 3.5 Super VL across Hopper, Blackwell and Red Hat DSpark (Oct. 15)vLLM Recipes▸AI · AWS contributes push-based KV transfer to vLLM, reporting 3x better TTFT under loadAWS Machine Learning Blog▸AI · AWS contributes bidirectional KV transfer to vLLM, cutting multi-turn TTFT up to 3.3xAWS Machine Learning Blog▸AI · vLLM Semantic Router adds d3-turbo with box and video-tracking decisionsvLLM Semantic Router▸IDENTITY · Keycloak DevDay 2027 opens call for deep technical talks through Oct. 24Keycloak▸AI · vLLM Recipes maps Muse Spark Open to single-node Blackwell and AMD deployment (Oct. 16)vLLM▸PLATFORM · Clang 23 bytecode interpreter cuts allocations and expands constant-expression supportRed Hat Developer▸PLATFORM · RHEL becomes first-party on OCI; OpenShift subscriptions reach Oracle MarketplaceRed Hat▸AI · vLLM-Omni merges native MOSS-Image serving with parallelism and offloadvLLM▸AI · vLLM adds System One endpoint for Decision 3.0 multimodal routing models (Oct. 15)vLLM▸SECURITY · Red Hat rates OpenShift AI 3.4.5 update Critical; advisory lists hundreds of CVEsRed Hat Product Security
upstreambeat.ai
releaseAI

vLLM Agentic API 0.8 makes stateful open-model agents easier to operate

The Rust gateway adds opt-in telemetry, preserves images across response continuations and broadens its server-side search and MCP handling.

By The News Desk· Sep 28, 2026the quick take — two AI hosts go live when you do

vLLM’s Agentic API project has released version 0.8.0, expanding the operational layer that sits in front of model servers for stateful agent workloads. The release adds opt-in OpenTelemetry support, keeps image inputs intact across response continuations and introduces Brave Search as another server-owned search provider.

What changed

The release can emit OpenTelemetry traces and HTTP metrics over OTLP HTTP/protobuf, propagate W3C trace context and correlate those traces with local logs. Telemetry remains disabled by default, so operators must opt in rather than absorb a new observability path during an upgrade.

Agentic API 0.8 also preserves images across Responses API requests, stored continuations and both HTTP and WebSocket transports. The project says it now resolves image capabilities consistently for Codex model catalogs and launchers. That closes an important continuity gap for agents that analyze images across multiple turns instead of treating every image request as a disconnected inference call.

The tool layer gained Brave Search as a selectable web-search provider, including provider concurrency limits. MCP discovery now follows pagination cursors returned by tools/list, avoiding an incomplete tool inventory when a server exposes more than one page. The release also separates logical retained-response accounting from raw SSE framing and reports token usage across every round of a Messages tool loop.

Who should care

Platform teams using vLLM behind coding assistants or other agent clients get the clearest benefit. The gateway’s role is not faster token generation; it is to own conversation state, streaming, tool execution and continuation around an inference backend. Version 0.8 makes that control plane more observable and less likely to lose multimodal context during longer sessions.

Developers embedding Agentic API as a Rust dependency should review the migration notes. The release changes source-level APIs around input content, configuration, typed resource-limit errors and web-search provider construction. Existing persistent Codex session homes should also be regenerated so that the updated image capability data is picked up.

What to do

The project publishes 0.8.0 through crates.io and PyPI, with portable Python wheels for Linux x86_64 and both Intel and Apple Silicon macOS. A verified Docker image is available as vllm/agentic-api:v0.8.0.

Operators should enable telemetry first in a test environment, verify their collector and trace-context settings, and exercise stored multimodal continuations before promoting the release. Teams maintaining Rust integrations should treat this as a migration rather than a drop-in library update.

sources

Filed by The News Desk. Corrections: desk@upstreambeat.ai · Our standards →

comments · 0

    Comments are moderated before they appear. Your email is used once to confirm it is you — never shown, never sold. Corrections and questions get an answer from the desk when we have one.

    more from the desk