Sign in
← AI PulseSep 15, 2026

Wire · news · Multi-source brief

Vercel AI SDK Adds Experimental OpenAI Live Provider Support and WebRTC for Client-Delegated Conversations

The Vercel AI SDK now includes experimental support for OpenAI Live providers and optional browser-direct WebRTC for client-delegated Live conversations, according to recent changelog entries.

By Illumora Editorial

Source · Sep 15, 2026, 5:15 PM · On Illumora · Sep 15, 2026, 5:28 PM

Media from the primary source — shown here so you can stay on Illumora.

Synthesized from multiple allowlisted primaries on the same event. Lanes →

Brief drafted by Illumora’s editorial model from the linked primary source. Ops desk reviews flagged pieces. How we write →

Read the source →Vercel AI SDK Changelog — Release @ai-sdk/workflow-harness@1.0.112 · vercel/ai
Save

The Vercel AI SDK has introduced experimental support for OpenAI Live providers. This update also adds optional browser-direct WebRTC for client-delegated Live conversations, operating alongside the existing WebSocket path, as detailed in the Vercel AI SDK changelog.

Key Points

  • The Vercel AI SDK now supports experimental OpenAI Live providers.
  • Optional browser-direct WebRTC is available for client-delegated Live conversations.
  • WebRTC functionality operates in parallel with the existing WebSocket path.
  • SDP exchange occurs through an application endpoint with api.session.
  • Server-owned data-channel permissions can be configured.
  • Committed React session ownership is preserved.
  • Applications are responsible for handling client delegation and submitting context.
  • Live session updates and Responses delegation remain unsupported.
  • The Vercel AI SDK also fixed an issue where Gemini closed sockets due to non-object tool results, now wrapping them under an output key.

Context

According to the Vercel AI SDK changelog, the new WebRTC implementation allows for browser-direct communication, with capture following the selected sender track. Borrowed tracks remain caller-owned, and disconnect recovery and finalization are bounded. The changelog also notes that microphone sender changes are serialized, and the peer closes if detachment fails without stopping borrowed tracks. Nonempty SDP setup answers are validated with a bounded response body, and a same-origin broker authentication contract is documented. Separately, the Vercel AI SDK addressed a bug where Gemini types expected a google.protobuf.Struct for functionResponse.response, which only accepts objects, leading to socket closures when non-object tool results were sent. The fix now wraps these non-object results under an output key.

Why It Matters

The addition of experimental OpenAI Live provider support and WebRTC capabilities expands the real-time interaction possibilities for developers using the Vercel AI SDK. These updates offer new avenues for client-delegated conversations and improve robustness in tool call handling with Gemini, potentially enhancing the responsiveness and reliability of AI-powered applications.

What To Do

  • Developers can explore the new experimental OpenAI Live provider support within the Vercel AI SDK.
  • Investigate the optional browser-direct WebRTC path for client-delegated Live conversations.
  • Review the documentation for api.session and data-channel permissions for WebRTC integration.
  • Note the current limitations regarding Live session updates and Responses delegation.
  • For Gemini users, verify that tool output JSON values are correctly serialized and handled, especially non-object results.

Keep Exploring

/atlas/**gemini**-family /atlas/gpt-family /techniques/output-schema /techniques/system-user-separation /studio?pack=foundation