← AI PulseSep 15, 2026

Wire · news · Multi-source brief

Vercel AI SDK Adds Experimental WebRTC and OpenAI Live Provider Support

The Vercel AI SDK has introduced experimental client-delegated WebRTC for Live conversations and support for the OpenAI Live provider, according to recent changelog entries.

By Illumora Editorial

Source · Sep 15, 2026, 5:15 PM · On Illumora · Sep 15, 2026, 5:28 PM

Media from the primary source — shown here so you can stay on Illumora.

Synthesized from multiple allowlisted primaries on the same event. Lanes →

Brief drafted by Illumora’s editorial model from the linked primary source. Ops desk reviews flagged pieces. How we write →

Read the source →Vercel AI SDK Changelog — Release @ai-sdk/zai@3.0.11 · vercel/ai
Save

The Vercel AI SDK has added experimental features for real-time interactions, including client-delegated WebRTC for Live conversations and support for the OpenAI Live provider. These updates are part of the @ai-sdk/zai@3.0.11 and ai@7.0.102 releases, as detailed in the Vercel AI SDK changelog.

Key Points

  • The @ai-sdk/zai@3.0.11 release introduces optional browser-direct WebRTC for experimental client-delegated Live conversations.
  • This WebRTC functionality operates alongside the existing WebSocket path.
  • Applications can exchange Session Description Protocol (SDP) through an api.session endpoint.
  • Server-owned data-channel permissions can be configured, and committed React session ownership is preserved.
  • The ai@7.0.102 release adds experimental OpenAI Live provider support.
  • Vercel AI SDK also fixed an issue in @ai-sdk/google@4.0.70 where Gemini types expected a google.protobuf.Struct for functionResponse.response.
  • A fix in @ai-sdk/xai@3.0.133 ensures additionalProperties: false is preserved in tool schemas.

Context

According to the Vercel AI SDK changelog, the new WebRTC path allows for client-delegated Live conversations, where applications handle client delegation and submit context. Live session updates and Responses delegation remain unsupported with this new feature. The changelog also notes that the Gemini fix addresses a problem where non-object tool results caused socket disconnections.

Why It Matters

These updates provide developers using the Vercel AI SDK with new experimental capabilities for real-time conversational AI, potentially enabling more direct and efficient client-side interactions. The fixes for Gemini and tool schemas address critical technical issues that can impact the reliability and functionality of AI applications.

What To Do

  • Review the @ai-sdk/zai@3.0.11 and ai@7.0.102 changelog entries for full details on the experimental WebRTC and OpenAI Live provider support.
  • Test the new experimental WebRTC path for client-delegated Live conversations in development environments.
  • Note the specific requirements for SDP exchange and data-channel permissions when implementing the new WebRTC features.
  • Verify that tool schemas in your applications correctly preserve additionalProperties: false if using @ai-sdk/xai.