The Vercel AI SDK has released version 7.0.102, which includes new experimental features for live conversations. This update adds browser-direct WebRTC capabilities for client-delegated Live conversations, offering an alternative to the existing WebSocket path. Additionally, the SDK now supports an experimental OpenAI Live provider.
Key Points
- The ai@7.0.102 release adds optional browser-direct WebRTC for experimental client-delegated Live conversations.
- This WebRTC path operates alongside the existing WebSocket path for live conversations.
- The update includes experimental OpenAI Live provider support.
- SDP is exchanged through an application endpoint using
api.session. - Server-owned data-channel permissions can be configured.
- Committed React session ownership is preserved.
- Capture follows the selected sender track, and borrowed tracks remain caller-owned.
- Disconnect recovery and finalization remain bounded.
- Applications continue to handle client delegation and submit context.
- Live session updates and Responses delegation are not supported.
- Microphone sender changes are serialized, and the peer closes if detachment fails without stopping borrowed tracks.
- Nonempty SDP setup answers are validated with a bounded response body.
- The same-origin broker authentication contract is documented.
- The ai@7.0.101 release fixed serialization of tool output JSON values.
- The @ai-sdk/google@4.0.70 release fixed an issue where non-object tool results caused Gemini to close the socket.
- The @ai-sdk/xai@3.0.133 release fixed the preservation of
additionalProperties: falsein tool schemas.
Context
According to the Vercel AI SDK changelog, the ai@7.0.102 patch changes focus on enhancing live conversation capabilities. This includes the introduction of WebRTC for direct browser communication, which complements the existing WebSocket infrastructure. The SDK also now supports OpenAI's Live features experimentally. Previous updates, such as ai@7.0.101, addressed issues with tool output serialization, while @ai-sdk/google@4.0.70 corrected how non-object tool results were handled with Gemini, preventing socket closures. The @ai-sdk/xai@3.0.133 release specifically addressed the preservation of additionalProperties: false in tool schemas.
Why It Matters
The addition of WebRTC and experimental OpenAI Live provider support in the Vercel AI SDK expands the options for developers building real-time conversational AI applications. These features offer new pathways for client-delegated interactions and broader model integration, potentially impacting how live AI experiences are constructed and deployed.
What To Do
- Note the introduction of experimental browser-direct WebRTC for client-delegated Live conversations in ai@7.0.102.
- Observe the new experimental OpenAI Live provider support.
- Review the documentation regarding SDP exchange via
api.sessionand server-owned data-channel permissions. - Test the handling of client delegation and context submission, noting that Live session updates and Responses delegation are not yet supported.
- Compare the WebRTC path with the existing WebSocket path for live conversations in your applications.
