The Vercel AI SDK has released version ai@7.0.102, which includes new experimental features for live conversations. This update adds browser-direct WebRTC capabilities for client-delegated Live conversations, offering an alternative to the existing WebSocket path. Additionally, the release introduces experimental support for the OpenAI Live provider.
Key Points
- The ai@7.0.102 release adds optional browser-direct WebRTC for experimental client-delegated Live conversations.
- This WebRTC path operates alongside the existing WebSocket path for live interactions.
- SDP exchange occurs through an application endpoint using
api.session. - Server-owned data-channel permissions can be configured, and React session ownership is preserved.
- The update also includes experimental OpenAI Live provider support.
- Applications are responsible for client delegation and context submission.
- Live session updates and Responses delegation remain unsupported in this release.
Context
According to the Vercel AI SDK changelog, the ai@7.0.102 update focuses on enhancing real-time conversational capabilities. This release builds upon previous updates, such as ai@7.0.101, which addressed issues like serializing tool output JSON values and preserving JSON Schema for Google provider tools. Earlier fixes also ensured that functionResponse.response remained an object for Gemini types, preventing socket closures due to unwrapped non-object tool results.
Why It Matters
The introduction of WebRTC and OpenAI Live provider support in the Vercel AI SDK offers developers new options for building real-time, client-delegated conversational AI applications. These features can enable more direct and potentially lower-latency interactions, expanding the scope of applications that can leverage the SDK for live AI experiences.
What To Do
- Note the new experimental browser-direct WebRTC path for Live conversations in ai@7.0.102.
- Review the documentation for
api.sessionregarding SDP exchange and server-owned data-channel permissions. - Test the experimental OpenAI Live provider support for new integration possibilities.
- Be aware that applications must still handle client delegation and context submission, as Live session updates and Responses delegation are not yet supported.
