Vercel's AI SDK has received updates, including the introduction of an experimental speech translation model specification, Experimental_SpeechTranslationModelV4, and a corresponding experimental_streamTranslate function for streaming speech-to-speech translation. These changes are part of the ai@7.0.38 release, which also addresses client tool errors.
Key Points
- The Vercel AI SDK now includes an experimental speech translation model specification, Experimental_SpeechTranslationModelV4.
- A new
experimental_streamTranslatefunction supports streaming speech-to-speech translation. - The update
ai@7.0.38avoids synthesizing client tool errors for invalid provider-executed tool calls. - TogetherAI streaming responses now report token usage, enabled by the
includeUsagefeature. - This
includeUsagefeature for TogetherAI was noted in releases@ai-sdk/togetherai@1.0.50and@ai-sdk/togetherai@2.0.68on July 27.
Context
According to the Vercel AI SDK Changelog, the ai@7.0.38 release incorporates updates across several packages, including @ai-sdk/gateway@4.0.29, @ai-sdk/provider@4.0.4, @ai-sdk/provider-utils@5.0.13, @ai-sdk/alibaba@2.0.17, @ai-sdk/amazon-bedrock@5.0.33, @ai-sdk/anthropic@4.0.22, @ai-sdk/openai@4.0.21, and @ai-sdk/angular@3.0.38. The Vercel AI SDK Changelog also indicates that the includeUsage feature for TogetherAI was enabled in separate patch changes for @ai-sdk/togetherai@1.0.50 and @ai-sdk/togetherai@2.0.68 on July 27.
Why It Matters
These updates expand the capabilities of the Vercel AI SDK by adding new experimental features like speech translation and improving transparency for developers using TogetherAI through token usage reporting. Builders can now explore new multimodal applications and better monitor resource consumption.
What To Do
- Note the
experimental_streamTranslatefunction for potential speech-to-speech translation applications. - Review the Vercel AI SDK documentation for details on Experimental_SpeechTranslationModelV4.
- Check the
includeUsagefeature for TogetherAI to monitor token consumption in streaming responses. - Compare the updated package versions for
@ai-sdk/togetheraiif using that provider.