The Vercel AI SDK has released updates, including the addition of a Fish Audio provider. This new provider supports both speech and transcription models, as detailed in the changelog for @ai-sdk/fish-audio@3.0.0.
Key Points
- The Fish Audio provider has been added to the Vercel AI SDK, supporting speech and transcription models.
ToolLoopAgentprepareCallcallbacks can now read and override the top-level reasoning option.- A
defaultInstructionsMiddlewarehas been introduced for applying default language model instructions while preserving call-level overrides. - Preceding assistant messages are now preserved when regenerating a response.
- The SDK rejects spliced Anthropic generations but allows duplicate message start events for the active message.
Context
According to the Vercel AI SDK changelog, these updates are part of a series of package releases, including @ai-sdk/tui@1.0.55, @ai-sdk/vercel@3.0.24, @ai-sdk/valibot@3.0.22, and @ai-sdk/voyage@2.0.22. The changes reflect ongoing development in the ai@7.0.54 package and its dependencies, such as @ai-sdk/amazon-bedrock@5.0.45 and @ai-sdk/anthropic@4.0.32.
Why It Matters
The addition of the Fish Audio provider expands the SDK's multimodal capabilities, offering developers new options for integrating speech and transcription functionalities. Enhancements to ToolLoopAgent and instruction handling provide greater control and flexibility for managing language model interactions and agent behavior.
What To Do
- Review the updated documentation for the Fish Audio provider to understand its speech and transcription model capabilities.
- Examine the
ToolLoopAgentprepareCallcallbacks for opportunities to customize reasoning options. - Investigate the
defaultInstructionsMiddlewareto implement consistent language model instructions with override capabilities. - Note the behavior regarding Anthropic generations, specifically the rejection of spliced generations and allowance of duplicate message start events.
