The Vercel AI SDK has released an update for its TogetherAI integration, version @ai-sdk/togetherai@2.0.68, which enables the includeUsage feature. This enhancement allows streaming responses from TogetherAI to report token usage.
Key Points
- The Vercel AI SDK updated its TogetherAI integration to version @ai-sdk/togetherai@2.0.68.
- The update enables
includeUsagefor TogetherAI. - This feature allows streaming responses to report token usage.
- The change is identified by patch 3a46a2f.
- The release occurred on July 27.
Context
According to the Vercel AI SDK Changelog, the patch 3a46a2f specifically addresses the functionality of reporting token usage. This update was released on July 27.
Why It Matters
Builders using the Vercel AI SDK with TogetherAI can now gain more transparency into the resource consumption of their streaming AI applications, which can aid in cost management and performance monitoring.
What To Do
- Review the Vercel AI SDK documentation for TogetherAI to understand the
includeUsageimplementation. - Test the @ai-sdk/togetherai@2.0.68 version to observe token usage reporting in streaming responses.
- Compare token usage data for streaming versus non-streaming TogetherAI interactions if applicable.
- Note the patch 3a46a2f in your change logs if you are tracking Vercel AI SDK updates.
