Feature: Calculate usage info for streamed responses #46
Labels
bug
Something isn't working
enhancement
New feature or request
help wanted
Extra attention is needed
usage
Milestone
Streamed responses don't include usage info in the response. Would have to calculate this via [tiktoken])(https://github.com/dqbd/tiktoken) e.g., but that would be a big dependency for the project.
Alternatively, count chunks manually for rough estimate (more info).
The text was updated successfully, but these errors were encountered: