Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add support for js functions as scorer #230

Merged
merged 15 commits into from
May 22, 2024

Conversation

saikatmitra91
Copy link
Member

No description provided.

Copy link

changeset-bot bot commented May 21, 2024

🦋 Changeset detected

Latest commit: 07ff068

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 4 packages
Name Type
empiricalrun Minor
@empiricalrun/scorer Minor
@empiricalrun/types Minor
web Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

Copy link
Contributor

github-actions bot commented May 21, 2024

Empirical Run Summary

Run #9479: gpt-3.5-turbo Run #f200: gpt-4-turbo-preview
Outputs 100% 100%
Scores
json-syntax 100% 100%
Avg latency 832ms 1763ms

Total dataset samples: 2

@saikatmitra91 saikatmitra91 marked this pull request as ready for review May 22, 2024 09:53
@saikatmitra91 saikatmitra91 merged commit f61545c into main May 22, 2024
3 checks passed
@saikatmitra91 saikatmitra91 deleted the feat/add-js-function-support branch May 22, 2024 12:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants