Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix inconsistent evaluation results #28

Merged
merged 11 commits into from
Apr 9, 2024
Merged

Fix inconsistent evaluation results #28

merged 11 commits into from
Apr 9, 2024

Commits on Apr 8, 2024

  1. refactor: claude evaluator flow and prompts

    @tonykchen
    tonykchen committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    06dbd05 View commit details
    Browse the repository at this point in the history

  2. docs: add evaluation flowchart

    @tonykchen
    tonykchen committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    ea33172 View commit details
    Browse the repository at this point in the history

  3. feat: set Cluade 3 haiku as default evaluator model

    @tonykchen
    tonykchen committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    6652196 View commit details
    Browse the repository at this point in the history

  4. refactor: remove claude instant

    @tonykchen
    tonykchen committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    e4e2328 View commit details
    Browse the repository at this point in the history

  5. docs: revamp README

    @tonykchen
    tonykchen committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    d8c62a3 View commit details
    Browse the repository at this point in the history

  6. refactor: use enum for categories and results

    @tonykchen
    tonykchen committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    d7fafd1 View commit details
    Browse the repository at this point in the history

  7. fix: implement backwards-compatible StrEnum

    @tonykchen
    tonykchen committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    5b74875 View commit details
    Browse the repository at this point in the history

Commits on Apr 9, 2024

  1. docs: update user guide

    @tonykchen
    tonykchen committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    c4808ee View commit details
    Browse the repository at this point in the history

  2. docs: update user guide

    @tonykchen
    tonykchen committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    5b3a164 View commit details
    Browse the repository at this point in the history

  3. fix: rephrase prompt for clarity

    @tonykchen
    tonykchen committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    b4ca3e6 View commit details
    Browse the repository at this point in the history

  4. fix: use claude-sonnet as default model

    @tonykchen
    tonykchen committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    4bb56c5 View commit details
    Browse the repository at this point in the history