This repository has been archived by the owner on Sep 24, 2024. It is now read-only.
verify trust_remote_code is being handled correctly
#115
Comments
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
#114 changes the
hellaswagtask toGLUEto get around the flakey test issue.EleutherAI/lm-evaluation-harness#2029 addresses hellaswag specifically, though it's not included in a release of lm-eval yet.
we need to ensure lm-buddy can pass the arg to lm-eval as well as hf models/datasets.
The text was updated successfully, but these errors were encountered: