-
Notifications
You must be signed in to change notification settings - Fork 661
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Multi-objective hyperparameter optimization #265
Comments
CC @braham-snyder we are tracking the progress w/ developing multi-objective hyperparameter optimization here. I think a first prototype is to support maximizing normalized scores while minimizing runtime. Let me know if you or anyone else who are interested in working on this, we always welcome new contributors :) |
Thanks -- it's unlikely I'll have anything contributable here, but if I were to I'd definitely let you know |
Had some preliminary results w/ multi-objective stuff, as shown in the following figure. The x-axis is the normalized score of CartPole-v1 and Acrobat-v1, and the y-axis is the average runtime (in seconds). We can see the Pareto Front highlighted in red, so we can pick a set of hyperparameters that achieves high normalized scores while remaining fast. |
Overview
#228 prototyped a great initial integration with optuna to do hyperparameter optimization. However, it has a couple of downsides:
I believe incorporating the multi-objective optimization API from optuna could offer an elegant solution to these issues. See https://optuna.readthedocs.io/en/stable/tutorial/20_recipes/002_multi_objective.html.
The text was updated successfully, but these errors were encountered: