Measure Model Performance

[Minor] Improve performance based on profiling results #2188

Sign in to view logs

GitHub Actions / ModelReport succeeded Aug 5, 2024 in 0s

ModelReport

Model Benchmark

Benchmark	Metric	main	current	diff
PeytonManning	MAE_val	0.35539	0.35539	0.0%	✅
PeytonManning	RMSE_val	0.50401	0.50401	0.0%	✅
PeytonManning	Loss_val	0.01803	0.01803	0.0%	✅
PeytonManning	train_loss	0.01466	0.01466	0.0%	✅
PeytonManning	reg_loss	0	0	0.0%	✅
PeytonManning	MAE	0.34755	0.34755	0.0%	✅
PeytonManning	RMSE	0.49449	0.49449	0.0%	✅
PeytonManning	Loss	0.01465	0.01465	0.0%	✅
PeytonManning	time	55.9486	58.87	5.22%	⚠️
YosemiteTemps	MAE_val	0.59734	0.59734	0.0%	✅
YosemiteTemps	RMSE_val	0.88884	0.88884	0.0%	✅
YosemiteTemps	Loss_val	0.00046	0.00046	0.0%	✅
YosemiteTemps	train_loss	0.00126	0.00126	0.0%	✅
YosemiteTemps	reg_loss	0	0	0.0%	✅
YosemiteTemps	MAE	0.97461	0.97461	0.0%	✅
YosemiteTemps	RMSE	1.70806	1.70806	0.0%	✅
YosemiteTemps	Loss	0.00126	0.00126	0.0%	✅
YosemiteTemps	time	210.194	207.69	-1.19%	✅
EnergyPriceDaily	MAE_val	5.64186	5.64186	0.0%	✅
EnergyPriceDaily	RMSE_val	7.19914	7.19914	0.0%	✅
EnergyPriceDaily	Loss_val	0.02893	0.02893	0.0%	✅
EnergyPriceDaily	train_loss	0.02957	0.02957	0.0%	✅
EnergyPriceDaily	reg_loss	0	0	0.0%	✅
EnergyPriceDaily	MAE	6.39655	6.39655	0.0%	✅
EnergyPriceDaily	RMSE	8.56207	8.56207	0.0%	✅
EnergyPriceDaily	Loss	0.02936	0.02936	0.0%	✅
EnergyPriceDaily	time	58.1817	62.45	7.34%	❌
AirPassengers	MAE_val	30.8328	30.8328	0.0%	✅
AirPassengers	RMSE_val	31.8182	31.8182	0.0%	✅
AirPassengers	Loss_val	0.01301	0.01301	0.0%	✅
AirPassengers	train_loss	0.00071	0.00071	0.0%	✅
AirPassengers	reg_loss	0	0	0.0%	✅
AirPassengers	MAE	6.88174	6.88174	0.0%	✅
AirPassengers	RMSE	8.92109	8.92109	0.0%	✅
AirPassengers	Loss	0.00076	0.00076	0.0%	✅
AirPassengers	time	12.689	13.71	8.05%	❌

Model training plots

Model Training

PeytonManning

YosemiteTemps

AirPassengers

EnergyPriceDaily

View more details on GitHub Actions