[Devops] update metrics ci with new tests

[ourownstory]

• Update to include new test from [tests] Model tests expansion (partially undone in #1464) #1455
• may clash with [Devops] Run metrics job from forks #1113
• Unsuccessfully tried to update CI to use poetry instead of pip

[codecov]

Codecov Report

Merging #1457 (7a1bd00) into main (951198d) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main    #1457   +/-   ##
=======================================
  Coverage   88.32%   88.32%           
=======================================
  Files          38       38           
  Lines        5097     5097           
=======================================
  Hits         4502     4502           
  Misses        595      595           

[github-actions]

Model Benchmark

Benchmark	Metric	main	current	diff
PeytonManning_test30	MAE_val	-	0.9731	-
PeytonManning_test30	RMSE_val	-	1.128	-
PeytonManning_test30	Loss_val	-	0.0317	-
PeytonManning_test30	MAE	-	0.33	-
PeytonManning_test30	RMSE	-	0.4574	-
PeytonManning_test30	Loss	-	0.0044	-
PeytonManning_test30	time	-	45.34	-
YosemiteTemps	MAE_val	1.34899	0.44287	-67.17%	🎉
YosemiteTemps	RMSE_val	2.00817	0.62874	-68.69%	🎉
YosemiteTemps	Loss_val	0.00078	7e-05	-91.32%	🎉
YosemiteTemps	MAE	1.32133	0.80138	-39.35%	🎉
YosemiteTemps	RMSE	2.13713	1.44081	-32.58%	🎉
YosemiteTemps	Loss	0.00064	0.00027	-57.67%	🎉
YosemiteTemps	time	63.56224	141.45	122.54%	❌
YosemiteTemps_test20	MAE_val	-	1.8	-
YosemiteTemps_test20	RMSE_val	-	2.2687	-
YosemiteTemps_test20	Loss_val	-	0.001	-
YosemiteTemps_test20	MAE	-	0.8432	-
YosemiteTemps_test20	RMSE	-	1.4617	-
YosemiteTemps_test20	Loss	-	0.0003	-
YosemiteTemps_test20	time	-	124.49	-
AirPassengers_test30	MAE_val	-	25.3608	-
AirPassengers_test30	RMSE_val	-	30.624	-
AirPassengers_test30	Loss_val	-	0.0074	-
AirPassengers_test30	MAE	-	5.3982	-
AirPassengers_test30	RMSE	-	6.8828	-
AirPassengers_test30	Loss	-	0.0002	-
AirPassengers_test30	time	-	20.17	-
AirPassengers	MAE_val	13.0627	30.1272	130.64%	❌
AirPassengers	RMSE_val	15.94532	31.014	94.5%	❌
AirPassengers	Loss_val	0.00131	0.00371	182.63%	❌
AirPassengers	MAE	9.88153	6.27639	-36.48%	🎉
AirPassengers	RMSE	11.73543	7.88805	-32.78%	🎉
AirPassengers	Loss	0.00052	0.00019	-62.92%	🎉
AirPassengers	time	5.81633	20.94	260.02%	❌
PeytonManning	MAE_val	0.58162	0.34778	-40.21%	🎉
PeytonManning	RMSE_val	0.72218	0.49928	-30.86%	🎉
PeytonManning	Loss_val	0.01239	0.00595	-51.96%	🎉
PeytonManning	MAE	0.41671	0.35123	-15.71%	🎉
PeytonManning	RMSE	0.55961	0.48066	-14.11%	🎉
PeytonManning	Loss	0.00612	0.0046	-24.8%	🎉
PeytonManning	time	13.84269	52.46	278.97%	❌

Model training plots

Model Training

PeytonManning

PeytonManning_test30

YosemiteTemps

YosemiteTemps_test20

AirPassengers

AirPassengers_test30