Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Index benchmark metadata #346

Merged

Conversation

rsevilla87
Copy link
Member

@rsevilla87 rsevilla87 commented Mar 21, 2022

Signed-off-by: Raul Sevilla [email protected]

Description

Index benchmark metadata leveraging the run_benchmark helper. Some benchmarks such as router-perf does not use that wrapper, we'll have to implement this functionallity separately.
Also renaming the start_date to the common timestamp field

Fixes

Signed-off-by: Raul Sevilla <[email protected]>
@rsevilla87 rsevilla87 added the ok to test Kick off our CI framework label Mar 21, 2022
@rsevilla87
Copy link
Member Author

/rerun all

@mkarg75
Copy link
Contributor

mkarg75 commented Mar 21, 2022

LGTM!

Signed-off-by: Raul Sevilla <[email protected]>
@rsevilla87
Copy link
Member Author

/rerun all kube-burner:WORKLOAD=cluster-density ./run.sh

@comet-perf-ci
Copy link
Collaborator

Results for e2e-benchmarking CI Tests

Workload Test Result Runtime
kube-burner WORKLOAD=cluster-density ./run.sh PASS 00:06:34

Signed-off-by: Raul Sevilla <[email protected]>
Signed-off-by: Raul Sevilla <[email protected]>
Signed-off-by: Raul Sevilla <[email protected]>
@rsevilla87
Copy link
Member Author

/rerun all

@comet-perf-ci
Copy link
Collaborator

Results for e2e-benchmarking CI Tests

Workload Test Result Runtime
router-perf-v2 ./ingress-performance.sh FAIL 00:00:56
etcd-perf ./run_etcd_tests_fromgit.sh PASS 00:03:57
scale-perf ./run_scale_fromgit.sh PASS 00:14:23
network-perf ./run.sh PASS 00:05:56
kube-burner WORKLOAD=cluster-density ./run.sh PASS 00:06:08
kube-burner WORKLOAD=node-density ./run.sh PASS 00:05:23
kube-burner WORKLOAD=node-density-heavy ./run.sh PASS 00:05:47
kube-burner WORKLOAD=pod-density-heavy ./run.sh PASS 00:06:00
kube-burner WORKLOAD=max-services ./run.sh PASS 00:04:56
kube-burner WORKLOAD=max-namespaces ./run.sh FAIL 00:05:49
upgrade-perf ./run_upgrade_fromgit.sh PASS 00:00:58

@rsevilla87
Copy link
Member Author

/rerun all

@rsevilla87
Copy link
Member Author

hehe, that's why I asked you :D

Sure, I was going nuts cuz I couldn't find any document :D

@comet-perf-ci
Copy link
Collaborator

Results for e2e-benchmarking CI Tests

Workload Test Result Runtime
router-perf-v2 ./ingress-performance.sh PASS 00:09:36
etcd-perf ./run_etcd_tests_fromgit.sh PASS 00:02:01
scale-perf ./run_scale_fromgit.sh PASS 00:12:36
network-perf ./run.sh PASS 00:06:05
kube-burner WORKLOAD=cluster-density ./run.sh PASS 00:05:54
kube-burner WORKLOAD=node-density ./run.sh PASS 00:05:12
kube-burner WORKLOAD=node-density-heavy ./run.sh PASS 00:05:51
kube-burner WORKLOAD=pod-density-heavy ./run.sh PASS 00:06:41
kube-burner WORKLOAD=max-services ./run.sh PASS 00:04:49
kube-burner WORKLOAD=max-namespaces ./run.sh FAIL 00:05:28
upgrade-perf ./run_upgrade_fromgit.sh PASS 00:00:57

@rsevilla87
Copy link
Member Author

/rerun all kube-burner:WORKLOAD=max-namespaces ./run.sh

@comet-perf-ci
Copy link
Collaborator

Results for e2e-benchmarking CI Tests

Workload Test Result Runtime
kube-burner WORKLOAD=max-namespaces ./run.sh PASS 00:06:09

@@ -177,15 +178,16 @@ local METADATA=$(cat << EOF
"total_nodes":"${TOTAL_NODES}",
"sdn_type":"${SDN_TYPE}",
"benchmark":"${BENCHMARK}",
"start_date":"${START_DATE}",
"timestamp":"${START_DATE}",
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why are we changing this?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We generally use timestamp as date field in our indexes and grafana is only able to handle a time field (Except for uperf which is uperf_ts, that's something we'll have to change to stantarize)

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ohh right yeah, this was added recently

Signed-off-by: Raul Sevilla <[email protected]>
@rsevilla87
Copy link
Member Author

/rerun all

@comet-perf-ci
Copy link
Collaborator

Results for e2e-benchmarking CI Tests

Workload Test Result Runtime
router-perf-v2 ./ingress-performance.sh FAIL 00:01:06
etcd-perf ./run_etcd_tests_fromgit.sh PASS 00:02:44
scale-perf ./run_scale_fromgit.sh PASS 00:14:36
network-perf ./run.sh PASS 00:05:43
kube-burner WORKLOAD=cluster-density ./run.sh PASS 00:05:43
kube-burner WORKLOAD=node-density ./run.sh PASS 00:05:21
kube-burner WORKLOAD=node-density-heavy ./run.sh PASS 00:06:10
kube-burner WORKLOAD=pod-density-heavy ./run.sh PASS 00:05:54
kube-burner WORKLOAD=max-services ./run.sh PASS 00:05:08
kube-burner WORKLOAD=max-namespaces ./run.sh PASS 00:05:31
upgrade-perf ./run_upgrade_fromgit.sh PASS 00:00:57

@Harshith-umesh
Copy link
Member

LGTM

@rsevilla87 rsevilla87 merged commit 86c1842 into cloud-bulldozer:master Mar 23, 2022
@rsevilla87 rsevilla87 deleted the index-benchmark-metadata branch March 23, 2022 17:11
vishnuchalla pushed a commit that referenced this pull request Sep 6, 2023
* Index benchmark metadata

Signed-off-by: Raul Sevilla <[email protected]>

* Add check for workload nodes

Signed-off-by: Raul Sevilla <[email protected]>

* Add informative log

Signed-off-by: Raul Sevilla <[email protected]>

* Fix delete CR

Signed-off-by: Raul Sevilla <[email protected]>

* Set static index variable

Signed-off-by: Raul Sevilla <[email protected]>

* Timestamp must be on milliseconds

Signed-off-by: Raul Sevilla <[email protected]>

* Send node count as integer

Signed-off-by: Raul Sevilla <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ok to test Kick off our CI framework
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants