Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reduce End-2-End Test Flakiness #1567

Open
runewake2 opened this issue Mar 18, 2021 · 0 comments
Open

Reduce End-2-End Test Flakiness #1567

runewake2 opened this issue Mar 18, 2021 · 0 comments
Labels
area/devops cleanup p2 size/S 1 day triaged Issue has been triaged by adding an `area/` label

Comments

@runewake2
Copy link
Contributor

The end-to-end-test.sh tests can create flaky behavior resulting in false test failures during Pull Requests and merges to the master branch. This is introduced due to test resources persisting between different tests. Right now this behavior seems rare.

To resolve this manually usually using "Re-run Jobs" works.

We should attempt to remove resource conflicts between tests so that tests provide clearer results and flaky test failures are reduced.

It may be helpful to track the occurrence of these test flakes so we have an idea of how common the issue is.

@runewake2 runewake2 added cleanup size/S 1 day p2 triaged Issue has been triaged by adding an `area/` label area/devops labels Mar 18, 2021
@mortent mortent added this to kpt Jan 21, 2023
@mortent mortent moved this to Backlog in kpt Jan 25, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/devops cleanup p2 size/S 1 day triaged Issue has been triaged by adding an `area/` label
Projects
None yet
Development

No branches or pull requests

1 participant