Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

remove non-flaky tests from pr-data.csv #1235

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

AhmedNusayer
Copy link

No description provided.

@darko-marinov
Copy link
Contributor

Why do you think that these tests deterministically fail? Do you have some logs of your results?

@AhmedNusayer
Copy link
Author

For each of the projects, I executed a script that runs NonDex using the following command.

# Run NonDex, NUMROUNDS rounds
timeout 3600s mvn edu.illinois:nondex-maven-plugin:2.1.1:nondex -DnondexRuns=${NUMROUNDS} > nondex_log.txt 2>&1 

The script then parses the nondex_log.txt file to identify the deterministically failed tests by reporting the tests listed under 'The following tests failed in the clean run:'.

[INFO] The following tests failed in the clean run: [WARNING] eu.fayder.restcountries.v2.CountryServiceTest#getByRegionalBloc

[INFO] The following tests failed in the clean run: [WARNING] cn.myperf4j.base.test.ILoggerTest#test [WARNING] cn.myperf4j.base.influxdb.InfluxDbV2ClientTest#testWrite

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants