Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[HOLD for payment 2024-11-11] Remove redundant reassure tests and improve documentation #51637

Open
mountiny opened this issue Oct 29, 2024 · 5 comments
Assignees
Labels
Awaiting Payment Auto-added when associated PR is deployed to production Bug Something is broken. Auto assigns a BugZero manager. Weekly KSv2

Comments

@mountiny
Copy link
Contributor

mountiny commented Oct 29, 2024

Coming from this proposal in Slack.

Problem:

There are redundant/flaky performance tests in the Reassure suite. These tests are difficult to maintain and provide low value, as their scenarios are already covered elsewhere or offer little regression detection. This creates unnecessary complexity, slows down the test suite, and increases the likelihood of false positives.

Solution:

Remove the redundant tests that verify scenarios already covered in separate tests. Eliminate tests that check interactions with minimal impact on regression detection. Focus on retaining tests that provide high-value regression coverage, and reorganize the test suites for better maintainability by moving essential tests to lower levels where they are easier to manage.

  • Move the reassure test documentation to the contributingGuidelines
  • Update the guidelines to provide more guidance on how to prevent adding any redundant tests
Issue OwnerCurrent Issue Owner: @strepanier03
@mountiny mountiny added Daily KSv2 Bug Something is broken. Auto assigns a BugZero manager. labels Oct 29, 2024
@mountiny mountiny self-assigned this Oct 29, 2024
Copy link

melvin-bot bot commented Oct 29, 2024

Triggered auto assignment to @strepanier03 (Bug), see https://stackoverflow.com/c/expensify/questions/14418 for more details. Please add this bug to a GH project, as outlined in the SO.

@OlimpiaZurek
Copy link
Contributor

Hi! I'm Olimpia from Callstack and I'd like to work on this issue.

@melvin-bot melvin-bot bot added Reviewing Has a PR in review Weekly KSv2 and removed Daily KSv2 labels Oct 29, 2024
@melvin-bot melvin-bot bot added Weekly KSv2 Awaiting Payment Auto-added when associated PR is deployed to production and removed Weekly KSv2 labels Oct 31, 2024
@melvin-bot melvin-bot bot changed the title Remove redundant reassure tests and improve documentation [HOLD for payment 2024-11-11] Remove redundant reassure tests and improve documentation Nov 4, 2024
Copy link

melvin-bot bot commented Nov 4, 2024

Reviewing label has been removed, please complete the "BugZero Checklist".

@melvin-bot melvin-bot bot removed the Reviewing Has a PR in review label Nov 4, 2024
Copy link

melvin-bot bot commented Nov 4, 2024

The solution for this issue has been 🚀 deployed to production 🚀 in version 9.0.56-9 and is now subject to a 7-day regression period 📆. Here is the list of pull requests that resolve this issue:

If no regressions arise, payment will be issued on 2024-11-11. 🎊

For reference, here are some details about the assignees on this issue:

Copy link

melvin-bot bot commented Nov 4, 2024

@mountiny @strepanier03 The PR fixing this issue has been merged! The following checklist (instructions) will need to be completed before the issue can be closed. Please copy/paste the BugZero Checklist from here into a new comment on this GH and complete it. If you have the K2 extension, you can simply click: [this button]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Awaiting Payment Auto-added when associated PR is deployed to production Bug Something is broken. Auto assigns a BugZero manager. Weekly KSv2
Projects
Development

No branches or pull requests

3 participants