Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bug plotting missing Shape Metrics e2 and R2 #111

Merged
merged 5 commits into from
Mar 6, 2024
Merged

Conversation

jeipollack
Copy link
Contributor

@jeipollack jeipollack commented Jan 15, 2024

Closes #110 and #94

Refactored the ShapeMetricsPlotHandler to reduce duplicated lines, and altered the sequence of commands to produce plots for e1, e2, and R2 shape metrics (see plots below).

This PR also applies a fix raised in #92 regarding skipped validation tests.
We want the validation tests to be skipped during CI, but to be ran manually with pytest by the developer. We applied the conditional pytest.mark.skipif decorator and will check if the CI environment variable was defined. If yes, the test is skipped, else the test is run.

Note, 28 files were changed due to rebase with the develop branch with updated package dependencies.

Below I show examples of the Shape metric plots for e1, e2 and R2/MeanR2.

test_metrics_nstars_1000_500_200_Shape_E1_RMSE

test_metrics_nstars_1000_500_200_Shape_R2_MEANR2_RMSE

test_metrics_nstars_1000_500_200_Shape_E2_RMSE

@jeipollack jeipollack added bug Something isn't working enhancement New feature or request labels Jan 15, 2024
@jeipollack jeipollack self-assigned this Jan 15, 2024
@jeipollack jeipollack changed the title Draft: Bug plotting missing Shape Metrics e2 and R2 Bug plotting missing Shape Metrics e2 and R2 Mar 4, 2024
@jeipollack
Copy link
Contributor Author

@sfarrens I am ready for you to review this PR:

  • plotting/plot_interface.py
  • tests/metrics_test.py
  • tests/train_test.py

@jeipollack jeipollack linked an issue Mar 4, 2024 that may be closed by this pull request
@sfarrens
Copy link
Member

sfarrens commented Mar 5, 2024

Looks OK to me @jeipollack!

Copy link
Member

@tobias-liaudat tobias-liaudat left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me

@jeipollack jeipollack merged commit 8186939 into develop Mar 6, 2024
2 checks passed
@jeipollack jeipollack deleted the bug_plotting branch March 18, 2024 09:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Bug: Missing e2 and R2 metrics plots
3 participants