Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added RomanImageReader and new config file for Roman Data #38

Open
wants to merge 336 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
336 commits
Select commit Hold shift + click to select a range
49ec6ed
Merge pull request #55 from lincc-frameworks/refactor
jeremykubica Oct 31, 2023
82d0efc
Fix broken test
jeremykubica Oct 31, 2023
f302ef4
Update test_parse_arguments.py
jeremykubica Oct 31, 2023
c4a3d1f
Merge pull request #56 from lincc-frameworks/test_fix
jeremykubica Oct 31, 2023
07aaca2
add DataMapper
grantmerz Nov 1, 2023
e40169b
add documentation
grantmerz Nov 1, 2023
ece0f30
revert parse_args
grantmerz Nov 1, 2023
0611a45
revert fileio and image_readers
grantmerz Nov 1, 2023
1ed7b16
Merge pull request #58 from lincc-frameworks/gmerz/train_mapper
grantmerz Nov 1, 2023
c19cc08
filepath generator and dataset dict loader
dougbrn Nov 1, 2023
9341fd5
Create data_loader_defaults.py
OliviaLynn Nov 7, 2023
aa8f4b3
Create solo_cascade_mask_rcnn_swin_b_in21k_50ep.py
OliviaLynn Nov 7, 2023
5b91cff
Create solo_test_run_transformers.py
OliviaLynn Nov 8, 2023
3e3624e
add structure for annotation functions; dataset_dicts->dataset
dougbrn Nov 8, 2023
8aafd31
add option to pass along filters
dougbrn Nov 8, 2023
e818b44
flat dict mapping and prediction
grantmerz Nov 8, 2023
1b6b268
Merge pull request #59 from lincc-frameworks/gmerz/train_mapper
grantmerz Nov 8, 2023
d04954e
Updates, fixes and add in latest changes from main
OliviaLynn Nov 9, 2023
e504ed1
Clean up, start adding more config explanation
OliviaLynn Nov 9, 2023
cc268ae
QA on defaults file, start notes for yaml anchors
OliviaLynn Nov 9, 2023
3002ce7
Finish adding translations of yaml anchors/aliases
OliviaLynn Nov 9, 2023
b7cad51
Enforce consistent style
OliviaLynn Nov 9, 2023
60ddabc
Improve file docstring and "MISC" explanation
OliviaLynn Nov 9, 2023
2d70d33
Add metadata storage in config, clean up remaining overrides in run file
OliviaLynn Nov 9, 2023
81e2b2d
Merge branch 'issue/16/configs' of https://github.com/lincc-framework…
OliviaLynn Nov 9, 2023
8418cb4
Delete tests/deepdisc/test_data/configs/solo/solo_cascade_mask_rcnn_s…
OliviaLynn Nov 9, 2023
1e773a3
Rename data_loader_defaults.py to yaml_style_defaults.py
OliviaLynn Nov 9, 2023
a8888a1
Update docstrings; clean ups
OliviaLynn Nov 9, 2023
2d38117
add index passing; annotate_hsc function
dougbrn Nov 9, 2023
dae2e3e
docstrings
dougbrn Nov 9, 2023
7984fc8
add decam annotation function
dougbrn Nov 10, 2023
509b0dc
rename loader class
dougbrn Nov 13, 2023
458b13c
decam file names
dougbrn Nov 13, 2023
f38c307
demos with DDLoader
dougbrn Nov 13, 2023
0537df7
update deepdisc path
dougbrn Nov 13, 2023
8c64478
Adding unit tests to increase code coverage for file_io `DataLoader`.
drewoldag Nov 13, 2023
81a4c33
Adding unit tests to increase code coverage for file_io `DataLoader`.
drewoldag Nov 13, 2023
26630fd
Merge branch 'main' into data_loader
dougbrn Nov 13, 2023
819f303
black run
dougbrn Nov 13, 2023
2a29778
Merge branch 'data_loader' of https://github.com/lincc-frameworks/dee…
dougbrn Nov 13, 2023
a5ff67e
add informative warning when func not provided
dougbrn Nov 13, 2023
fbe34e3
Merge pull request #60 from lincc-frameworks/issue/16/configs
OliviaLynn Nov 14, 2023
43babda
Removed unused imports, added validation method to confirm equal numb…
drewoldag Nov 14, 2023
71fa6e9
Updating comment.
drewoldag Nov 14, 2023
2a57b7e
Adding more unit tests, fixing some small bugs in `ImageReader`.
drewoldag Nov 15, 2023
062b071
Removed superfluous `ImageReader` class from file_io.py. Add a bunch …
drewoldag Nov 16, 2023
7246279
Commenting out pylint checks.
drewoldag Nov 16, 2023
c553ee0
Swapping out miniconda for minimamba for faster CI workflows.
drewoldag Nov 16, 2023
84330e0
Removing unnecessary inputs for micromamba.
drewoldag Nov 16, 2023
7205c51
Merge pull request #63 from lincc-frameworks/issue/62/comment-out-pylint
drewoldag Nov 16, 2023
3fd0f9d
Commenting out pylint checks.
drewoldag Nov 16, 2023
e10ca9c
Merge branch 'main' into use-micro-mamba-for-ci
drewoldag Nov 16, 2023
420873f
Merge pull request #64 from lincc-frameworks/use-micro-mamba-for-ci
drewoldag Nov 16, 2023
8a17117
Rename defaults file
OliviaLynn Nov 17, 2023
321881a
Start mvitv, clean up imports
OliviaLynn Nov 17, 2023
a57c931
Update ref
OliviaLynn Nov 17, 2023
d55f798
add decam test
dougbrn Nov 17, 2023
58b3c75
fix import
dougbrn Nov 17, 2023
e40f2a3
Merge pull request #61 from lincc-frameworks/data_loader
dougbrn Nov 17, 2023
a8f5735
Add dir for solo run scripts
OliviaLynn Nov 17, 2023
7841e29
add z point matching to match_objects
grantmerz Nov 21, 2023
700c3bd
Merge pull request #67 from lincc-frameworks/gmerz/refactor
grantmerz Nov 21, 2023
fe482e5
add flattening code
grantmerz Nov 22, 2023
9ab8c16
Add dc2 support
OliviaLynn Nov 27, 2023
d6068db
Undo switched names
OliviaLynn Nov 27, 2023
017bcaa
Add DC2_redshift run
OliviaLynn Nov 27, 2023
9e670bc
Remove added DC2 comments
OliviaLynn Nov 27, 2023
cb6c9db
Fix flipped dtype
OliviaLynn Nov 27, 2023
7d393bb
add test
grantmerz Nov 27, 2023
8814c21
Merge pull request #68 from lincc-frameworks/gmerz/refactor
grantmerz Nov 27, 2023
6eab4d9
remove comments
grantmerz Nov 27, 2023
ca09b6a
Merge pull request #69 from lincc-frameworks/gmerz/refactor
grantmerz Nov 27, 2023
7c8ab45
test_eval_model first pass; start removing cfg_node from predictors &…
OliviaLynn Nov 28, 2023
0344904
update flatten code and unit test
grantmerz Nov 28, 2023
6ff89d5
Merge pull request #70 from lincc-frameworks/gmerz/refactor
grantmerz Nov 28, 2023
25cdecf
Predictors mostly updated
OliviaLynn Dec 1, 2023
b178d8f
Loaders docstrings
OliviaLynn Dec 1, 2023
474afa5
Cover trainers
OliviaLynn Dec 1, 2023
9a00b54
More predictors; clean ups
OliviaLynn Dec 1, 2023
1f3bdaf
Predictors branch 2
OliviaLynn Dec 1, 2023
03e66fa
fix bbox format for matching predictions
grantmerz Dec 1, 2023
eccedb4
Merge pull request #71 from lincc-frameworks/gmerz/refactor
grantmerz Dec 1, 2023
5ab5681
Spacing
OliviaLynn Dec 4, 2023
2cc6064
Add .map_data after DictMappers in test_run_transformers_DC2.py
OliviaLynn Dec 5, 2023
f579988
Add .map_data to solo run file for DC2 (as in #72)
OliviaLynn Dec 5, 2023
0dc484d
Merge pull request #72 from lincc-frameworks/issue/16/dictmapper
OliviaLynn Dec 5, 2023
b3c66d4
Improve consistency in language used in configs
OliviaLynn Dec 5, 2023
a63e554
test
grantmerz Dec 6, 2023
c4a12e3
Apply black to configs
OliviaLynn Dec 6, 2023
336b087
Docstrings, remove old comments
OliviaLynn Dec 6, 2023
6ff26f1
Update solo_test_run_transformers_DC2_redshift.py
OliviaLynn Dec 6, 2023
6cfaca1
Update solo_run_scripts/solo_test_eval_model.py
OliviaLynn Dec 7, 2023
c083438
Update solo_run_scripts/solo_test_eval_model.py
OliviaLynn Dec 7, 2023
7665664
Update solo_run_scripts/solo_test_eval_model.py
OliviaLynn Dec 7, 2023
7948791
PR comments
OliviaLynn Dec 7, 2023
dc8aeae
debug lossHook
grantmerz Dec 11, 2023
f772ec1
remove losseval
grantmerz Dec 11, 2023
7e2e493
Merge pull request #78 from lincc-frameworks/gmerz/refactor
grantmerz Dec 11, 2023
02800e9
fix merge
grantmerz Dec 11, 2023
bc66b32
Merge pull request #66 from lincc-frameworks/issue/16/configs
OliviaLynn Dec 12, 2023
9d116f2
add 0.1 redshift loss
grantmerz Dec 13, 2023
2f51775
Merge branch 'main' of github.com:lincc-frameworks/deepdisc
grantmerz Dec 13, 2023
d97d961
Adding configs for demo_hsc; revising yacs_style_defaults
OliviaLynn Dec 13, 2023
438378e
fix deletion after dataloading
grantmerz Dec 14, 2023
0ed7b14
fixes
grantmerz Dec 14, 2023
dfe31f2
Merge pull request #80 from lincc-frameworks/gmerz/refactor
grantmerz Dec 14, 2023
81b599d
Merge branch 'main' of github.com:lincc-frameworks/deepdisc
grantmerz Dec 14, 2023
ddf12bb
AstroPredictor now cases on model type (lazy/yacs)
OliviaLynn Dec 15, 2023
a6546fd
Remove unneccessary placeholders from configs
OliviaLynn Dec 15, 2023
e356eea
Keep notebook metadata switch to its own commit
OliviaLynn Dec 15, 2023
440e11c
model pdf linspace
grantmerz Dec 15, 2023
848a145
Demo notebook runs end to end with solo config
OliviaLynn Dec 15, 2023
a55bc92
Merge pull request #82 from lincc-frameworks/gmerz/model
grantmerz Dec 15, 2023
63ccf58
Merge pull request #81 from lincc-frameworks/issue/16/configs-in-demos
grantmerz Dec 15, 2023
f5f03ad
zloss factor
grantmerz Dec 18, 2023
d063ede
WIP to accept model weights after big config update.
drewoldag Dec 19, 2023
54cfba2
Merge pull request #84 from lincc-frameworks/awo/wip/support_model_we…
drewoldag Dec 19, 2023
8b8b7fb
loading no stars
grantmerz Dec 19, 2023
4d22744
ebv and aug models
grantmerz Dec 20, 2023
a788472
add random shuffle and hdf5 code
grantmerz Jan 1, 2024
fb5e08d
add files
grantmerz Jan 1, 2024
bf1593d
revert demo_hsc
grantmerz Jan 1, 2024
a81f9cd
revert training data
grantmerz Jan 1, 2024
e29a6d0
rename ROI heads
grantmerz Jan 2, 2024
ef4d888
preprocess nb
grantmerz Jan 2, 2024
2db4a65
move module and add documentation
grantmerz Jan 2, 2024
fe6530f
black and isort
grantmerz Jan 2, 2024
2944370
Merge pull request #86 from lincc-frameworks/preprocessing
grantmerz Jan 2, 2024
4b228b1
Merge branch 'main' of github.com:lincc-frameworks/deepdisc into mode…
grantmerz Jan 2, 2024
76d4615
fix unit test
grantmerz Jan 3, 2024
8a7919d
fix unit tests
grantmerz Jan 3, 2024
cd201a5
add sep
grantmerz Jan 3, 2024
580fb60
Merge pull request #88 from lincc-frameworks/unit_test
grantmerz Jan 3, 2024
3a05f9e
test parallel
grantmerz Jan 3, 2024
243c382
update names
grantmerz Jan 3, 2024
3f05d9c
update model
grantmerz Jan 3, 2024
9ab023e
batch inference
grantmerz Jan 3, 2024
3952631
fix batching
grantmerz Jan 4, 2024
72989e2
add files
grantmerz Jan 4, 2024
c8127fd
fixes
grantmerz Jan 4, 2024
9b69415
fixes
grantmerz Jan 4, 2024
0ffe4d6
fix conversions
grantmerz Jan 4, 2024
67d3a89
update conversion
grantmerz Jan 4, 2024
8877a55
Merge branch 'main' of github.com:lincc-frameworks/deepdisc
grantmerz Jan 4, 2024
e99e4cf
Merge pull request #92 from lincc-frameworks/conversions
grantmerz Jan 4, 2024
d4244a9
add stub notebooks for docs
dougbrn Jan 4, 2024
581e699
gather outputs
grantmerz Jan 4, 2024
7608ac2
remove astrodet changes
grantmerz Jan 4, 2024
139f5e7
change ROI inference
grantmerz Jan 5, 2024
25ddaa9
Merge pull request #94 from lincc-frameworks/parallel_inference
grantmerz Jan 5, 2024
ed335a3
add option to match ids in match_pdfs
grantmerz Jan 5, 2024
efe3b9e
Delete astrodet/astrodet.py
OliviaLynn Jan 5, 2024
630cd97
Create test.py
OliviaLynn Jan 5, 2024
9892474
Merge pull request #93 from lincc-frameworks/enable_autodocs
dougbrn Jan 5, 2024
b6372d8
match objects option
grantmerz Jan 5, 2024
9e55f44
test on double_test.json
grantmerz Jan 5, 2024
04999be
Merge pull request #95 from lincc-frameworks/parallel_inference
grantmerz Jan 5, 2024
5d1b68e
Merge branch 'main' of github.com:lincc-frameworks/deepdisc into matc…
grantmerz Jan 5, 2024
0606ed7
Merge pull request #96 from lincc-frameworks/match_oids
grantmerz Jan 5, 2024
f0bb5d9
add train_augs
grantmerz Jan 11, 2024
a35ba22
Remove commented code that is unused and now also deprecated
OliviaLynn Jan 12, 2024
241580c
Remove commented out unused/deprecated code
OliviaLynn Jan 12, 2024
07a42cc
Remove redundant LazyAstroTrainers
OliviaLynn Jan 12, 2024
e3ad6a1
Move test/train_mapper_class fns to astrodet; update hsc branch withi…
OliviaLynn Jan 12, 2024
c1be739
Update astrodet.astrodet imports to deepdisc.astrodet.astrodet; remov…
OliviaLynn Jan 12, 2024
709ff5a
Delete test.py
OliviaLynn Jan 16, 2024
7839339
Merge pull request #97 from lincc-frameworks/issue/79/astrodet
OliviaLynn Jan 16, 2024
91707bb
Add run script to bundle 3 versions of test_run_transformers
OliviaLynn Jan 18, 2024
6688d87
add use-dc2 and use-redshift to arg parser
OliviaLynn Jan 18, 2024
9b01fb4
Make generic run script use argparsed args
OliviaLynn Jan 18, 2024
b0cdf17
Patch imports
OliviaLynn Jan 18, 2024
f6f6634
Add to argparser
OliviaLynn Jan 19, 2024
828e1eb
Add bash script to run each unified setting; expand unified runs covered
OliviaLynn Jan 19, 2024
e932ce9
Can run all prev. working combinations of transformers and eval_models
OliviaLynn Jan 19, 2024
7401ef2
Formatting
OliviaLynn Jan 19, 2024
95146b3
Remove now-unified run/eval scripts
OliviaLynn Jan 19, 2024
ce3146f
Merge pull request #98 from lincc-frameworks/issue/17/unify_train
OliviaLynn Jan 19, 2024
3b60559
Move config values into config files for any_test_eval_model
OliviaLynn Jan 19, 2024
eeff466
Refactored any_test_eval into functions a bit to help readability. Co…
OliviaLynn Jan 21, 2024
3ba1d50
Merge pull request #99 from lincc-frameworks/issue/17/unify_train
OliviaLynn Jan 25, 2024
0250adf
update models
grantmerz Jan 26, 2024
49531d4
fix conflicts
grantmerz Jan 26, 2024
b6414d7
old ebv model
grantmerz Jan 26, 2024
1f92582
clean aug file
grantmerz Jan 26, 2024
81bcc0b
add solo test eval
grantmerz Jan 26, 2024
2ac869f
Merge pull request #100 from lincc-frameworks/model_tests
grantmerz Jan 26, 2024
37e4637
various fixes
grantmerz Feb 8, 2024
5beff23
lots of changes
grantmerz Feb 15, 2024
43c2679
Merge pull request #101 from lincc-frameworks/model_tests
grantmerz Feb 15, 2024
bc875ca
testing docs
grantmerz Feb 15, 2024
2efedc0
test docs
grantmerz Feb 15, 2024
4a70fcb
Merge branch 'main' of github.com:lincc-frameworks/deepdisc into docs
grantmerz Feb 16, 2024
7a98175
add tutorial link
grantmerz Feb 16, 2024
ba7d1c1
update html link
grantmerz Feb 16, 2024
ed0d629
update installation nb
grantmerz Feb 16, 2024
4e759b1
update installation nb
grantmerz Feb 16, 2024
e4e9b0c
update installation nb
grantmerz Feb 16, 2024
703f036
change kernel
grantmerz Feb 16, 2024
31d580c
update code
grantmerz Feb 16, 2024
dbc84ec
add preprocessing
grantmerz Feb 16, 2024
892155c
more docs
grantmerz Feb 22, 2024
eb1a169
Merge pull request #102 from lincc-frameworks/docs
grantmerz Feb 22, 2024
941e132
Install doc
grantmerz Feb 22, 2024
07c4a95
Preprocess doc
grantmerz Feb 22, 2024
f783d03
add install.rst
grantmerz Feb 22, 2024
588dc70
start config doc
grantmerz Feb 22, 2024
6a87e04
move files
grantmerz Feb 22, 2024
5e18ef5
Merge pull request #103 from lincc-frameworks/docs
grantmerz Feb 22, 2024
5c500ab
Merge pull request #104 from lincc-frameworks/config
grantmerz Feb 22, 2024
ed6717e
clean .py files
grantmerz Feb 22, 2024
3b05948
Merge pull request #105 from lincc-frameworks/config
grantmerz Feb 22, 2024
6584b85
rm top astrodet
grantmerz Feb 22, 2024
baec973
Merge pull request #106 from lincc-frameworks/config
grantmerz Feb 22, 2024
af03e1c
add config dir
grantmerz Feb 22, 2024
9d6d903
Merge pull request #107 from lincc-frameworks/config
grantmerz Feb 22, 2024
70f21b3
add config doc
grantmerz Feb 22, 2024
66f7a7a
fix config path
grantmerz Feb 22, 2024
2ac9569
add save json
grantmerz Feb 26, 2024
6a608ca
Merge pull request #109 from lincc-frameworks/save_json
grantmerz Feb 26, 2024
625bcc9
add argparse
grantmerz Feb 27, 2024
d8fdacc
Merge pull request #110 from lincc-frameworks/rail_argparse
grantmerz Feb 27, 2024
44a06c5
fix DDloader random sampling
grantmerz Mar 12, 2024
691c5ab
Merge pull request #111 from lincc-frameworks/DDloader
grantmerz Mar 12, 2024
b66792b
Update README.md
grantmerz Mar 13, 2024
7205a01
change homepage
grantmerz Mar 14, 2024
5c6a131
add logo
grantmerz Mar 14, 2024
fb49a7a
add logo
grantmerz Mar 14, 2024
3b98873
move installation
grantmerz Mar 14, 2024
cebe110
docs
grantmerz Mar 14, 2024
010cf59
index paths
grantmerz Mar 14, 2024
442c468
link tree
grantmerz Mar 14, 2024
e3370ed
maxdepthj
grantmerz Mar 14, 2024
813b4a9
maxdepthj
grantmerz Mar 14, 2024
3aeec08
fix install
grantmerz Mar 14, 2024
da78b91
incldue hidden
grantmerz Mar 14, 2024
c82683e
add line
grantmerz Mar 14, 2024
59d3635
add line
grantmerz Mar 14, 2024
8607e57
hidden
grantmerz Mar 14, 2024
97315a5
depth2
grantmerz Mar 14, 2024
91536ac
fix headers
grantmerz Mar 14, 2024
6bd8377
fix headers
grantmerz Mar 14, 2024
8aff3e2
Merge pull request #108 from lincc-frameworks/docs
grantmerz Mar 14, 2024
b0bd01d
change train arg parser
grantmerz May 28, 2024
c428a06
Merge pull request #112 from lincc-frameworks/train_script
grantmerz May 28, 2024
da47459
add config
grantmerz May 28, 2024
9a0d75d
Merge pull request #113 from lincc-frameworks/configs
grantmerz May 28, 2024
2964c15
slight config change
grantmerz May 28, 2024
7d5d087
add demo
grantmerz May 30, 2024
15920b1
Merge pull request #115 from lincc-frameworks/notebooks
grantmerz May 30, 2024
e505a33
Added RomanImageReader and create new swin config file for Roman data
yaswant2403 Jun 6, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
17 changes: 17 additions & 0 deletions .copier-answers.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
# Changes here will be overwritten by Copier
_commit: v1.4.3
_src_path: gh:lincc-frameworks/python-project-template
author_email: [email protected]
author_name: Grant Merz
create_example_module: true
custom_install: true
include_benchmarks: false
include_docs: true
include_notebooks: true
mypy_type_checking: none
package_name: deepdisc
preferred_linter: pylint
project_license: MIT
project_name: deepdisc
use_gitlfs: none
use_isort: true
44 changes: 44 additions & 0 deletions .github/linting.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,44 @@
# !!! MOVE THIS FILE BACK TO ./workflows WHEN IT'S TIME TO REINTRODUCE PYLINT !!!
# While this file is outside of the workflows directory, the workflow it defines
# will not run automatically.

# This workflow will install Python dependencies, then perform static linting analysis.
# For more information see: https://help.github.com/actions/language-and-framework-guides/using-python-with-github-actions

name: Lint

on:
push:
branches: [ main ]
pull_request:
branches: [ main ]

concurrency:
group: ${{ github.workflow }}-${{ github.ref }}
cancel-in-progress: true

jobs:
build:
runs-on: ubuntu-latest
defaults:
run:
shell: bash -l {0}
steps:
- uses: actions/checkout@v3
- uses: mamba-org/setup-micromamba@v1
with:
create-args: >-
python=3.9.15
environment-file: ci-environment.yml
- name: Install dependencies
run: |
sudo apt-get update
python -m pip install --upgrade pip
pip install .
pip install 'git+https://github.com/facebookresearch/detectron2.git@80307d2d5e06f06a8a677cc2653f23a4c56402ac'
pip install 'git+https://github.com/pmelchior/scarlet.git'
pip install .[dev]
- name: Analyze code with linter

run: |
pylint -rn -sn --recursive=y ./src --rcfile=./src/.pylintrc
43 changes: 43 additions & 0 deletions .github/workflows/build-documentation.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,43 @@
# This workflow will install Python dependencies, build the package and then build the documentation.

name: Build documentation


on:
push:
branches: [ main ]
pull_request:
branches: [ main ]

concurrency:
group: ${{ github.workflow }}-${{ github.ref }}
cancel-in-progress: true

jobs:
build:
runs-on: ubuntu-latest
defaults:
run:
shell: bash -l {0}
steps:
- uses: actions/checkout@v3
- uses: mamba-org/setup-micromamba@v1
with:
create-args: >-
python=3.9.15
environment-file: ci-environment.yml
- name: Install dependencies
run: |
sudo apt-get update
python -m pip install --upgrade pip
pip install .
pip install 'git+https://github.com/facebookresearch/detectron2.git@80307d2d5e06f06a8a677cc2653f23a4c56402ac'
pip install 'git+https://github.com/pmelchior/scarlet.git'
pip install .[dev]
if [ -f docs/requirements.txt ]; then pip install -r docs/requirements.txt; fi
- name: Install notebook requirements
run: |
sudo apt-get install pandoc
- name: Build docs
run: |
sphinx-build -T -E -b html -d docs/build/doctrees ./docs docs/build/html
36 changes: 36 additions & 0 deletions .github/workflows/pre-commit-ci.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,36 @@
# This workflow runs pre-commit hooks on pull requests to enforce coding style.
# To ensure correct configuration, please refer to:
# https://lincc-ppt.readthedocs.io/en/latest/practices/ci_precommit.html

name: Run pre-commit hooks

on:
# Disabling until we can figure out inconsistencies in bash behavior
# between conda setup and pre-commit itself.
# pull_request:

jobs:
pre-commit-ci:
runs-on: ubuntu-latest
env:
SKIP: "check-lincc-frameworks-template-version,pytest-check,no-commit-to-branch,validate-pyproject,check-added-large-files,sphinx-build"
steps:
- uses: actions/checkout@v3
with:
fetch-depth: 0
- name: Set up Python
uses: actions/setup-python@v4
with:
python-version: '3.10'
- name: Install dependencies
run: |
sudo apt-get update
python -m pip install --upgrade pip
pip install .
pip install .[dev]
if [ -f requirements.txt ]; then pip install -r requirements.txt; fi
- uses: pre-commit/[email protected]
with:
extra_args: --from-ref ${{ github.event.pull_request.base.sha }} --to-ref ${{ github.event.pull_request.head.sha }}
- uses: pre-commit-ci/[email protected]
if: always()
46 changes: 46 additions & 0 deletions .github/workflows/publish-to-pypi.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,46 @@
# This workflow will upload a Python Package using Twine when a release is created
# For more information see: https://docs.github.com/en/actions/automating-builds-and-tests/building-and-testing-python#publishing-to-package-registries

# This workflow uses actions that are not certified by GitHub.
# They are provided by a third-party and are governed by
# separate terms of service, privacy policy, and support
# documentation.

name: Upload Python Package

on:
release:
types: [published]

permissions:
contents: read

jobs:
deploy:
runs-on: ubuntu-latest
defaults:
run:
shell: bash -l {0}
steps:
- uses: actions/checkout@v3
- uses: mamba-org/setup-micromamba@v1
with:
create-args: >-
python=3.9.15
environment-file: ci-environment.yml
- name: Install dependencies
run: |
sudo apt-get update
python -m pip install --upgrade pip
pip install .
pip install 'git+https://github.com/facebookresearch/detectron2.git@80307d2d5e06f06a8a677cc2653f23a4c56402ac'
pip install 'git+https://github.com/pmelchior/scarlet.git'
pip install .[dev]
pip install build
- name: Build package
run: python -m build
- name: Publish package
uses: pypa/gh-action-pypi-publish@27b31702a0e7fc50959f5ad993c78deac1bdfc29
with:
user: __token__
password: ${{ secrets.PYPI_API_TOKEN }}
43 changes: 43 additions & 0 deletions .github/workflows/smoke-test.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,43 @@
# This workflow will run daily at 06:45.
# It will install Python dependencies and run tests with a variety of Python versions.
# See documentation for help debugging smoke test issues:
# https://lincc-ppt.readthedocs.io/en/latest/practices/ci_testing.html#version-culprit

name: Unit test smoke test

on:

# Runs this workflow automatically
schedule:
- cron: 45 6 * * *

# Allows you to run this workflow manually from the Actions tab
workflow_dispatch:

jobs:
build:
runs-on: ubuntu-latest
defaults:
run:
shell: bash -l {0}
steps:
- uses: actions/checkout@v3
- uses: mamba-org/setup-micromamba@v1
with:
create-args: >-
python=3.9.15
environment-file: ci-environment.yml
- name: Install dependencies
run: |
sudo apt-get update
python -m pip install --upgrade pip
pip install .
pip install 'git+https://github.com/facebookresearch/detectron2.git@80307d2d5e06f06a8a677cc2653f23a4c56402ac'
pip install 'git+https://github.com/pmelchior/scarlet.git'
pip install .[dev]
- name: List dependencies
run: |
pip list
- name: Run unit tests with pytest
run: |
python -m pytest tests
37 changes: 37 additions & 0 deletions .github/workflows/testing-and-coverage.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,37 @@
# This workflow will install Python dependencies, run tests and report code coverage with a variety of Python versions
# For more information see: https://help.github.com/actions/language-and-framework-guides/using-python-with-github-actions

name: Unit test and code coverage

on:
push:
branches: [ main ]
pull_request:
branches: [ main ]

jobs:
build:
runs-on: ubuntu-latest
defaults:
run:
shell: bash -l {0}
steps:
- uses: actions/checkout@v3
- uses: mamba-org/setup-micromamba@v1
with:
create-args: >-
python=3.9.15
environment-file: ci-environment.yml
- name: Install dependencies
run: |
sudo apt-get update
python -m pip install --upgrade pip
pip install .
pip install 'git+https://github.com/facebookresearch/detectron2.git@80307d2d5e06f06a8a677cc2653f23a4c56402ac'
pip install 'git+https://github.com/pmelchior/scarlet.git'
pip install .[dev]
- name: Run unit tests with pytest
run: |
python -m pytest tests --cov=deepdisc --cov-report=xml
- name: Upload coverage report to codecov
uses: codecov/codecov-action@v3
Loading