Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BDT trained and minor modifications to plotting #216

Merged
merged 40 commits into from
Sep 30, 2024

Conversation

dprim7
Copy link
Collaborator

@dprim7 dprim7 commented Sep 30, 2024

No description provided.

@cmantill cmantill merged commit 7b0ea79 into LPC-HH:update-parT Sep 30, 2024
9 checks passed
cmantill added a commit that referenced this pull request Oct 15, 2024
* review xsecs with xsdb

* add v12v2 with glopart

* use xsdb number for last vbfhh4b sample

* fix typo in vbf sample for xsec

* add new nano version

* delete unused trigger weights

* reorder added fatjet variables and rename parT

* enable bdt inference, reduce jecs, add part variables, uniformize presel and signal cuts, lower mreg cut;

* style: pre-commit fixes

* formatting

* style: pre-commit fixes

* fix format and remove duplicate xsec

* style: pre-commit fixes

* fix format

* add submit config and get rid of unused option

* gen match ak8 jets ordered by pt

* 2nd try submission

* style: pre-commit fixes

* fix str

* style: pre-commit fixes

* add part roc curve validation

* add pnet xbb option

* style: pre-commit fixes

* fix

* style: pre-commit fixes

* format

* style: pre-commit fixes

* format

* push latest files

* style: pre-commit fixes

* fix submit

* add matching for vv and vjets

* style: pre-commit fixes

* change pnet txbb option

* add assertion in genselection and switch pnet txbb str

* style: pre-commit fixes

* few more fixes

* add options for loading with different txbb versions

* move to run2 folder

* add bdt training config

* style: pre-commit fixes

* remove legacy options

* style: pre-commit fixes

* add bdt training command

* style: pre-commit fixes

* add all years

* style: pre-commit fixes

* fix logging

* temp fix to submit w/o trigger selection

* add logging

* style: pre-commit fixes

* sync ROC curve

* style: pre-commit fixes

* BDT trained and minor modifications to plotting (#216)

* Added notebook to retrieve eventlist

* style: pre-commit fixes

* better merge

* style: pre-commit fixes

* update

* style: pre-commit fixes

* saving loaded events in root, wip

* NB loads file, selects desired columns from hh4b, saves to root

* root files saved into a separate folder

* started making eventlist.py, made note of potential bug in EventList.ipynb

* minor touch ups

* make eventlist.py

* added README.md

* added README.md

* tested eventlist script, ready for merge

* training BDT with v12 events

* PNetPlots wip

* wip

* plotting ROC for PNET wip

* wip

* added matching masks

* added different way of handling signal exclusive columns

* wip

* fixed masks, wip

* added Legacy, values off, needs fix

* wip

* wip

* added 24Sep26 BDT Training config

* modified TrainBDT.py and postprocessing.py to fit retraining

* wip

* test BDT trained on aprtial data

* trained 24Sep27_v5_GloParTv2

* removed duplicate line

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Javier Duarte <[email protected]>

* revert trigger selection in place

* comparison script

* style: pre-commit fixes

* working version of ValidateBDT.py, next: evaluate with scale&smear (#217)

* Added notebook to retrieve eventlist

* style: pre-commit fixes

* better merge

* style: pre-commit fixes

* update

* style: pre-commit fixes

* saving loaded events in root, wip

* NB loads file, selects desired columns from hh4b, saves to root

* root files saved into a separate folder

* started making eventlist.py, made note of potential bug in EventList.ipynb

* minor touch ups

* make eventlist.py

* added README.md

* added README.md

* tested eventlist script, ready for merge

* training BDT with v12 events

* PNetPlots wip

* wip

* plotting ROC for PNET wip

* wip

* added matching masks

* added different way of handling signal exclusive columns

* wip

* fixed masks, wip

* added Legacy, values off, needs fix

* wip

* wip

* added 24Sep26 BDT Training config

* modified TrainBDT.py and postprocessing.py to fit retraining

* wip

* test BDT trained on aprtial data

* trained 24Sep27_v5_GloParTv2

* removed duplicate line

* fixed bugs and working on plotting funciton

* working version of ValidateBDT.py, next: evaluate with scale&smear

* fixed plotting of vertical lines for thresholds

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Javier Duarte <[email protected]>

* edit requirements

* edit legend

* style: pre-commit fixes

* performed validation on latest three BDTs, cleaned up code  (#219)

* Added notebook to retrieve eventlist

* style: pre-commit fixes

* better merge

* style: pre-commit fixes

* update

* style: pre-commit fixes

* saving loaded events in root, wip

* NB loads file, selects desired columns from hh4b, saves to root

* root files saved into a separate folder

* started making eventlist.py, made note of potential bug in EventList.ipynb

* minor touch ups

* make eventlist.py

* added README.md

* added README.md

* tested eventlist script, ready for merge

* training BDT with v12 events

* PNetPlots wip

* wip

* plotting ROC for PNET wip

* wip

* added matching masks

* added different way of handling signal exclusive columns

* wip

* fixed masks, wip

* added Legacy, values off, needs fix

* wip

* wip

* added 24Sep26 BDT Training config

* modified TrainBDT.py and postprocessing.py to fit retraining

* wip

* test BDT trained on aprtial data

* trained 24Sep27_v5_GloParTv2

* removed duplicate line

* fixed bugs and working on plotting funciton

* working version of ValidateBDT.py, next: evaluate with scale&smear

* fixed plotting of vertical lines for thresholds

* wip

* performed validation on thre most recent BDTs, code cleaned up

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Javier Duarte <[email protected]>
Co-authored-by: Cristina Mantilla Suarez <[email protected]>

* modify jms jmr to default to 10%

* style: pre-commit fixes

* remove year

* restructure yaml files

* revert jmsr for semilep-tt and implement in ttskimmer instead

* fix a couple of typos in ttskimmer

* rhalphalib update

* pre-commit

* run3 ttskimmer

* remove unused option

* style: pre-commit fixes

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: dprim7 <[email protected]>
Co-authored-by: Javier Duarte <[email protected]>
cmantill added a commit that referenced this pull request Oct 15, 2024
* review xsecs with xsdb

* add v12v2 with glopart

* use xsdb number for last vbfhh4b sample

* fix typo in vbf sample for xsec

* add new nano version

* delete unused trigger weights

* reorder added fatjet variables and rename parT

* enable bdt inference, reduce jecs, add part variables, uniformize presel and signal cuts, lower mreg cut;

* style: pre-commit fixes

* formatting

* style: pre-commit fixes

* fix format and remove duplicate xsec

* style: pre-commit fixes

* fix format

* add submit config and get rid of unused option

* gen match ak8 jets ordered by pt

* 2nd try submission

* style: pre-commit fixes

* fix str

* style: pre-commit fixes

* add part roc curve validation

* add pnet xbb option

* style: pre-commit fixes

* fix

* style: pre-commit fixes

* format

* style: pre-commit fixes

* format

* push latest files

* style: pre-commit fixes

* fix submit

* add matching for vv and vjets

* style: pre-commit fixes

* change pnet txbb option

* add assertion in genselection and switch pnet txbb str

* style: pre-commit fixes

* few more fixes

* add options for loading with different txbb versions

* move to run2 folder

* add bdt training config

* style: pre-commit fixes

* remove legacy options

* style: pre-commit fixes

* add bdt training command

* style: pre-commit fixes

* add all years

* style: pre-commit fixes

* fix logging

* temp fix to submit w/o trigger selection

* add logging

* style: pre-commit fixes

* sync ROC curve

* style: pre-commit fixes

* BDT trained and minor modifications to plotting (#216)

* Added notebook to retrieve eventlist

* style: pre-commit fixes

* better merge

* style: pre-commit fixes

* update

* style: pre-commit fixes

* saving loaded events in root, wip

* NB loads file, selects desired columns from hh4b, saves to root

* root files saved into a separate folder

* started making eventlist.py, made note of potential bug in EventList.ipynb

* minor touch ups

* make eventlist.py

* added README.md

* added README.md

* tested eventlist script, ready for merge

* training BDT with v12 events

* PNetPlots wip

* wip

* plotting ROC for PNET wip

* wip

* added matching masks

* added different way of handling signal exclusive columns

* wip

* fixed masks, wip

* added Legacy, values off, needs fix

* wip

* wip

* added 24Sep26 BDT Training config

* modified TrainBDT.py and postprocessing.py to fit retraining

* wip

* test BDT trained on aprtial data

* trained 24Sep27_v5_GloParTv2

* removed duplicate line

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Javier Duarte <[email protected]>

* revert trigger selection in place

* comparison script

* style: pre-commit fixes

* working version of ValidateBDT.py, next: evaluate with scale&smear (#217)

* Added notebook to retrieve eventlist

* style: pre-commit fixes

* better merge

* style: pre-commit fixes

* update

* style: pre-commit fixes

* saving loaded events in root, wip

* NB loads file, selects desired columns from hh4b, saves to root

* root files saved into a separate folder

* started making eventlist.py, made note of potential bug in EventList.ipynb

* minor touch ups

* make eventlist.py

* added README.md

* added README.md

* tested eventlist script, ready for merge

* training BDT with v12 events

* PNetPlots wip

* wip

* plotting ROC for PNET wip

* wip

* added matching masks

* added different way of handling signal exclusive columns

* wip

* fixed masks, wip

* added Legacy, values off, needs fix

* wip

* wip

* added 24Sep26 BDT Training config

* modified TrainBDT.py and postprocessing.py to fit retraining

* wip

* test BDT trained on aprtial data

* trained 24Sep27_v5_GloParTv2

* removed duplicate line

* fixed bugs and working on plotting funciton

* working version of ValidateBDT.py, next: evaluate with scale&smear

* fixed plotting of vertical lines for thresholds

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Javier Duarte <[email protected]>

* edit requirements

* edit legend

* style: pre-commit fixes

* performed validation on latest three BDTs, cleaned up code  (#219)

* Added notebook to retrieve eventlist

* style: pre-commit fixes

* better merge

* style: pre-commit fixes

* update

* style: pre-commit fixes

* saving loaded events in root, wip

* NB loads file, selects desired columns from hh4b, saves to root

* root files saved into a separate folder

* started making eventlist.py, made note of potential bug in EventList.ipynb

* minor touch ups

* make eventlist.py

* added README.md

* added README.md

* tested eventlist script, ready for merge

* training BDT with v12 events

* PNetPlots wip

* wip

* plotting ROC for PNET wip

* wip

* added matching masks

* added different way of handling signal exclusive columns

* wip

* fixed masks, wip

* added Legacy, values off, needs fix

* wip

* wip

* added 24Sep26 BDT Training config

* modified TrainBDT.py and postprocessing.py to fit retraining

* wip

* test BDT trained on aprtial data

* trained 24Sep27_v5_GloParTv2

* removed duplicate line

* fixed bugs and working on plotting funciton

* working version of ValidateBDT.py, next: evaluate with scale&smear

* fixed plotting of vertical lines for thresholds

* wip

* performed validation on thre most recent BDTs, code cleaned up

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Javier Duarte <[email protected]>
Co-authored-by: Cristina Mantilla Suarez <[email protected]>

* modify jms jmr to default to 10%

* style: pre-commit fixes

* remove year

* restructure yaml files

* revert jmsr for semilep-tt and implement in ttskimmer instead

* fix a couple of typos in ttskimmer

* rhalphalib update

* pre-commit

* run3 ttskimmer

* remove unused option

* style: pre-commit fixes

* add more data

* remove option

* rename dfs

* fix ttskimmer options

* style: pre-commit fixes

* skip empty parquet

* change vjets sample

* modify list of samples to submit for ttskimmer

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: dprim7 <[email protected]>
Co-authored-by: Javier Duarte <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants