Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New jsons for including extensions in the same jsons as the original sample, and updated #449

Merged
merged 50 commits into from
Dec 20, 2024

Conversation

anpicci
Copy link
Collaborator

@anpicci anpicci commented Dec 4, 2024

This PR includes updated jsons from @anehnis and updated xsec for the TTToLNu2Q sample

@anpicci anpicci requested review from bryates and sscruz December 4, 2024 16:23
Copy link
Contributor

@bryates bryates left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @anpicci, this looks good to me. @Andrew42 and @sscruz any comments?

Copy link

codecov bot commented Dec 11, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 26.24%. Comparing base (656b5a6) to head (dd65989).
Report is 1 commits behind head on master.

Additional details and impacted files
@@           Coverage Diff           @@
##           master     #449   +/-   ##
=======================================
  Coverage   26.24%   26.24%           
=======================================
  Files          31       31           
  Lines        4747     4747           
=======================================
  Hits         1246     1246           
  Misses       3501     3501           
Flag Coverage Δ
unittests 26.24% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@@ -0,0 +1,37 @@
import os
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm curious what this file is for. Did some of the central samples go missing after we made the json files? If so, does this properly fix the sum of weights, or should we rerun make_jsons.py instead?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@bryates yes, we have seen that some of them are missing, so this is a temporary fix. We need for sure rerun make_jsons. In addition, we should recopy the missing files, but considering that we are going to run the skimming procedure with the new ttH MVA on top of the Run3 samples, I would avoid to recopy the missing central files and directly wait for the skimmed samples. What do you think?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We'll need the central files to perform the skimming, unless we want to change the redirector used in the lobster script. Are they just missing on ceph? Let's try to get those copies ASAP.

@anpicci
Copy link
Collaborator Author

anpicci commented Dec 18, 2024

@bryates I think we merge this PR
My additional comment is that, to make it work, Sergio's updates need to find the new ttH MVA attached to the lepton collections, which is not the case right now.

@bryates bryates merged commit 90d5bc9 into master Dec 20, 2024
4 checks passed
@bryates bryates deleted the clib_run3 branch December 20, 2024 15:21
anpicci added a commit that referenced this pull request Dec 20, 2024
…sample, and updated (#449)

* Adding json and  cfg files.

* Run3 processor and event selection

* Topeft/modules update

* Temporary commit

* unit SFs for Run3

* some tweaking

* another temp commit

* Fixed issues in analysis processor for plain Run3

* Fixed issues in analysis processor for plain Run3

* JME Run3

* Fixing dataset definition for data in analysis_processor

* First pkl file version

* Adapting SFs to Run3

* Fixing dataset definition for data in analysis_processor

* Fixing uncommented line

* Stable Run2 + Run3 flow with systematics (when available)

* Fixing uncommented line

* Fixing uncommented line

* Adapting corrections to the new JECStack

* Merging with master

* Minor fixes

* Minor fixes for pylint

* Minor fixes for pylint

* Minor fixes for pylint

* Optimizing JME corrections

* fixing pylint errors

* Addressing Brent's comments

* Fixing pyling comments

* Fixing pyling comments

* Fixing pyling comments

* Implementing Brent's comments

* fixing pylint errors

* Fixing AttachElectronSF

* Updates for plotting with make_cr_and_sr_plots.py

* Updated jsons, summed over ext files

* Working make_cr_and_sr_plots.py update

* Realigning plotter script to Brent's version

* Realigning plotter script to Brent's version

* Updating redirector

* fixing ttbar 2QLNu sample

* fixing Run3 cfgs

* Script to check that all the files listed in the jsons are reachable

* modified files, according to what is present

* modified files, according to what is present

---------

Co-authored-by: Amanda Ehnis <anehnis@gmail.com>
bryates added a commit that referenced this pull request Dec 20, 2024
* aligining ch_update to master

* first implementation of parsing selections defining a SR - only tried with 2lss_p

* Uploading latest Tau SF functions

* Update topeft/modules/corrections.py

Co-authored-by: Brent R. Yates <brentRyates@gmail.com>

* Addressing lint errors

* Addressing lint issues

* Pin setuptools

* Checkout `pin-setuptools` on TopCoffea

* Back to topcoffea main

* Modifying the code according to the results from the CI tests

* adapt datacards_post_processing.py to ch_lst.json

* Update ch_lst json

* testing

* Updates for CRs in processor and json, replacing deepthought with hactar01

* Fixing some bugs in the analysis_processor

* fixing channel json

* fixing channel json

* Updated and working versions

* update ch_lst_test.json with 3loffZ split

* turn off 3loffZ split

* Add tau channels

* update datacards_post_processing.py script for ch_lst_test.json

* Change tau channels

* Add taus to datacards_post_processing

* Addressing pylint errors

* Addressing pylint errors

* Addressing pylint errors

* add 3l-offZ-split channels in analysis_processor.py

* Addressing Lint errors

* Fixing TES/FES

* Addressing pylint errors

* recalling the correct branch for topcoffea

* Changes to tau run mode based on comments

* fix run_analysis issue

* Generalizing usage of lepton categories for weight_dict

* Address pylint issues

* Add fwd region

* Remove `rebin`

* Add `--fwd-flag` and copy LT

* Propagate flags correctly

* Actually use fwd flag

* Update missing parton script

* Some improvements

* Add `fwd` region to missing parton

* Fix lint

* Use l1 for `fwd` not `tau`

* Ignore specified variables

* Revert

* Ignore specified variables

* edit dc post selection for 2lss_fwd lt

* minor update in fwd post dc

* update run_analysis for command options

* remove 2lss_4t_fwd regions

* addressing pylint errors

* addressing pylint errors

* addressing pylint errors

* Addressing Brent's comments and first try to fix CI Analysis errors

* addressing pylint errors

* Fix CI Analysis errors

* fix fwdjet masking

* include lt variable in analysis processor

* add removed scalings post selection

* change back 2lss 4t bin variable to lj0pt

* fixing 3l-offZ bug

* New jsons for including extensions in the same jsons as the original sample, and updated (#449)

* Adding json and  cfg files.

* Run3 processor and event selection

* Topeft/modules update

* Temporary commit

* unit SFs for Run3

* some tweaking

* another temp commit

* Fixed issues in analysis processor for plain Run3

* Fixed issues in analysis processor for plain Run3

* JME Run3

* Fixing dataset definition for data in analysis_processor

* First pkl file version

* Adapting SFs to Run3

* Fixing dataset definition for data in analysis_processor

* Fixing uncommented line

* Stable Run2 + Run3 flow with systematics (when available)

* Fixing uncommented line

* Fixing uncommented line

* Adapting corrections to the new JECStack

* Merging with master

* Minor fixes

* Minor fixes for pylint

* Minor fixes for pylint

* Minor fixes for pylint

* Optimizing JME corrections

* fixing pylint errors

* Addressing Brent's comments

* Fixing pyling comments

* Fixing pyling comments

* Fixing pyling comments

* Implementing Brent's comments

* fixing pylint errors

* Fixing AttachElectronSF

* Updates for plotting with make_cr_and_sr_plots.py

* Updated jsons, summed over ext files

* Working make_cr_and_sr_plots.py update

* Realigning plotter script to Brent's version

* Realigning plotter script to Brent's version

* Updating redirector

* fixing ttbar 2QLNu sample

* fixing Run3 cfgs

* Script to check that all the files listed in the jsons are reachable

* modified files, according to what is present

* modified files, according to what is present

---------

Co-authored-by: Amanda Ehnis <anehnis@gmail.com>

* reverting some temporary additions

* pylint comments addressed

---------

Co-authored-by: Andrea Piccinelli <andrea8395@gmail.com>
Co-authored-by: Andrea Piccinelli <44297061+anpicci@users.noreply.github.com>
Co-authored-by: Brent R. Yates <brentRyates@gmail.com>
Co-authored-by: Yuyi Wan <ywan2@glados.crc.nd.edu>
Co-authored-by: Brent Yates <yates.313@osu.edu>
Co-authored-by: ywan2 <85906153+ywan2@users.noreply.github.com>
Co-authored-by: Amanda Ehnis <anehnis@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants