Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Change the parallelization to be handled by joblib #19

Merged
merged 24 commits into from
Dec 13, 2023
Merged

Conversation

nwlandry
Copy link
Owner

@nwlandry nwlandry commented Dec 10, 2023

I did the following in this PR:

  • I converted all the parallelization scripts (running and file collecting) to be handled by joblib (~10% faster than python multiprocessing)
  • Changed all the input arguments to enforce passing by reference.
  • I massively re-organized the repo, putting unused scripts in Extra, renaming the scripts to be more descriptive, having a single notebook for generating each figure, and organizing by figures.
  • I wrote a script to infer ZKC for different values of $t_{max}$ to generate figure 1c, which is the posterior similarity vs. $t_{max}$ for ZKC.
  • I added a script for generating heatmaps for the configuration model.

Copy link

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

@nwlandry
Copy link
Owner Author

Once I get new results and the parallelization scripts have been fixed, this will be ready for review.

@nwlandry nwlandry merged commit 3372b8f into main Dec 13, 2023
1 check passed
@nwlandry nwlandry deleted the change-to-joblib branch December 13, 2023 22:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant