-
Notifications
You must be signed in to change notification settings - Fork 74
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Random sampling for Plot Options histogram #2763
Conversation
…pacetelescope#2735)" This reverts commit fbef31f.
but does not seem to work [ci skip]
Using this branch with a ~4Gb dataset, the histogram seems pretty fast to me. Can you try and measure the time for the histogram to update using e.g:
just so we can rule out other issues such as the image viewer itself being slow. |
On further investigation I can reproduce the issue. However it does look like you are using the glue histogram viewer beneath the hood, let me see what we can do. |
Good catch on the nan stuff. I am going to close this in favor of yours. Thanks, Tom! |
* Revert "BUG: Always downsample histogram for Imviz in Plot Options (#2735)" This reverts commit fbef31f. * Use glue's ability to randomly sample values when computing histograms and image statistics, and remove code to handle NaN values that caused the whole array to be loaded into memory. * Use order='K' in ravel() to avoid copy * Avoid calling ravel() since this causes a copy for cutouts * Add comment to explain percentile values * Fix issue when array len() match but .shape doesn't * Adjust reference values for test * Bumped minimum required version of glue-core and glue-jupyter * Fix case where data is not a Numpy array * Add change log
… (spacetelescope#2771) * Revert "BUG: Always downsample histogram for Imviz in Plot Options (spacetelescope#2735)" This reverts commit fbef31f. * Use glue's ability to randomly sample values when computing histograms and image statistics, and remove code to handle NaN values that caused the whole array to be loaded into memory. * Use order='K' in ravel() to avoid copy * Avoid calling ravel() since this causes a copy for cutouts * Add comment to explain percentile values * Fix issue when array len() match but .shape doesn't * Adjust reference values for test * Bumped minimum required version of glue-core and glue-jupyter * Fix case where data is not a Numpy array * Add change log
Description
This pull request is to
Since we do not use glue-native histogram directly, not sure if we can take advantage of the following upstream PRs directly:
TODO
Change log entry
CHANGES.rst
? If you want to avoid merge conflicts,list the proposed change log here for review and add to
CHANGES.rst
before merge. If no, maintainershould add a
no-changelog-entry-needed
label.Checklist for package maintainer(s)
This checklist is meant to remind the package maintainer(s) who will review this pull request of some common things to look for. This list is not exhaustive.
trivial
label.