Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Limit memory consumption of sensitivity analysis #642

Open
geofjamg opened this issue Nov 4, 2022 · 0 comments
Open

Limit memory consumption of sensitivity analysis #642

geofjamg opened this issue Nov 4, 2022 · 0 comments
Assignees

Comments

@geofjamg
Copy link
Member

geofjamg commented Nov 4, 2022

  • Do you want to request a feature or report a bug?
    Feature

  • What is the current behavior?
    For both AC and DC sensitivity analysis, all factors end up in a "factor state" dense matrix. We already encountered 2 issues:

    • it sometimes can be greater that Java array size limit (which is the size of an integer)
    • it could lead a very high and uncontrollable memory consumption
  • What is the expected behavior?
    We should be able to configure a "chunk size" so that internally DC and AC sensitivity analysis process factors by batches and so on limit the memory consumption even if lower performance.

  • What is the motivation / use case for changing the behavior?
    Control memory consumption and allows to process a higher number of factors.

  • Please tell us about your environment:

    • PowSyBl Version: ...
    • OS Version: ...
  • Other information (e.g. detailed explanation, stacktraces, related issues, suggestions how to fix, links for us to have context, eg. stackoverflow, spectrum, etc)

(if a question doesn't apply, you can delete it)

@flo-dup flo-dup changed the title Limit memory consumption of sensisivity analysis Limit memory consumption of sensitivity analysis Nov 4, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants