Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request] Allow parallel sync/copy per measurement instead per chunk #20

Open
toni-moreno opened this issue Jun 18, 2019 · 0 comments

Comments

@toni-moreno
Copy link
Owner

Right now sync is done by chunk period, each chunk process in parallel ( as workers as configured ) each one of the measurements , if one measurement fails all the chuck are marked as bad chunk (even though all other measurements has been synced/copies ok) .

Our DB's usually could be one big measurement and others smaller, if processed by chunks all data will be affected if one big measurements impact on all other data. Perhaps per measurment parallel process data will be fastest copied and also recovered by measurement.

This change requires a big refactor.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant