Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

promdump: Implement a "minimal" collection mode #163

Closed
ionthegeek opened this issue Dec 17, 2024 · 0 comments · Fixed by yugabyte/prometheus-remote-backfill#35
Closed
Assignees
Labels
enhancement New feature or request promdump Issues related to the prometheus-remote-backfill tools

Comments

@ionthegeek
Copy link
Contributor

Currently, universes with very large numbers of nodes or very large numbers of tables produce too many metrics for promdump to collect. Attempts to collect the tserver metrics cause Prometheus to hang, crash or return data so slowly that the dump fails due to timeout.

A "minimal" collection mode (similar to the YBA yb.metrics.collection_level => MINIMAL setting) should be implemented in promdump as this should make it possible to collect metrics from these very large Universes.

@ionthegeek ionthegeek self-assigned this Dec 17, 2024
@ionthegeek ionthegeek added enhancement New feature or request promdump Issues related to the prometheus-remote-backfill tools labels Dec 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request promdump Issues related to the prometheus-remote-backfill tools
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant