Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Optimize Coroot AWS Agent to Handle Large Number of RDS Hosts #6

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

YoranSys
Copy link

@YoranSys YoranSys commented Oct 9, 2024

The Coroot AWS Agent is currently unable to efficiently process and monitor the large number of RDS hosts in our environment. This performance bottleneck is causing delays in data collection and reporting, potentially impacting our ability to monitor our AWS RDS infrastructure effectively.

Proposed Solution:

  • Implement a worker pool for concurrent processing of RDS instances during discovery.
  • Use sync.Map for thread-safe operations on the instances map.
  • Collect metrics concurrently within each Collector.
  • Utilize buffered channels for metric collection to reduce blocking.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant