Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Index Management Action Metrics #1195

Merged

Conversation

harshitakaushik-dev
Copy link
Contributor

@harshitakaushik-dev harshitakaushik-dev commented Jun 20, 2024

Description of changes:

  • Added metrics to all the ISM Actions.

CheckList:

  • Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@bowenlan-amzn I have made the requested changes in the code as per your feedback. Could you kindly review it again? I will add the changes to the tests in the next iteration.

Here are the metrics results we have on Grafana with the OpenTelemetry (Otel) setup. Attached are metrics for Transition Cumulative Latency and Rollover Failure.
image
image

harycash added 5 commits June 11, 2024 12:50
Signed-off-by: harycash <harycash@amazon.com>
Signed-off-by: harycash <harycash@amazon.com>
… Integration

Signed-off-by: harycash <harycash@amazon.com>
… Integration

Signed-off-by: harycash <harycash@amazon.com>
Signed-off-by: harycash <harycash@amazon.com>
@harshitakaushik-dev
Copy link
Contributor Author

@bowenlan-amzn @Gaganjuneja @sarthakaggarwal97 @vikasvb90 @r1walz @ankitkala
Kindly review the PR. Metrics have been added for 5 more ISM actions. Requested changes in the previous action have been made.

@harshitakaushik-dev harshitakaushik-dev changed the title Additional Index Management Action Metrics Index Management Action Metrics Jun 24, 2024
harycash and others added 5 commits June 25, 2024 00:42
Signed-off-by: harycash <harycash@amazon.com>
Signed-off-by: harycash <harycash@amazon.com>
Signed-off-by: harycash <harycash@amazon.com>
Copy link
Member

@bowenlan-amzn bowenlan-amzn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you show the metrics results with a Otel setup? Want to get an idea on what's the end results look like for user.
And do this on multi-node environments

Signed-off-by: harycash <harycash@amazon.com>
harycash added 4 commits July 1, 2024 21:43
Signed-off-by: harycash <harycash@amazon.com>
Signed-off-by: harycash <harycash@amazon.com>
Signed-off-by: harycash <harycash@amazon.com>
Signed-off-by: harycash <harycash@amazon.com>
Signed-off-by: harycash <harycash@amazon.com>
Copy link
Contributor

@sarthakaggarwal97 sarthakaggarwal97 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks @harshitakaushik-dev for taking this up. This would be really useful!

Copy link
Collaborator

@r1walz r1walz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good work!

@r1walz r1walz merged commit c5425a5 into opensearch-project:main Jul 4, 2024
18 of 29 checks passed
@opensearch-trigger-bot
Copy link
Contributor

The backport to 2.x failed:

The process '/usr/bin/git' failed with exit code 128

To backport manually, run these commands in your terminal:

# Navigate to the root of your repository
cd $(git rev-parse --show-toplevel)
# Fetch latest updates from GitHub
git fetch
# Create a new working tree
git worktree add ../.worktrees/index-management/backport-2.x 2.x
# Navigate to the new working tree
pushd ../.worktrees/index-management/backport-2.x
# Create a new branch
git switch --create backport/backport-1195-to-2.x
# Cherry-pick the merged commit of this pull request and resolve the conflicts
git cherry-pick -x --mainline 1 c5425a52e6e7d5fd0f87bf770436527c8911ee08
# Push it to GitHub
git push --set-upstream origin backport/backport-1195-to-2.x
# Go back to the original working tree
popd
# Delete the working tree
git worktree remove ../.worktrees/index-management/backport-2.x

Then, create a pull request where the base branch is 2.x and the compare/head branch is backport/backport-1195-to-2.x.

@sarthakaggarwal97 sarthakaggarwal97 added enhancement New request action Index management actions and removed backport-failed labels Jul 4, 2024
harshitakaushik-dev added a commit to harshitakaushik-dev/index-management that referenced this pull request Jul 4, 2024
* Initial integration of TelemetryAwarePlugin to ISM

Signed-off-by: harycash <harycash@amazon.com>

* Initial integration of TelemetryAwarePlugin to ISM

Signed-off-by: harycash <harycash@amazon.com>

* Initial integration of TelemetryAwarePlugin to ISM with Rollover Step Integration

Signed-off-by: harycash <harycash@amazon.com>

* Initial integration of TelemetryAwarePlugin to ISM with Rollover Step Integration

Signed-off-by: harycash <harycash@amazon.com>

* Additional actions metrics with requested changes from previous commit

Signed-off-by: harycash <harycash@amazon.com>

* Fixed Build Issues

Signed-off-by: harycash <harycash@amazon.com>

* Fixed Build Issues

Signed-off-by: harycash <harycash@amazon.com>

* Fixed Build Issues, Added new metric : Cumulative Latency

Signed-off-by: harycash <harycash@amazon.com>

* Fixed Build Issues, Added new metric : Cumulative Latency

Signed-off-by: harycash <harycash@amazon.com>

* Requested Changes and Addition of Metrics to all the remaining Actions

Signed-off-by: harycash <harycash@amazon.com>

* Updates on Action Metrics

Signed-off-by: harycash <harycash@amazon.com>

* Updates on Action Metrics

Signed-off-by: harycash <harycash@amazon.com>

* Build issues fixed

Signed-off-by: harycash <harycash@amazon.com>

* Build issues fixed

Signed-off-by: harycash <harycash@amazon.com>

---------

Signed-off-by: harycash <harycash@amazon.com>
Co-authored-by: harycash <harycash@amazon.com>
(cherry picked from commit c5425a5)
Signed-off-by: harycash <harycash@amazon.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
action Index management actions backport 2.x enhancement New request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants