Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

periodically check reindex status #219

Open
wants to merge 5 commits into
base: 2.x
Choose a base branch
from

Conversation

AlternateIf
Copy link
Contributor

@AlternateIf AlternateIf commented Dec 2, 2024

aws opensearch failed me multiple times when reindexing big indices. apparently there is some time of connection time limit set and even passing "timeout" for the reinidex call did not help. When the time limit is reached an exception occurs. (i think it was a 504 gateway timeout)

so to fix this i switched to letting the reindex run asynchronously and only querying the status periodically. this way we get instant responses from the index call and don't run into timeouts.

We can refine this approach. this is just my WIP i used to temporarly fix for a project where that problem occured.

what do you think? @fashxp @mattamon

Copy link

github-actions bot commented Dec 2, 2024

CLA Assistant Lite bot:
Thank you for your submission, we really appreciate it. Like many open-source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution. You can sign the CLA by just posting a Pull Request Comment same as the below format.


I have read the CLA Document and I hereby sign the CLA


1 out of 2 committers have signed the CLA.
✅ (AlternateIf)[https://github.com/AlternateIf]
@david Magoc
David Magoc seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.
You can retrigger this bot by commenting recheck in this Pull Request

Copy link

sonarcloud bot commented Dec 2, 2024

@AlternateIf
Copy link
Contributor Author

AlternateIf commented Dec 3, 2024

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants