Engknow 1855 object store performance #27
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Contributor
gmagnu
commented
Dec 26, 2024
•
gmagnu
commented
- Move to the Java SDK CRT client - much faster.
- Use Files.list in stead of Files.walk as more stable and walk not needed.
- In write also ensure dir for remote locations.
- S3 in createDirectories just use createDirectory as Fiies.createDirectories (Carlspring version) needs to much access.
- OCI implement createDirectory and createDirectories.
- Tuning of tests.
- Update libs.
- Longer sleep tomes for cloud storage (because throttling is common cause).
…t-store-performance
…t-store-performance
- Fix error in metrics.
- Create directories fix for S3 (only create last element, but needs less access writes). - Test tuning.
Junit Tests - Summary4 224 tests ±0 4 059 ✅ - 1 11m 48s ⏱️ + 1m 3s Results for commit 49fddcc. ± Comparison against base commit 7cf6e01. This pull request skips 1 test.♻️ This comment has been updated with latest results. |
janeliutw
approved these changes
Dec 30, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.