Releases: hemachandsai/s3-bulk-delete
Releases · hemachandsai/s3-bulk-delete
Minor Changes
Banner Addition & minor code enhancements
s3-bulk-delete v2 release
This release contains s3-bulk-delete utility which clear aws s3 bucket at much higher rate than aws-cli recursive delete functionality.
Note:-
- Once, aws max limit is hit(approx after deletion of 2,50,000 keys) the subsequent calls slows down to match available ops per second.
- The max rate of this utility is currently set to the default s3 value of 3.5k objects per second, max 21 active requests at any instinct. This value can be tweaked with maxConcurrentHTTPCalls and maxQueuedHTTPCalls variable.
s3-bulk-delete v1 release
This release contains the basic version of s3-bulk-delete utility which clear aws s3 bucket at much higher rate than aws-cli recursive delete functionality.
Note:-
- Continuous code handling when aws max limit is hit(approx after deletion of 2,50,000 keys), is not yet handled and will be taken care off once aws go-sdk community team responds back.
- The max rate of this utility is currently set to the default s3 value of 3.5k objects per second and is dependent on number of s3 prefixes. This value can be tweaked with maxConcurrentHTTPCalls variable.