Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Process delayed alert conditions in batches of 10,000 #75302

Merged
merged 20 commits into from
Jul 31, 2024
Merged

Process delayed alert conditions in batches of 10,000 #75302

merged 20 commits into from
Jul 31, 2024

Commits on Jul 31, 2024

  1. WIP

    @saponifi3d
    saponifi3d committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    79ba7d0 View commit details
    Browse the repository at this point in the history

  2. Add the ability to batch the apply delayed function. 

    - look at the size of the hash
- if under the limit
  - parse the groups as we were
- else (over the limit)
  - break into batches of 10,000. Store new batches in redis.
    @saponifi3d
    saponifi3d committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    1ed44ad View commit details
    Browse the repository at this point in the history

  3. WIP

    @saponifi3d
    saponifi3d committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    70cbbb4 View commit details
    Browse the repository at this point in the history

  4. move mock redis buffer into the create event test case, and provide p… 

    …ush_to_hash there
    @saponifi3d
    saponifi3d committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    5225441 View commit details
    Browse the repository at this point in the history

  5. Cleanup the code, add some test cases around single / batch execution

    @saponifi3d
    saponifi3d committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    8b20402 View commit details
    Browse the repository at this point in the history

  6. raise a not implemented error

    @saponifi3d
    saponifi3d committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    7aafed8 View commit details
    Browse the repository at this point in the history

  7. add a docstring tot he process grops, move logic for fetching teh rul… 

    …egroup data to that function
    @saponifi3d
    saponifi3d committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    cdf288f View commit details
    Browse the repository at this point in the history

  8. i am the walrus

    @saponifi3d
    saponifi3d committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    d39202e View commit details
    Browse the repository at this point in the history

  9. fix comment

    @saponifi3d
    saponifi3d committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    9af164b View commit details
    Browse the repository at this point in the history

  10. -1 line changed

    @saponifi3d
    saponifi3d committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    c94c18e View commit details
    Browse the repository at this point in the history

  11. add hmset and use bulk updating to redis

    @saponifi3d
    saponifi3d committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    41fbcb7 View commit details
    Browse the repository at this point in the history

  12. add tests for the all the new buffer code

    @saponifi3d
    saponifi3d committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    c1a7982 View commit details
    Browse the repository at this point in the history

  13. reduce diff

    @saponifi3d
    saponifi3d committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    ba6b28d View commit details
    Browse the repository at this point in the history

  14. use options automator to store the batch size

    @saponifi3d
    saponifi3d committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    b767878 View commit details
    Browse the repository at this point in the history

  15. move from a module vairable to getting it from the options automator.… 

    … using the test helper instead
    @saponifi3d
    saponifi3d committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    267d71d View commit details
    Browse the repository at this point in the history

  16. make the comment _better_

    @saponifi3d
    saponifi3d committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    c29c5e3 View commit details
    Browse the repository at this point in the history

  17. make it modifiable

    @saponifi3d
    saponifi3d committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    babca17 View commit details
    Browse the repository at this point in the history

  18. update cleanup_redis_buffers to remove batched keys as well

    @saponifi3d
    saponifi3d committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    1cd92fe View commit details
    Browse the repository at this point in the history

  19. add a note about hmset v hset

    @saponifi3d
    saponifi3d committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    834445d View commit details
    Browse the repository at this point in the history

  20. remove all these extra mocks

    @saponifi3d
    saponifi3d committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    4bac969 View commit details
    Browse the repository at this point in the history