Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Remove query splitters from the API #5571

Merged
merged 1 commit into from
Feb 22, 2024

Conversation

evanh
Copy link
Member

@evanh evanh commented Feb 21, 2024

After testing how much the splitters were being used, and the improvement they
were providing, splitters were only being used on a very small percentage
of queries (up to 5% on the highest dataset). After pausing the splitters,
there was almost no impact on the performance of queries. Only a single
referrer had a noticeable performance degradation, and that was not enough to
cause any actual impact on the queries (rate limiting, timeouts etc.)

After testing how much the splitters were being used, and the improvement they
were providing, splitters were only being used on a very small percentage
of queries (up to 5% on the highest dataset). After pausing the splitters,
there was almost no impact on the performance of queries. Only a single
referrer had a noticeable performance degradation, and that was not enough to
cause any actual impact on the queries (rate limiting, timeouts etc.)
@evanh evanh requested a review from a team as a code owner February 21, 2024 16:06
Copy link

codecov bot commented Feb 21, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (fab669b) 89.90% compared to head (d89f829) 89.88%.
Report is 4 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #5571      +/-   ##
==========================================
- Coverage   89.90%   89.88%   -0.03%     
==========================================
  Files         896      893       -3     
  Lines       43418    43179     -239     
  Branches      288      288              
==========================================
- Hits        39034    38810     -224     
+ Misses       4342     4327      -15     
  Partials       42       42              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@evanh evanh merged commit 01af478 into master Feb 22, 2024
32 checks passed
@evanh evanh deleted the evanh/fix/remove-query-splitters branch February 22, 2024 14:31
@getsentry-bot
Copy link
Contributor

PR reverted: ab239e8

getsentry-bot added a commit that referenced this pull request Feb 22, 2024
This reverts commit 01af478.

Co-authored-by: asottile-sentry <103459774+asottile-sentry@users.noreply.github.com>
@asottile-sentry
Copy link
Member

this is breaking sentry:

FAILED tests/sentry/eventstore/snuba/test_backend.py::SnubaEventStorageTest::test_get_adjacent_event_ids - AssertionError: assert None == ('4553539026681858', 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa')

evanh added a commit that referenced this pull request Feb 22, 2024
evanh added a commit to getsentry/sentry that referenced this pull request Mar 14, 2024
This one test fails in Snuba CI, however I have been completely unable
to
reproduce this failure in any other environment. That includes prod,
because
the change that breaks this (removing query splitters in Snuba) is
currently
running in prod.

It is also extremely difficult to debug this problem using just CI. So,
this
test will be xfail'd for now, then after the Snuba change is merged in,
I can
debug this test in a much easier way.

Snuba change in question: getsentry/snuba#5571
evanh added a commit that referenced this pull request Mar 15, 2024
* Original commit: "feat: Remove query splitters from the API (#5571)"

After testing how much the splitters were being used, and the improvement they
were providing, splitters were only being used on a very small percentage
of queries (up to 5% on the highest dataset). After pausing the splitters,
there was almost no impact on the performance of queries. Only a single
referrer had a noticeable performance degradation, and that was not enough to
cause any actual impact on the queries (rate limiting, timeouts etc.)

* Unrevert: feat: Remove query splitters from the API

This was reverted because it was causing a test failure in Sentry master.
JonasBa pushed a commit to getsentry/sentry that referenced this pull request Mar 17, 2024
This one test fails in Snuba CI, however I have been completely unable
to
reproduce this failure in any other environment. That includes prod,
because
the change that breaks this (removing query splitters in Snuba) is
currently
running in prod.

It is also extremely difficult to debug this problem using just CI. So,
this
test will be xfail'd for now, then after the Snuba change is merged in,
I can
debug this test in a much easier way.

Snuba change in question: getsentry/snuba#5571
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants