Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Exposing the getEstimate to test distinct values against a pre-built frequent items sketch #2

Open
cccs-jc opened this issue Oct 18, 2024 · 0 comments

Comments

@cccs-jc
Copy link

cccs-jc commented Oct 18, 2024

I'm interested in the frequent items (heavy hitters) sketch. I would like to build such a sketch on say a month of data.

I would then use this sketch on newly arriving events. What I would like to enrich my stream of events with a new column which states if the current event is a heavy hitter or not. One way I was thinking of doing this is by calling getEstimate of the ItemsSketch.

https://github.com/apache/datasketches-java/blob/2e9b84e8230e1067bfc5e977de4e3a3a13445169/src/main/java/org/apache/datasketches/frequencies/ItemsSketch.java#L338

Unfrortunately this function is note exposed in your library but seems like it would be easy to add?

Does it make sense to use getEstimate to achieve what I want or is there a even better way which I did not think of ?

Thanks in advance. @maropu

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant