Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[GLUTEN-8187][VL] Support velox cache metrics #8188

Merged
merged 2 commits into from
Dec 13, 2024
Merged

Conversation

yikf
Copy link
Contributor

@yikf yikf commented Dec 9, 2024

What changes were proposed in this pull request?

Velox backend supports cache functionality controlled by the config spark.gluten.sql.columnar.backend.velox.cacheEnabled, When the cache is enabled, we want to measure its effectiveness through a series of metrics.

This PR intends to add metrics for cache read operations.

How was this patch tested?

unit tests

@github-actions github-actions bot added the VELOX label Dec 9, 2024
Copy link

github-actions bot commented Dec 9, 2024

#8187

@yikf yikf force-pushed the cache-metrics branch 3 times, most recently from 48e45f6 to aaea35b Compare December 11, 2024 11:45
@yikf
Copy link
Contributor Author

yikf commented Dec 11, 2024

@PHILO-HE @zhztheplayer Could you please take a look, thanks!

env,
metricsBuilderClass,
"<init>",
"([J[J[J[J[J[J[J[J[J[JJ[J[J[J[J[J[J[J[J[J[J[J[J[J[J[J[J[J[J[J[J[J[J[J[J[J[J)V");
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We eventually need a better way to pass metrics.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks @FelixYBW , agree with you.

@FelixYBW FelixYBW merged commit dd72810 into apache:main Dec 13, 2024
46 checks passed
@yikf yikf deleted the cache-metrics branch December 13, 2024 02:09
yikf added a commit to yikf/incubator-gluten that referenced this pull request Dec 13, 2024
Velox backend supports cache functionality controlled by the config spark.gluten.sql.columnar.backend.velox.cacheEnabled, When the cache is enabled, we want to measure its effectiveness through a series of metrics.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants