Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[parquet] Set the default size of BitWriter in DeltaBitPackEncoder to 1MB #5776

Merged
merged 1 commit into from
May 20, 2024

Conversation

AdamGS
Copy link
Contributor

@AdamGS AdamGS commented May 16, 2024

Which issue does this PR close?

closes #5755.

Rationale for this change

Save on unnecessary allocations, now that the buffers are mutable.

What changes are included in this PR?

The main change + a couple of automatic fmt changes courtesy of vscode.

Are there any user-facing changes?

No

@github-actions github-actions bot added the parquet Changes to the parquet crate label May 16, 2024
@tustvold tustvold changed the title [parquet] Set the default size of BitWriter in DeltdBitPackEndoer to 1MB [parquet] Set the default size of BitWriter in DeltaBitPackEncoder to 1MB May 20, 2024
@tustvold tustvold merged commit ce8363a into apache:master May 20, 2024
17 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
parquet Changes to the parquet crate
Projects
None yet
Development

Successfully merging this pull request may close these issues.

parquet: ByteArrayEncoder allocates large unused FallbackEncoder for Parquet 2
2 participants