New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Include the Intel ISA-L library to improve erasure coding performance #558

Open

Jimvin opened this issue Jul 22, 2024 · 0 comments

Member

Jimvin commented Jul 22, 2024

Erasure coding performance can be improved by including support for the Intel ISA-L native library as described in the Hadoop documentation -> https://hadoop.apache.org/docs/r3.3.4/hadoop-project-dist/hadoop-hdfs/HDFSErasureCoding.html#Enable_Intel_ISA-L

This following steps are required to enable ISA-L support:

Building the ISA-L library
Building Hadoop with ISA-L support
Including the ISA-L native library in the Hadoop docker image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment