Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

build: RHEL 8 Compatibility #7519

Merged
merged 17 commits into from
Aug 16, 2024
Merged

build: RHEL 8 Compatibility #7519

merged 17 commits into from
Aug 16, 2024

Conversation

nv-kmcgill53
Copy link
Contributor

@nv-kmcgill53 nv-kmcgill53 commented Aug 12, 2024

What does the PR do?

This PR adds the following:

  • Support for RHEL 8 compatible builds.
    • Public users will need to setup their RHEL-like systems and then use the --no-container-build since Triton Inference Server doesn't publish a base container with which to use
    • NVIDIA users may build using a private base container to build
  • Updated the target_platform() method in build.py to distinguish between debian and rhel-like systems.
    • A follow on PR to change the target platform from "linux" to "debian" will be generated after this.
  • Update to L0_infer to be able to execute on either debian-like or rhel-like systems.
  • Update to CMakeLists.txt files to correctly point at the lib64 directories on rhel-like systems.

Checklist

  • PR title reflects the change and is of format <commit_type>: <Title>
  • Changes are described in the pull request.
  • Related issues are referenced.
  • Populated github labels field
  • Added test plan and verified test passes.
  • Verified that the PR passes existing CI.
  • Verified copyright is correct on all changed files.
  • Added succinct git squash message before merging ref.
  • All template sections are filled out.
  • Optional: Additional screenshots for behavior/output changes with before/after.

Commit Type:

Check the conventional commit type
box here and add the label to the github PR.

  • build
  • ci
  • docs
  • feat
  • fix
  • perf
  • refactor
  • revert
  • style
  • test

Related PRs:

triton-inference-server/core#387
triton-inference-server/third_party#59

Where should the reviewer start?

build.py is the meat of this PR. The CMakeLists.txt files are the same changes which are needed in the Related PRs section.

Test plan:

No new e2e tests were added to this repository

  • CI Pipeline ID:17365005

Caveats: N/A

Background

This is a requested feature from users of Triton, check with Product team for specifics.

Related Issues: (use one of the action keywords Closes / Fixes / Resolves / Relates to)

  • N/A

nv-kmcgill53 and others added 7 commits August 12, 2024 08:21
More general capture of Linux Distros

tritonserver compiling except for --filesystem=gcs and --filesystem=s3

adding sbsa installation for dcgm

updating RUNPATH directory for tritonserver executable

cleanup

removed build_ubuntu and updated build.py
* Merge ORT RHEL changes Into Kyle's RHEL dev
@nv-kmcgill53 nv-kmcgill53 added the module: platforms Issues related to platforms, hardware, and support matrix label Aug 12, 2024
@nv-kmcgill53 nv-kmcgill53 marked this pull request as ready for review August 12, 2024 21:12
build.py Outdated Show resolved Hide resolved
CMakeLists.txt Show resolved Hide resolved
mc-nv
mc-nv previously approved these changes Aug 14, 2024
CMakeLists.txt Show resolved Hide resolved
@mc-nv mc-nv dismissed their stale review August 14, 2024 03:32

I think we can make definition more clear

mc-nv
mc-nv previously approved these changes Aug 14, 2024
build.py Outdated Show resolved Hide resolved
Co-authored-by: Francesco Petrini <francescogpetrini@gmail.com>
Copy link
Contributor

@fpetrini15 fpetrini15 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, pending passing CI. Great work Kyle!

@nv-kmcgill53 nv-kmcgill53 merged commit 7a158a4 into main Aug 16, 2024
3 checks passed
@nv-kmcgill53 nv-kmcgill53 deleted the kmcgill-rhel branch August 16, 2024 17:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
module: platforms Issues related to platforms, hardware, and support matrix
Development

Successfully merging this pull request may close these issues.

3 participants