Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unable to find shared memory region problem #7396

Open
sofiawu opened this issue Jul 1, 2024 · 1 comment
Open

Unable to find shared memory region problem #7396

sofiawu opened this issue Jul 1, 2024 · 1 comment

Comments

@sofiawu
Copy link

sofiawu commented Jul 1, 2024

Description
We deploy GPU services using tritonserver 21.12 version. The service adopts a dual docker mode, with one docker for the logical service and another docker for the triton service.
Data communication between GPU and CPU is done through shared memory
Recently, we have found that our service encounters an error like
tritonclient.utils.InferenceServerException: [StatusCode.NOT_FOUND] Unable to find shared memory region: 'data_xx_x'
causing the triton service to be unavailable and all service requests to fail.
After restarting the service, it resumes normal operation.

Triton Information
tritonserver 21.12 version

Are you using the Triton container or did you build it yourself?
using Triton container

@namogg
Copy link

namogg commented Jul 1, 2024

i am getting the same problem.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

2 participants