Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Automatic model type detection #7381

Open
dvirmor opened this issue Jun 27, 2024 · 0 comments
Open

Automatic model type detection #7381

dvirmor opened this issue Jun 27, 2024 · 0 comments

Comments

@dvirmor
Copy link

dvirmor commented Jun 27, 2024

Description
When I create a model directory without configuration, the server try to detect the model type from the first version and not from the latest version. In this case, if my first version model is onnx type and my second version is trt type, without configuration the server will search for model.onnx instead model.plan

Triton Information
What version of Triton are you using?
23.04

Are you using the Triton container or did you build it yourself?
container

To Reproduce
Create model with 2 versions, onnx and trt. After this try to run the server.

Expected behavior
I expect that if the automatic configuration take the latest model, it needs to take the model type of the latest version and not the first version.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

1 participant