You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
Rust API for Triton Server to integrate Triton in-process with a Rust Server
Rust is now a universally recommended language to develop native close-to-metal high performance programs providing compile time guarantees of safety.
Describe the solution you'd like
Generate Rust bindings using rust-bindgen based on tritonserver.h and leverage the inprocess library with our Rust server. I'm working on this in my free time and would be happy to contribute; however, if you have official plans of supports a Rust crate, that'd make my life easier.
Describe alternatives you've considered
Integrating with tensorflow/rust and tch-rs crates directly and bypassing Triton. Not as desired since we would have to reimplement a bunch of inference server functionality that Triton provides out of the box.
Additional context
None.
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
Rust API for Triton Server to integrate Triton in-process with a Rust Server
Rust is now a universally recommended language to develop native close-to-metal high performance programs providing compile time guarantees of safety.
Describe the solution you'd like
Generate Rust bindings using rust-bindgen based on tritonserver.h and leverage the inprocess library with our Rust server. I'm working on this in my free time and would be happy to contribute; however, if you have official plans of supports a Rust crate, that'd make my life easier.
Describe alternatives you've considered
Integrating with tensorflow/rust and tch-rs crates directly and bypassing Triton. Not as desired since we would have to reimplement a bunch of inference server functionality that Triton provides out of the box.
Additional context
None.
The text was updated successfully, but these errors were encountered: