We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Currently TorchServe has support for Intel GPUs:
examples/intel_extension_for_pytorch
Support is provided more as an extension rather than being inherent part of TorchServe
Nevertheless, TorchServe with Intel® Extension for PyTorch* can deploy any model and do inference.
To use TorchServe with Intel GPU, the machine must have the latest oneAPI Base Kit installed, activated, and ipex GPU installed.
There is a custom intel_gpu_metric_collector.py provided that needs to be used, rather than the existing metric_collector.py in TorchServe
Action points:
The text was updated successfully, but these errors were encountered:
Some notes: torch.xpu — PyTorch 2.5 documentation torch.xpu.is_available — PyTorch 2.5 documentation Intel® Extension for PyTorch* — PyTorch Tutorials 2.5.0+cu124 documentation GitHub - intel/intel-extension-for-pytorch at xpu-main Examples — Intel® Extension for PyTorch* 2.3.110+xpu documentation pytorch/torch/xpu/memory.py at main · pytorch/pytorch Tensor Attributes — PyTorch 2.5 documentation
Sorry, something went wrong.
No branches or pull requests
Currently TorchServe has support for Intel GPUs:
examples/intel_extension_for_pytorch
Support is provided more as an extension rather than being inherent part of TorchServe
Nevertheless, TorchServe with Intel® Extension for PyTorch* can deploy any model and do inference.
To use TorchServe with Intel GPU, the machine must have the latest oneAPI Base Kit installed, activated, and ipex GPU installed.
There is a custom intel_gpu_metric_collector.py provided that needs to be used, rather than the existing metric_collector.py in TorchServe
Action points:
The text was updated successfully, but these errors were encountered: