Skip to content

Commit

Permalink
Merge pull request #95 from huggingface/jeffboudier-endpoints-doc-nim…
Browse files Browse the repository at this point in the history
…-container-order

Update container_types.mdx
  • Loading branch information
Michellehbn authored Sep 5, 2024
2 parents ae3702f + f28bb28 commit cdfcf9d
Showing 1 changed file with 5 additions and 5 deletions.
10 changes: 5 additions & 5 deletions docs/source/others/container_types.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -10,11 +10,6 @@ The default container type is the easiest way to deploy endpoints and is flexibl

Select a custom container type if you'd like to customize the image and include a [custom container](https://huggingface.co/docs/inference-endpoints/guides/custom_container).

## NVIDIA NIM (no longer available in UI)

*The NIM container type will no longer be officially supported for already existing Endpoints in Inference Endpoints beginning October 1st, 2024.*
Select the NIM container type for models supported by NVIDIA. You'll see this option in the UI if supported for that model.

## Text Embeddings Inference

Select the Text Embeddings Inference container type to gain all the benefits of [TEI](https://huggingface.co/docs/text-embeddings-inference/en/index) for your Endpoint. You'll see this option in the UI if supported for that model.
Expand All @@ -30,3 +25,8 @@ Select the Text Generation Inference Inferentia2 Neuron container type for model
## Text Generation Inference (TPU)

Select the Text Generation Inference TPU container type for models you'd like to deploy with TGI on a Google Cloud TPU instance. You'll see this option in the UI if supported for that model.

## NVIDIA NIM (no longer available in UI)

*The NIM container type will no longer be officially supported for already existing Endpoints in Inference Endpoints beginning October 1st, 2024.*
Select the NIM container type for models supported by NVIDIA. You'll see this option in the UI if supported for that model.

0 comments on commit cdfcf9d

Please sign in to comment.