Skip to content
This repository has been archived by the owner on Jun 29, 2019. It is now read-only.

How to scale operationalization on your ACS cluster

Don Glover edited this page Jun 14, 2017 · 1 revision

Operationalized models, deployed on ACS clusters on which Kubernetes has been installed, can be scaled in two ways:

  • You can scale the number of agent nodes in the cluster.
  • You can scale the number of Kubernetes pods.

Scale the number of nodes in the cluster

For information on scaling the number of nodes in the cluster, see Scale agent nodes in a Container Service cluster.

Scale the number Kubernetes pods

Using the -k parameter when setting up the operationalization environment, configures one pod and installs the Kubernetes CLI. You can use Azure Machine Learning CLI or the Kubernetes dashboard to scale the number of pods assigned to the cluster.

Scale using the Azure Machine Learning CLI

To scale the number pods in the Kubernetes service, use the az ml scale command.

az ml scale realtime -n <service name> -z <number of pods>

For more information on Kubernetes pods, see the Kubernetes Pods documentation.

Scale using the Kubernetes dashboard

The command to start the Kubernetes dashboard web interface is the same on both Windows and Linux:

kubectl proxy

On Windows, the Kubernetes install location is not automatically added to the path. You must first navigate the install folder:

c:\users\<user name>\bin

Once you run the command, you should see the following informational message:

Starting to serve on 127.0.0.1:8001

If the port is already in use, you see a message similar to the following example:

F0612 21:49:22.459111   59621 proxy.go:137] listen tcp 127.0.0.1:8001: bind: address already in use

You can specify an alternate port number using the --port parameter.

kubectl proxy --port=8010
Starting to serve on 127.0.0.1:8010

Once you have started the dashboard server, open a browser and enter the following URL:

127.0.0.1:<port number>/ui

From the dashboard main screen, click Deployments on the left navigation bar. If the navigation pane does not display, select this icon Menu consisting of three short horizontal lines on the upper left.

Locate the deployment to modify and click this icon Menu icon consisting of three vertical dots on the right and then click View/edi YAML.

On the Edit deployment screen, locate the spec node and modify the replicas value and click Update.