The Weka cluster on Azure provides a fast and scalable platform to run, for example, performance-intensive applications and hybrid cloud workflows. It can also be used for object stores, tiering, and snapshots using the Azure Blob service. The provided Azure-Weka Terraform package contains modules and examples you can customize according to your deployment needs. The installation is based on applying the customized Terraform variables file to a predefined Azure subscription. Applying the Terraform variables file performs the following:
- Creates resources in a predefined resource group, such as virtual machines, network interfaces, function app, load balancer, and more.
- Deploys Azure virtual machines.
- Installs the Weka software.
- Configures the Weka cluster.
You can find here our essential deployment which creates only vms and placement group.
module "deploy-weka" {
source = "weka/weka/azure"
version = "3.0.1"
prefix = "weka"
rg_name = "myResourceGroup"
vnet_name = "weka-vpc-0"
vnet_rg_name = "myVnetResourceGroup"
subnet_name = "weka-subnet-0"
sg_id = "security-group-id"
get_weka_io_token = "get_weka_io_token"
cluster_name = "myCluster"
subnet_delegation = "10.0.1.0/25"
set_obs_integration = false
instance_type = "Standard_L8s_v3"
cluster_size = 6
subscription_id = "mySubscriptionId"
private_dns_zone_name = "myDns.private.net"
}As you can see via source_image_id variable, we use our own custom image.
This is a community image that we created and uploaded to azure.
In case you would like to view how we created the image you can find it here.
You can as well create it on your own subscription and use it.
| Name | Version |
|---|---|
| azurerm | ~>3.43.0 |
| Name | Version |
|---|---|
| azurerm | ~>3.43.0 |
| local | n/a |
| null | n/a |
| random | n/a |
| tls | n/a |
No modules.
| Name | Description | Type | Default | Required |
|---|---|---|---|---|
| apt_repo_url | The URL of the apt private repository. | string |
"" |
no |
| blob_obs_access_key | The access key of the existing Blob object store container. | string |
"" |
no |
| cluster_name | The cluster name. | string |
"poc" |
no |
| cluster_size | The number of virtual machines to deploy. | number |
6 |
no |
| container_number_map | Maps the number of objects and memory size per machine type. | map(object({ |
{ |
no |
| default_disk_size | The default disk size. | number |
48 |
no |
| function_app_dist | Function app code dist | string |
"release" |
no |
| function_app_log_level | Log level for function app (from -1 to 5). See https://github.com/rs/zerolog#leveled-logging | number |
1 |
no |
| function_app_storage_account_container_prefix | Weka storage account container name prefix | string |
"weka-tf-functions-deployment-" |
no |
| function_app_storage_account_prefix | Weka storage account name prefix | string |
"weka" |
no |
| function_app_version | Function app code version (hash) | string |
"caff19ed8651de36891b0c99e330c006" |
no |
| get_weka_io_token | The token to download the Weka release from get.weka.io. | string |
"" |
no |
| hotspare | Hot-spare value. | number |
1 |
no |
| install_cluster_dpdk | Install weka cluster with DPDK | bool |
true |
no |
| install_weka_url | The URL of the Weka release download tar file. | string |
"" |
no |
| instance_type | The virtual machine type (sku) to deploy. | string |
"Standard_L8s_v3" |
no |
| obs_container_name | Name of existing obs conatiner name | string |
"" |
no |
| obs_name | Name of existing obs storage account | string |
"" |
no |
| prefix | The prefix for all the resource names. For example, the prefix for your system name. | string |
"weka" |
no |
| private_dns_zone_name | The private DNS zone name. | string |
null |
no |
| private_network | Determines whether to enable a private or public network. The default is public network. | bool |
false |
no |
| protection_level | Cluster data protection level. | number |
2 |
no |
| rg_name | A predefined resource group in the Azure subscription. | string |
n/a | yes |
| set_obs_integration | Determines whether to enable object stores integration with the Weka cluster. Set true to enable the integration. | bool |
false |
no |
| sg_id | The security group id. | string |
n/a | yes |
| source_image_id | Use weka custom image, ubuntu 20.04 with kernel 5.4 and ofed 5.8-1.1.2.1 | string |
"/communityGalleries/WekaIO-d7d3f308-d5a1-4c45-8e8a-818aed57375a/images/ubuntu20.04/versions/latest" |
no |
| ssh_private_key | The path to the VM private key. If it is not set, the key is auto-generated. If it is set, also set the ssh_private_key. The private key used for connecting to the deployed virtual machines to initiate the clusterization of Weka. | string |
null |
no |
| ssh_public_key | The path to the VM public key. If it is not set, the key is auto-generated. If it is set, also set the ssh_private_key. | string |
null |
no |
| stripe_width | Stripe width = cluster_size - protection_level - 1 (by default). | number |
-1 |
no |
| subnet_delegation | Subnet delegation enables you to designate a specific subnet for an Azure PaaS service | string |
n/a | yes |
| subnet_name | The subnet name. | string |
n/a | yes |
| subscription_id | The subscription id for the deployment. | string |
n/a | yes |
| tags_map | A map of tags to assign the same metadata to all resources in the environment. Format: key:value. | map(string) |
{ |
no |
| tiering_ssd_percent | When set_obs_integration is true, this variable sets the capacity percentage of the filesystem that resides on SSD. For example, for an SSD with a total capacity of 20GB, and the tiering_ssd_percent is set to 20, the total available capacity is 100GB. | number |
20 |
no |
| traces_per_ionode | The number of traces per ionode. Traces are low-level events generated by Weka processes and are used as troubleshooting information for support purposes. | number |
10 |
no |
| vm_username | The user name for logging in to the virtual machines. | string |
"weka" |
no |
| vnet_name | The virtual network name. | string |
n/a | yes |
| vnet_rg_name | Resource group name of vnet | string |
n/a | yes |
| weka_version | The Weka version to deploy. | string |
"4.2.0.142" |
no |
| Name | Description |
|---|---|
| cluster_helpers_commands | Useful commands and script to interact with weka cluster |