Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to choose? Local setup on VM vs Remote AKS cluster? #143

Closed
chetan2309 opened this issue Feb 2, 2024 · 2 comments
Closed

How to choose? Local setup on VM vs Remote AKS cluster? #143

chetan2309 opened this issue Feb 2, 2024 · 2 comments
Assignees
Labels
FarmVibes.AI setup Issues encountered during cluster setup local cluster Issues encountered in local cluster question Information requested from user remote cluster Issues encountered in remote (AKS) cluster

Comments

@chetan2309
Copy link

Topic

FarmVibes.AI setup, Local cluster, Remote (AKS) cluster

Ask away!

Hi Team,

I would like to get clarity purely from cost perspective what and how to choose! What are cost implications of setting an Azure VM and then do the installation vs setting up a remote cluster?

  • I initially thought that AKS would be cheaper but seeing the cost in resource group made me believe that probably they would cost almost same.
  • On an Azure VM with installation I can run notebooks and connect via my local machine via port forwarding. I believe I can’t do the same on Remote AKS setup! Please guide.
  • What’s the situation where you would choose Azure AKS setup over VM setup?

Thanks,
Chetan

@chetan2309 chetan2309 added the question Information requested from user label Feb 2, 2024
@github-actions github-actions bot added triage Issues still not triaged by team FarmVibes.AI setup Issues encountered during cluster setup local cluster Issues encountered in local cluster remote cluster Issues encountered in remote (AKS) cluster labels Feb 2, 2024
@lonnes lonnes self-assigned this Feb 9, 2024
@renatolfc
Copy link
Contributor

Hello @chetan2309, thanks for your question!

  • If memory serves, an empty VM using the default configuration on Azure should be cheaper than an AKS cluster.
  • When you setup an AKS cluster, FarmVibes.AI gives you a public endpoint you can connect to. That endpoint is open by default, so you point your notebooks to it and run your workflows directly. (If you have security requirements, we encourage you to restrict access from the Azure portal itself.)

In general, you'd want to use a VM for development and experimentation and once you get into "steady state" of execution, you should probably migrate to AKS, as that'll allow for faster workflow execution and automatic storage scaling.

AKS has two other advantages as well: it is inherently multi-user (and multi-admin), and storage costs scale much slower than those of the VMs, because on AKS the asset storage is backed by Azure Blobs, whereas the VM uses HDDs or SSDs.

@rafaspadilha rafaspadilha removed the triage Issues still not triaged by team label Mar 8, 2024
@chetan2309
Copy link
Author

@renatolfc - thanks for your detailed explanation on this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
FarmVibes.AI setup Issues encountered during cluster setup local cluster Issues encountered in local cluster question Information requested from user remote cluster Issues encountered in remote (AKS) cluster
Projects
None yet
Development

No branches or pull requests

4 participants