Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Demo environment bootstrap #36

Merged
merged 5 commits into from
Aug 1, 2024
Merged

Demo environment bootstrap #36

merged 5 commits into from
Aug 1, 2024

Conversation

AdrianoKF
Copy link
Collaborator

@AdrianoKF AdrianoKF commented Aug 1, 2024

The hack/bootstrap-demo-env.sh script automatically performs the necessary steps to provision a demo environment on a macOS machine:

  • Colima VM setup
  • Minikube cluster deployment with image registry and proxy
  • Kueue with single cluster queue setup
  • Kuberay operator

By default, it uses the following settings:

  • Colima: 6 CPU, 12 GiB memory, 40 GiB disk, vz VM type
  • Minikube: all available Colima CPUs, 10 GiB memory
  • Kueue version v0.8.0

The defaults can be overwritten using the COLIMA_[CPUS|MEMORY|DISK|VM_TYPE], MINIKUBE_[CPUS|MEMORY], and KUEUE_VERSION environment variables.


Furthermore, this PR changes the CI pipeline to install packages using uv pip install, leading to a significant speedup of the CI workflow (~36s vs ~2min before).


Also, it updates Ray to the latest version 2.34.0 and adds code to automatically detect the installed Ray version from the active Python environment.

Closes #32

The script automatically performs the necessary steps to provision
a demo environment on a macOS machine:

- Colima VM setup
- Minikube cluster deployment with image registry and proxy
- Kueue with single cluster queue setup
- Kuberay operator

Closes #32
@AdrianoKF AdrianoKF self-assigned this Aug 1, 2024
@AdrianoKF AdrianoKF marked this pull request as ready for review August 1, 2024 10:32
@AdrianoKF
Copy link
Collaborator Author

AdrianoKF commented Aug 1, 2024

Note: the recently released v0.7.0 of Colima fixes the problems we previously had with vz VMs (the script automatically installs the latest version, no need to manually update).

Since I did not encounter any problems after switching to vz from qemu, I have made it the default in the script.
Please verify if it also works for you and report any issues.

@AdrianoKF AdrianoKF force-pushed the 32-setup-script branch 14 times, most recently from 9d1d422 to f0556eb Compare August 1, 2024 11:25
This considerably speeds up the dependency installation in CI.
@AdrianoKF AdrianoKF merged commit 5022b7b into main Aug 1, 2024
2 checks passed
@AdrianoKF AdrianoKF deleted the 32-setup-script branch August 1, 2024 11:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Setup script to create resources needed for live demo
1 participant