Check demos and upgrade from 24.3 to 24.7 release #65
Labels
Comments
|
🟢 airflow-scheduled-jobs Upgrade 23.4 -> 23.7 worked. Had to uninstall postgres and redis (new versions) manually |
|
🟢 hbase-hdfs-load-cycling-data EDIT: Installing from main / 24.7 leads to failing distcp job (due to removing map reduce from docker image) Works with #69 |
|
🟢 end-to-end-security No upgrade required. But requires #67 for krb5 version (1.21.1) fix. Works with that fix. |
|
🟢 nifi-kafka-druid-earthquake-data Requires #67 for druid db credentials fix. |
|
🟢 signal-processing # Clone demos repository and checkout release-24.3 branch (/tmp)
git clone git@github.com:stackabletech/demos.git
git checkout release-24.3
# Clone release and use 24.3
git clone git@github.com:stackabletech/release.git
# point local stacks file to local folder
stackablectl demo in signal-processing --demo-file /tmp/demos/demos/demos-v2.yaml --stack-file /tmp/demos/stacks/stacks-v2.yaml --release-file /tmp/release/releases.yaml
# uninstall release
stackablectl release uninstall 24.3
# replace crds
kubectl replace -f https://raw.githubusercontent.com/stackabletech/commons-operator/release-24.7/deploy/helm/commons-operator/crds/crds.yaml
kubectl replace -f https://raw.githubusercontent.com/stackabletech/nifi-operator/release-24.7/deploy/helm/nifi-operator/crds/crds.yaml
kubectl replace -f https://raw.githubusercontent.com/stackabletech/secret-operator/release-24.7/deploy/helm/secret-operator/crds/crds.yaml
kubectl replace -f https://raw.githubusercontent.com/stackabletech/zookeeper-operator/release-24.7/deploy/helm/zookeeeper-operator/crds/crds.yaml
# install latest
stackablectl demo in signal-processing |
|
🟢 logging # Clone demos repository and checkout release-24.3 branch (/tmp)
git clone git@github.com:stackabletech/demos.git
git checkout release-24.3
# Clone release and use 24.3
git clone git@github.com:stackabletech/release.git
# point local stacks file to local folder
stackablectl demo in logging --demo-file /tmp/demos/demos/demos-v2.yaml --stack-file /tmp/demos/stacks/stacks-v2.yaml --release-file /tmp/release/releases.yaml
# uninstall release
stackablectl release uninstall 24.3
# replace crds
kubectl replace -f https://raw.githubusercontent.com/stackabletech/commons-operator/release-24.7/deploy/helm/commons-operator/crds/crds.yaml
kubectl replace -f https://raw.githubusercontent.com/stackabletech/secret-operator/release-24.7/deploy/helm/secret-operator/crds/crds.yaml
kubectl replace -f https://raw.githubusercontent.com/stackabletech/zookeeper-operator/release-24.7/deploy/helm/zookeeper-operator/crds/crds.yaml
# delete setup-opensearch-dashboards job
# uninstall helm releases
helm uninstall vector-aggregator
# install latest
stackablectl demo in signal-processing |
|
🟢 trino-iceberg
Loosely following: #59 (comment) # Clone demos repository and checkout release-24.3 branch (/tmp)
stackablectl demo install trino-iceberg --demo-file demos/demos-v2.yaml --stack-file stacks/stacks-v2.yaml
# FAILED: docker.stackable.tech/stackable/opa:0.66.0-stackable24.3.0 fails to pull
# Have to edit the stack/demo refs to not use main.
# upgrade postgres chart
helm upgrade postgresql-hive-iceberg bitnami/postgresql --version 15.5.16
helm upgrade minio minio/minio --version 5.2.0
# uninstall operators
stackablectl release uninstall 24.3
# update crds
kubectl replace -f https://raw.githubusercontent.com/stackabletech/commons-operator/release-24.7/deploy/helm/commons-operator/crds/crds.yaml
kubectl create -f https://raw.githubusercontent.com/stackabletech/listener-operator/release-24.7/deploy/helm/listener-operator/crds/crds.yaml
kubectl replace -f https://raw.githubusercontent.com/stackabletech/secret-operator/release-24.7/deploy/helm/secret-operator/crds/crds.yaml
kubectl replace -f https://raw.githubusercontent.com/stackabletech/hive-operator/release-24.7/deploy/helm/hive-operator/crds/crds.yaml
kubectl replace -f https://raw.githubusercontent.com/stackabletech/trino-operator/release-24.7/deploy/helm/trino-operator/crds/crds.yaml
kubectl replace -f https://raw.githubusercontent.com/stackabletech/opa-operator/release-24.7/deploy/helm/opa-operator/crds/crds.yaml
# install 24.7 version of operators
stackablectl demo install trino-iceberg # if changes are needed: --stack-file stacks/stacks-v2.yaml
# If changes are needed, checkout a branch for fixes
git checkout main
git pull
git checkout -b fix/release-24.7-trino-iceberg
stackablectl demo install trino-iceberg --demo-file=demos/demos-v2.yaml --stack-file stacks/stacks-v2.yaml
# If the fixes are needed in main too, cherry pick the relevant ones
...Other errorsDuring the 24.3 install, I got errors (slack thread): Trying with: diff --git a/stacks/trino-iceberg/trino.yaml b/stacks/trino-iceberg/trino.yaml
index e9c3f08..f7afdac 100644
--- a/stacks/trino-iceberg/trino.yaml
+++ b/stacks/trino-iceberg/trino.yaml
@@ -103,10 +103,7 @@ spec:
productVersion: 0.57.0
servers:
roleGroups:
- default:
- selector:
- matchLabels:
- kubernetes.io/os: linux
+ default: {}
---
apiVersion: v1
kind: ConfigMap
This looks like a leftover from the 24.3 release: See stackabletech/operator-rs#652 (thanks @sbernauer) ⚠ |
|
🟢 spark-k8s-anomaly-detection-taxi-data works with #67 |
|
🟢 jupyterhub-pyspark-hdfs-anomaly-detection-taxi-data Gets stuck on starting the Edit Malte: Could not reproduce, works as expected (there was a change from hadoop 3.3.6 to 3.3.4, which maybe made the difference?) |
|
🟢 trino-taxi-data works with #67 |
|
🟢 data-lakehouse-iceberg-trino-spark During install:
During upgrade:
After upgrade:
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Description
For each demo: test the upgrading process from 24.3 to 24.7 release and document necessary changes for upgrading if necessary. Also check the steps in the demo documentation to ensure the proper functionality of the demo with the 24.7 release.
PR for changes
Tasks
The text was updated successfully, but these errors were encountered: