docs: upgrade 0.8.5 (#3741)

CHANGELOG.md

@@ -1,5 +1,38 @@
 # Changelog
 
+## [0.8.5] - 2024-02-27
+
+### Features
+- Support Iceberg as an offline storage (#3737 @vagetablechicken)
+- Support `UNION ALL` statement (#3590 #3653 @aceforeverd)
+- Support `SELECT ... INTO OUTFILE` to OpenMLDB online tables (#3616 @tobegit3hub)
+- Support `LAST JOIN` and `WINDOW` without `ORDER BY` in offline mode (#3619 @aceforeverd)
+- Support `CREATE/ALTER/DROP USER` statement (#3678 #3745 #3747 @dl239, #3744 @tobegit3hub)
+- Support specifying Spark configurations in the SDK (#3613 @tobegit3hub)
+- `INSERT`returns failure if the server-side memory usage exceeds the specified limit (#3631 @dl239)
+- Add a new interfact for SQLs to DAG (#3630 @aceforeverd)
+- If the deployed SQL contains the `LEFT JOIN`, the indexs will be created automatically. (#3667 @aceforeverd)
+- Support automatic deletion of logs (#3704 #3736 #3706 @dl239)
+- Support `absandlat/absorlat` TTL type for disktable (#3716 @dl239)
+- Optimize error messages for insert failures (#3725 @vagetablechicken)
+- Improve the documents (#3617 #3519 #3690 #3699 @vagetablechicken, #3612 @dl239, #3609 #3672 #3687 @aceforeverd, #3649 #3570 #3569 @TanZiYen @Elliezza, #3665 @DrDub, #3585 #3584 #3579 #3578 #3574 #3573 #3552 #3539 #3488 #3477 #3475 #3586 #3470 #3474 #3568 #3583 #3564 #3764 @TanZiYen, #3688 #3697 #3753 #3721 #3731 #3739 #3754 #3720 #3756 #3762 #3752 #3757 #3719 @Elliezza, #3075 @Elliezza @tobegit3hub, #3710 @tobegit3hub)
+- Other minor features (#3623 #3636 @aceforeverd, #3651 @tobegit3hub, #3641 #3692 @vagetablechicken, #3582 #3702 @dl239, #3674 @lqy222)
+
+### Bug Fixes
+- Executing offline tasks will consume an excessive number of ZooKeeper connections (#3642 @dl239)
+- There is no automatic reconnection after ZooKeeper disconnection in SDK. (#3656 #3668 @vagetablechicken)
+- The `FlexibleRowBuilder` will throw a `NullPointerException` if set with a null value (#3649 @dl239)
+- If the length of strings in the imported data exceeds 255, it may throw a `BufferOverflowException`. (#3729 @ljwh)
+- If a table contains a large amount of data, querying the data may still be possible after executing `TRUNCATE` (#3677 @dl239)
+- After deleting data, it can still be retrieved from other indexes (#3693 @dl239)
+- Delete dirty data when insertion fails (#3681 @dl239)
+- When there are no tables, getting databases using `GetAllDbs` fails. (#3742 @vagetablechicken)
+- Adding a deleted index fails if the index name is different from the previous name (#3635 @dl239)
+- Other minor bug fixes (#3638 #3654 #3717 #3726 #3743 @vagetablechicken, #3607 #3775 @dl239, #3640 @tobegit3hub, #3686 #3735 #3738 #3740 @aceforeverd, #3759 @yangwucheng)
+
+### Code Refactoring
+#3666 @vagetablechicken
+
 ## [0.8.4] - 2023-11-17
 
 ### Features

demo/predict-taxi-trip-duration/README.md

@@ -28,7 +28,7 @@ w2 as (PARTITION BY passenger_count ORDER BY pickup_datetime ROWS_RANGE BETWEEN
 
 **Start docker**
 ```
-docker run -it 4pdosc/openmldb:0.8.4 bash
+docker run -it 4pdosc/openmldb:0.8.5 bash
 ```
 **Initialize environment**
 ```bash
@@ -138,7 +138,7 @@ python3 predict.py
 **Start docker**
 
 ```bash
-docker run -it 4pdosc/openmldb:0.8.4 bash
+docker run -it 4pdosc/openmldb:0.8.5 bash
 ```
 **Initialize environment**
 

demo/talkingdata-adtracking-fraud-detection/README.md

@@ -15,7 +15,7 @@ We recommend you to use docker to run the demo. OpenMLDB and dependencies have b
 **Start docker**
 
 ```
-docker run -it 4pdosc/openmldb:0.8.4 bash
+docker run -it 4pdosc/openmldb:0.8.5 bash
 ```
 
 #### Run locally

docs/en/deploy/compile.md

@@ -5,7 +5,7 @@
 This section describes the steps to compile and use OpenMLDB inside its official docker image [hybridsql](https://hub.docker.com/r/4pdosc/hybridsql), mainly for quick start and development purposes in the docker container.
 The docker image has packed the required tools and dependencies, so there is no need to set them up separately. To compile without the official docker image, refer to the section [Detailed Instructions for Build](#detailed-instructions-for-build) below.
 
-Keep in mind that you should always use the same version of both compile image and [OpenMLDB version](https://github.com/4paradigm/OpenMLDB/releases). This section demonstrates compiling for [OpenMLDB v0.8.4](https://github.com/4paradigm/OpenMLDB/releases/tag/v0.8.4) under `hybridsql:0.8.4` ，If you prefer to compile on the latest code in `main` branch, pull `hybridsql:latest` image instead.
+Keep in mind that you should always use the same version of both compile image and [OpenMLDB version](https://github.com/4paradigm/OpenMLDB/releases). This section demonstrates compiling for [OpenMLDB v0.8.5](https://github.com/4paradigm/OpenMLDB/releases/tag/v0.8.5) under `hybridsql:0.8.5` ，If you prefer to compile on the latest code in `main` branch, pull `hybridsql:latest` image instead.
 
 1. Pull the docker image
 
@@ -19,11 +19,11 @@ Keep in mind that you should always use the same version of both compile image a
    docker run -it 4pdosc/hybridsql:0.8 bash
    ```
 
-3. Download the OpenMLDB source code inside the docker container, and set the branch into v0.8.4
+3. Download the OpenMLDB source code inside the docker container, and set the branch into v0.8.5
 
    ```bash
    cd ~
-   git clone -b v0.8.4 https://github.com/4paradigm/OpenMLDB.git
+   git clone -b v0.8.5 https://github.com/4paradigm/OpenMLDB.git
    ```
 
 4. Compile OpenMLDB
@@ -150,7 +150,7 @@ The built jar packages are in the `target` path of each submodule. If you want t
 1. Downloading the pre-built OpenMLDB Spark distribution:
 
 ```bash
-wget https://github.com/4paradigm/spark/releases/download/v3.2.1-openmldb0.8.4/spark-3.2.1-bin-openmldbspark.tgz
+wget https://github.com/4paradigm/spark/releases/download/v3.2.1-openmldb0.8.5/spark-3.2.1-bin-openmldbspark.tgz
 ```
 
 Alternatively, you can also download the source code and compile from scratch:
@@ -209,7 +209,7 @@ After forking the OpenMLDB repository, you can trigger the `Other OS Build` work
 
 - Do not change the `Use workflow from` setting to a specific tag; it can be another branch.
 - Choose the desired `OS name`, which in this case is `centos6`.
-- If you are not compiling the main branch, provide the name of the branch, tag (e.g., v0.8.4), or SHA you want to compile in the `The branch, tag, or SHA to checkout, otherwise use the branch` field.
+- If you are not compiling the main branch, provide the name of the branch, tag (e.g., v0.8.5), or SHA you want to compile in the `The branch, tag, or SHA to checkout, otherwise use the branch` field.
 - The compilation output will be accessible in "runs", as shown in an example [here](https://github.com/4paradigm/OpenMLDB/actions/runs/6044951902).
   - The workflow will definitely produce the OpenMLDB binary file.
   - If you don't need the Java or Python SDK, you can configure `java sdk enable` or `python sdk enable` to be "OFF" to save compilation time.

docs/en/deploy/install_deploy.md

@@ -52,17 +52,17 @@ If your operating system is not mentioned above or if you want to compile from s
 
 ### Linux Platform Compatibility Pre-test
 
-Due to the variations among Linux platforms, the distribution package may not be entirely compatible with your machine. Therefore, it's recommended to conduct a preliminary compatibility test. Download the pre-compiled package `openmldb-0.8.4-linux.tar.gz`, and execute:
+Due to the variations among Linux platforms, the distribution package may not be entirely compatible with your machine. Therefore, it's recommended to conduct a preliminary compatibility test. Download the pre-compiled package `openmldb-0.8.5-linux.tar.gz`, and execute:
 
 ```
-tar -zxvf openmldb-0.8.4-linux.tar.gz
-./openmldb-0.8.4-linux/bin/openmldb --version
+tar -zxvf openmldb-0.8.5-linux.tar.gz
+./openmldb-0.8.5-linux/bin/openmldb --version
 ```
 
 The result should display the version number of the program, as shown below:
 
 ```
-openmldb version 0.8.4-xxxx
+openmldb version 0.8.5-xxxx
 Debug build (NDEBUG not #defined)
 ```
 
@@ -177,9 +177,9 @@ DataCollector and SyncTool currently do not support one-click deployment. Please
 ### Download OpenMLDB
 
 ```
-wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.4/openmldb-0.8.4-linux.tar.gz
-tar -zxvf openmldb-0.8.4-linux.tar.gz
-cd openmldb-0.8.4-linux
+wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.5/openmldb-0.8.5-linux.tar.gz
+tar -zxvf openmldb-0.8.5-linux.tar.gz
+cd openmldb-0.8.5-linux
 ```
 
 ### Environment Configuration
@@ -188,7 +188,7 @@ The environment variables are defined in `conf/openmldb-env.sh`, as shown in the
 
 | Environment Variable              | Default Value                                           | Note                                                         |
 | --------------------------------- | ------------------------------------------------------- | ------------------------------------------------------------ |
-| OPENMLDB_VERSION                  | 0.8.4                                                   | OpenMLDB version                                             |
+| OPENMLDB_VERSION                  | 0.8.5                                                   | OpenMLDB version                                             |
 | OPENMLDB_MODE                     | standalone                                              | standalone or cluster                                        |
 | OPENMLDB_HOME                     | root directory of the release folder                    | openmldb root directory                                      |
 | SPARK_HOME                        | $OPENMLDB_HOME/spark                                    | openmldb spark root directory，If the directory does not exist,  it will be downloaded automatically.|
@@ -361,10 +361,10 @@ Note that at least two TabletServer need to be deployed, otherwise errors may oc
 **1. Download the OpenMLDB deployment package**
 
 ```
-wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.4/openmldb-0.8.4-linux.tar.gz
-tar -zxvf openmldb-0.8.4-linux.tar.gz
-mv openmldb-0.8.4-linux openmldb-tablet-0.8.4
-cd openmldb-tablet-0.8.4
+wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.5/openmldb-0.8.5-linux.tar.gz
+tar -zxvf openmldb-0.8.5-linux.tar.gz
+mv openmldb-0.8.5-linux openmldb-tablet-0.8.5
+cd openmldb-tablet-0.8.5
 ```
 
 **2. Modify the configuration file `conf/tablet.flags`**
@@ -427,12 +427,12 @@ For clustered versions, the number of TabletServers must be 2 or more. If there'
 
 To start the next TabletServer on a different machine, simply repeat the aforementioned steps on that machine. If starting the next TabletServer on the same machine, ensure it's in a different directory, and do not reuse a directory where the TabletServer is already running.
 
-For instance, you can decompress the package again (avoid using a directory where TabletServer is already running, as files generated after startup may be affected), and name the directory `openmldb-tablet-0.8.4-2`.
+For instance, you can decompress the package again (avoid using a directory where TabletServer is already running, as files generated after startup may be affected), and name the directory `openmldb-tablet-0.8.5-2`.
 
 ```
-tar -zxvf openmldb-0.8.4-linux.tar.gz
-mv openmldb-0.8.4-linux openmldb-tablet-0.8.4-2
-cd openmldb-tablet-0.8.4-2
+tar -zxvf openmldb-0.8.5-linux.tar.gz
+mv openmldb-0.8.5-linux openmldb-tablet-0.8.5-2
+cd openmldb-tablet-0.8.5-2
 ```
 
 Modify the configuration again and start the TabletServer. Note that if all TabletServers are on the same machine, use different port numbers to avoid "Fail to listen" error in the log (`logs/tablet.WARNING`).
@@ -450,10 +450,10 @@ Please ensure that all TabletServer have been successfully started before deploy
 **1. Download the OpenMLDB deployment package**
 
 ````
-wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.4/openmldb-0.8.4-linux.tar.gz
-tar -zxvf openmldb-0.8.4-linux.tar.gz
-mv openmldb-0.8.4-linux openmldb-ns-0.8.4
-cd openmldb-ns-0.8.4
+wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.5/openmldb-0.8.5-linux.tar.gz
+tar -zxvf openmldb-0.8.5-linux.tar.gz
+mv openmldb-0.8.5-linux openmldb-ns-0.8.5
+cd openmldb-ns-0.8.5
 ````
 
 **2.  Modify the configuration file conf/nameserver.flags**
@@ -498,12 +498,12 @@ You can have only one NameServer, but if you need high availability, you can dep
 
 To start the next NameServer on another machine, simply repeat the above steps on that machine. If starting the next NameServer on the same machine, ensure it's in a different directory and do not reuse the directory where NameServer has already been started.
 
-For instance, you can decompress the package again (avoid using the directory where NameServer is already running, as files generated after startup may be affected) and name the directory `openmldb-ns-0.8.4-2`.
+For instance, you can decompress the package again (avoid using the directory where NameServer is already running, as files generated after startup may be affected) and name the directory `openmldb-ns-0.8.5-2`.
 
 ```
-tar -zxvf openmldb-0.8.4-linux.tar.gz
-mv openmldb-0.8.4-linux openmldb-ns-0.8.4-2
-cd openmldb-ns-0.8.4-2
+tar -zxvf openmldb-0.8.5-linux.tar.gz
+mv openmldb-0.8.5-linux openmldb-ns-0.8.5-2
+cd openmldb-ns-0.8.5-2
 ```
 
 Then modify the configuration and start.
@@ -544,10 +544,10 @@ Before running APIServer, ensure that the TabletServer and NameServer processes
 **1. Download the OpenMLDB deployment package**
 
 ```
-wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.4/openmldb-0.8.4-linux.tar.gz
-tar -zxvf openmldb-0.8.4-linux.tar.gz
-mv openmldb-0.8.4-linux openmldb-apiserver-0.8.4
-cd openmldb-apiserver-0.8.4
+wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.5/openmldb-0.8.5-linux.tar.gz
+tar -zxvf openmldb-0.8.5-linux.tar.gz
+mv openmldb-0.8.5-linux openmldb-apiserver-0.8.5
+cd openmldb-apiserver-0.8.5
 ```
 
 **2. Modify the configuration file conf/apiserver.flags**
@@ -609,18 +609,18 @@ You can have only one TaskManager, but if you require high availability, you can
 Spark distribution：
 
 ```shell
-wget https://github.com/4paradigm/spark/releases/download/v3.2.1-openmldb0.8.4/spark-3.2.1-bin-openmldbspark.tgz
-# Image address (China)：https://www.openmldb.com/download/v0.8.4/spark-3.2.1-bin-openmldbspark.tgz
+wget https://github.com/4paradigm/spark/releases/download/v3.2.1-openmldb0.8.5/spark-3.2.1-bin-openmldbspark.tgz
+# Image address (China)：https://www.openmldb.com/download/v0.8.5/spark-3.2.1-bin-openmldbspark.tgz
 tar -zxvf spark-3.2.1-bin-openmldbspark.tgz 
 export SPARK_HOME=`pwd`/spark-3.2.1-bin-openmldbspark/
 ```
 
 OpenMLDB deployment package：
 ```
-wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.4/openmldb-0.8.4-linux.tar.gz
-tar -zxvf openmldb-0.8.4-linux.tar.gz
-mv openmldb-0.8.4-linux openmldb-taskmanager-0.8.4
-cd openmldb-taskmanager-0.8.4
+wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.5/openmldb-0.8.5-linux.tar.gz
+tar -zxvf openmldb-0.8.5-linux.tar.gz
+mv openmldb-0.8.5-linux openmldb-taskmanager-0.8.5
+cd openmldb-taskmanager-0.8.5
 ```
 
 **2. Modify the configuration file conf/taskmanager.properties**

docs/en/integration/deploy_integration/OpenMLDB_Byzer_taxi.md

@@ -13,7 +13,7 @@ This article demonstrates how to use [OpenMLDB](https://github.com/4paradigm/Ope
 
 The command is as follows:
 ```
-docker run --network host -dit --name openmldb -v /mlsql/admin/:/byzermnt 4pdosc/openmldb:0.8.4 bash
+docker run --network host -dit --name openmldb -v /mlsql/admin/:/byzermnt 4pdosc/openmldb:0.8.5 bash
 docker exec -it openmldb bash
 /work/init.sh
 echo "create database db1;" | /work/openmldb/bin/openmldb --zk_cluster=127.0.0.1:2181 --zk_root_path=/openmldb --role=sql_client

docs/en/integration/deploy_integration/airflow_provider_demo.md

@@ -36,7 +36,7 @@ For smooth function, we recommend starting OpenMLDB using the docker image and i
 Since Airflow Web requires an external port for login, the container's port must be exposed. Then map the downloaded file from the previous step to the `/work/airflow/dags` directory. This step is crucial for Airflow to load the DAGs from this folder correctly.
 
 ```
-docker run -p 8080:8080 -v `pwd`/airflow_demo_files:/work/airflow_demo_files -it 4pdosc/openmldb:0.8.4 bash
+docker run -p 8080:8080 -v `pwd`/airflow_demo_files:/work/airflow_demo_files -it 4pdosc/openmldb:0.8.5 bash
 ```
 
 #### Download and Install Airflow and Airflow OpenMLDB Provider

docs/en/integration/deploy_integration/dolphinscheduler_task_demo.md

@@ -31,7 +31,7 @@ In addition to SQL execution in OpenMLDB, real-time prediction also requires mod
 
 The test can be executed on macOS or Linux, and we recommend running this demo within the provided OpenMLDB docker image. In this setup, both OpenMLDB and DolphinScheduler will be launched inside the container, with the port of DolphinScheduler exposed.
 ```
-docker run -it -p 12345:12345 4pdosc/openmldb:0.8.4 bash
+docker run -it -p 12345:12345 4pdosc/openmldb:0.8.5 bash
 ```
 ```{attention}
 For proper configuration of DolphinScheduler, the tenant should be set up as a user of the operating system, and this user must have sudo permissions. It is advised to download and initiate DolphinScheduler within the OpenMLDB container. Otherwise, please ensure that the user has sudo permissions.

docs/en/integration/online_datasources/kafka_connector_demo.md

@@ -23,7 +23,7 @@ This article will use Docker mode to start OpenMLDB, so there is no need to down
 We recommend that you bind all three downloaded file packages to the `kafka` directory. Alternatively, you can download the file packages after starting the container. For our demonstration, we assume that the file packages are all in the `/work/kafka` directory.
 
 ```
-docker run -it -v `pwd`:/work/kafka 4pdosc/openmldb:0.8.4 bash
+docker run -it -v `pwd`:/work/kafka 4pdosc/openmldb:0.8.5 bash
 ```
 
 ### Note

docs/en/integration/online_datasources/pulsar_connector_demo.md

@@ -43,7 +43,7 @@ Currently, only the OpenMLDB cluster version can act as the receiver of sinks, a
 We recommend using the 'host network' mode to run Docker and bind the file directory 'files' where the SQL script is located.
 
 ```
-docker run -dit --network host -v `pwd`/files:/work/pulsar_files --name openmldb 4pdosc/openmldb:0.8.4 bash
+docker run -dit --network host -v `pwd`/files:/work/pulsar_files --name openmldb 4pdosc/openmldb:0.8.5 bash
 docker exec -it openmldb bash
 ```
 

docs/en/quickstart/openmldb_quickstart.md

@@ -18,7 +18,7 @@ This sample program is developed and deployed based on OpenMLDB CLI, so you need
 Execute the following command in the command line to pull the OpenMLDB image and start the Docker container:
 
 ```bash
-docker run -it 4pdosc/openmldb:0.8.4 bash
+docker run -it 4pdosc/openmldb:0.8.5 bash
 ```
 
 ``` {note}