Skip to content

Commit

Permalink
[release] release catalog-migrator-0.2.0
Browse files Browse the repository at this point in the history
  • Loading branch information
Nessie Release Workflow [bot] committed Apr 18, 2023
1 parent 1c19b91 commit 4cfd50e
Show file tree
Hide file tree
Showing 2 changed files with 16 additions and 16 deletions.
30 changes: 15 additions & 15 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ Need to have Java installed in your machine(JDK11 is recommended) to use this CL

Below is the CLI syntax:
```
$ java -jar iceberg-catalog-migrator-cli-0.1.0.jar -h
$ java -jar iceberg-catalog-migrator-cli-0.2.0.jar -h
Usage: iceberg-catalog-migrator [-hV] [COMMAND]
-h, --help Show this help message and exit.
-V, --version Print version information and exit.
Expand All @@ -37,7 +37,7 @@ Commands:
```

```
$ java -jar iceberg-catalog-migrator-cli-0.1.0.jar migrate -h
$ java -jar iceberg-catalog-migrator-cli-0.2.0.jar migrate -h
Usage: iceberg-catalog-migrator migrate [-hV] [--disable-safety-prompts] [--dry-run] [--stacktrace] [--output-dir=<outputDirPath>]
(--source-catalog-type=<type> --source-catalog-properties=<String=String>[,<String=String>...]
[--source-catalog-properties=<String=String>[,<String=String>...]]...
Expand Down Expand Up @@ -113,7 +113,7 @@ Note: Options for register command is exactly same as migrate command.
# Sample Inputs
## Bulk migrating all the tables from Hadoop catalog to Nessie catalog (main branch)
```shell
java -jar iceberg-catalog-migrator-cli-0.1.0.jar migrate \
java -jar iceberg-catalog-migrator-cli-0.2.0.jar migrate \
--source-catalog-type HADOOP \
--source-catalog-properties warehouse=/tmp/warehouse,type=hadoop \
--target-catalog-type NESSIE \
Expand All @@ -130,7 +130,7 @@ export AWS_S3_ENDPOINT=xxxxxxx
```

```shell
java -jar iceberg-catalog-migrator-cli-0.1.0.jar register \
java -jar iceberg-catalog-migrator-cli-0.2.0.jar register \
--source-catalog-type HADOOP \
--source-catalog-properties warehouse=/tmp/warehouse,type=hadoop \
--target-catalog-type NESSIE \
Expand All @@ -147,7 +147,7 @@ export AWS_S3_ENDPOINT=xxxxxxx
```

```shell
java -jar iceberg-catalog-migrator-cli-0.1.0.jar migrate \
java -jar iceberg-catalog-migrator-cli-0.2.0.jar migrate \
--source-catalog-type NESSIE \
--source-catalog-properties uri=https://nessie.test1.dremio.site/v1/repositories/8158e68a-5046-42c6-a7e4-c920d9ae2475,ref=main,warehouse=/tmp/warehouse,authentication.type=BEARER,authentication.token=$PAT \
--target-catalog-type HADOOP \
Expand All @@ -156,7 +156,7 @@ java -jar iceberg-catalog-migrator-cli-0.1.0.jar migrate \

## Migrate all tables from GLUE catalog to Arctic catalog (main branch)
```shell
java -jar iceberg-catalog-migrator-cli-0.1.0.jar migrate \
java -jar iceberg-catalog-migrator-cli-0.2.0.jar migrate \
--source-catalog-type GLUE \
--source-catalog-properties warehouse=s3a://some-bucket/wh/,io-impl=org.apache.iceberg.aws.s3.S3FileIO \
--target-catalog-type NESSIE \
Expand All @@ -165,7 +165,7 @@ java -jar iceberg-catalog-migrator-cli-0.1.0.jar migrate \

## Migrate all tables from HIVE catalog to Arctic catalog (main branch)
```shell
java -jar iceberg-catalog-migrator-cli-0.1.0.jar migrate \
java -jar iceberg-catalog-migrator-cli-0.2.0.jar migrate \
--source-catalog-type HIVE \
--source-catalog-properties warehouse=s3a://some-bucket/wh/,io-impl=org.apache.iceberg.aws.s3.S3FileIO,uri=thrift://localhost:9083 \
--target-catalog-type NESSIE \
Expand All @@ -174,7 +174,7 @@ java -jar iceberg-catalog-migrator-cli-0.1.0.jar migrate \

## Migrate all tables from DYNAMODB catalog to Arctic catalog (main branch)
```shell
java -jar iceberg-catalog-migrator-cli-0.1.0.jar migrate \
java -jar iceberg-catalog-migrator-cli-0.2.0.jar migrate \
--source-catalog-type DYNAMODB \
--source-catalog-properties warehouse=s3a://some-bucket/wh/,io-impl=org.apache.iceberg.aws.s3.S3FileIO \
--target-catalog-type NESSIE \
Expand All @@ -183,7 +183,7 @@ java -jar iceberg-catalog-migrator-cli-0.1.0.jar migrate \

## Migrate all tables from JDBC catalog to Arctic catalog (main branch)
```shell
java -jar iceberg-catalog-migrator-cli-0.1.0.jar migrate \
java -jar iceberg-catalog-migrator-cli-0.2.0.jar migrate \
--source-catalog-type JDBC \
--source-catalog-properties warehouse=/tmp/warehouseJdbc,jdbc.user=root,jdbc.password=pass,uri=jdbc:mysql://localhost:3306/db1,name=catalogName \
--target-catalog-type NESSIE \
Expand All @@ -200,7 +200,7 @@ Users can use a new catalog by creating a fresh table to test the new catalog's

Sample input:
```shell
java -jar iceberg-catalog-migrator-cli-0.1.0.jar register \
java -jar iceberg-catalog-migrator-cli-0.2.0.jar register \
--source-catalog-type HADOOP \
--source-catalog-properties warehouse=/tmp/warehouse,type=hadoop \
--target-catalog-type NESSIE \
Expand All @@ -216,7 +216,7 @@ which can be used for actual migration using the `--identifiers-from-file` optio

Sample input:
```shell
java -jar iceberg-catalog-migrator-cli-0.1.0.jar migrate \
java -jar iceberg-catalog-migrator-cli-0.2.0.jar migrate \
--source-catalog-type HADOOP \
--source-catalog-properties warehouse=/tmp/warehouse,type=hadoop \
--target-catalog-type NESSIE \
Expand Down Expand Up @@ -268,7 +268,7 @@ and also log any table level failures, if present.

Sample input:
```shell
java -jar iceberg-catalog-migrator-cli-0.1.0.jar migrate \
java -jar iceberg-catalog-migrator-cli-0.2.0.jar migrate \
--source-catalog-type HADOOP \
--source-catalog-properties warehouse=/tmp/warehouse,type=hadoop \
--target-catalog-type NESSIE \
Expand Down Expand Up @@ -312,7 +312,7 @@ Users can provide the selective list of identifiers to migrate using any of thes

Sample input: (only migrate tables that starts with "foo.")
```shell
java -jar iceberg-catalog-migrator-cli-0.1.0.jar migrate \
java -jar iceberg-catalog-migrator-cli-0.2.0.jar migrate \
--source-catalog-type HADOOP \
--source-catalog-properties warehouse=/tmp/warehouse,type=hadoop \
--target-catalog-type NESSIE \
Expand All @@ -323,7 +323,7 @@ java -jar iceberg-catalog-migrator-cli-0.1.0.jar migrate \

Sample input: (migrate all tables in the file ids.txt where each entry is delimited by newline)
```shell
java -jar iceberg-catalog-migrator-cli-0.1.0.jar migrate \
java -jar iceberg-catalog-migrator-cli-0.2.0.jar migrate \
--source-catalog-type HADOOP \
--source-catalog-properties warehouse=/tmp/warehouse,type=hadoop \
--target-catalog-type NESSIE \
Expand All @@ -333,7 +333,7 @@ java -jar iceberg-catalog-migrator-cli-0.1.0.jar migrate \

Sample input: (migrate only two tables foo.tbl1, foo.tbl2)
```shell
java -jar iceberg-catalog-migrator-cli-0.1.0.jar migrate \
java -jar iceberg-catalog-migrator-cli-0.2.0.jar migrate \
--source-catalog-type HADOOP \
--source-catalog-properties warehouse=/tmp/warehouse,type=hadoop \
--target-catalog-type NESSIE \
Expand Down
2 changes: 1 addition & 1 deletion version.txt
Original file line number Diff line number Diff line change
@@ -1 +1 @@
0.1.1-SNAPSHOT
0.2.0

0 comments on commit 4cfd50e

Please sign in to comment.