Skip to content

Commit

Permalink
u3e prototype for MySQL Metastore Installs.
Browse files Browse the repository at this point in the history
  • Loading branch information
@dstreev
dstreev committed Aug 10, 2023
1 parent 7db08ae commit 9728565
Show file tree
Hide file tree
Showing 21 changed files with 1,340 additions and 387 deletions.
49 changes: 29 additions & 20 deletions README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -4,32 +4,41 @@ This application has 3 sub-programs:

- [`sre`](./sre.md) is used to find potential 'Hive' performance issues caused by small files and excessive partitions.
- [`u3`](./u3.md) is used to review 'Hive 1/2' environments for Hive3 upgrade planning.
- **NEW** [`u3e`](./u3e.md) is used to 'execute' the upgrade scripts for Hive3 directly against the metastore database. Run against the metastore DB **AFTER** the upgrade to Hive 3.
- [`perf`](./perf.md) is used to check the throughput of a JDBC connection.

### [Trouble-Shooting](./troubleshooting.md)

## Supported Metastore DB's

| Sub-Program | Database | Version | Tested | Notes |
|:---|:---|:---|:---------------------------------|:---------------------------------------------------------------------------------------------------------------------------------|
| `u3` | MySql | 5.6 | Limited | Recommend upgrading 5.7. This is the lower MySql supported env for HDP |
| | | 5.7 | Yes | |
| | | 8.0 | No | Not supported by HDP |
| | MariaDb | 10.1 | No, but should work as 10.2 does | |
| | | 10.2 | Yes | |
| | Postgresql | 9.6 | No, but should work | |
| | | 10 | Yes | Field Tested, May still be a few rough edges |
| | | 11 | No, but should work at 10 does | |
| | Oracle | 12 | Yes | Field Tested, May still be a few rough edges |
| `sre` | MySql | 5.6 | Limited | Recommend upgrading 5.7. This is the lower MySql supported env for HDP |
| | | 5.7 | Partly | Some `sre` reports use CTE in the SQL, which isn't supported in this version. Those report will error, the other will run fine. |
| | | 8.0 | No | Not supported by HDP |
| | MariaDb | 10.1 | No, but should work as 10.2 does | |
| | | 10.2 | Yes | |
| | Postgresql | 9.6 | No, but should work | |
| | | 10 | Yes | Field Tested, May still be a few rough edges |
| | | 11 | No, but should work at 10 does | |
| | Oracle | 12 | Yes | Field Tested, May still be a few rough edges |

| Sub-Program | Database | Version | Tested | Notes |
|:------------|:----------------|:--------|:---------------------------------|:---------------------------------------------------------------------------------------------------------------------------------|
| `u3` | MySql | 5.6 | Limited | Recommend upgrading 5.7. This is the lower MySql supported env for HDP |
| | | 5.7 | Yes | |
| | | 8.0 | No | Not supported by HDP |
| | MariaDb | 10.1 | No, but should work as 10.2 does | |
| | | 10.2 | Yes | |
| | Postgresql | 9.6 | No, but should work | |
| | | 10 | Yes | Field Tested, May still be a few rough edges |
| | | 11 | No, but should work at 10 does | |
| | Oracle | 12 | Yes | Field Tested, May still be a few rough edges |
| `u3e` | MySql | 5.6 | Limited | Recommend upgrading 5.7. This is the lower MySql supported env for HDP |
| | | 5.7 | Yes | |
| | | 8.0 | No | Not supported by HDP |
| | MariaDb | 10.1 | No, but should work as 10.2 does | |
| | | 10.2 | Yes | |
| | Postgresql | * | NOT YET IMPLEMENTED | |
| | Oracle | * | NOT YET IMPLEMENTED | |
| `sre` | MySql | 5.6 | Limited | Recommend upgrading 5.7. This is the lower MySql supported env for HDP |
| | | 5.7 | Partly | Some `sre` reports use CTE in the SQL, which isn't supported in this version. Those report will error, the other will run fine. |
| | | 8.0 | No | Not supported by HDP |
| | MariaDb | 10.1 | No, but should work as 10.2 does | |
| | | 10.2 | Yes | |
| | Postgresql | 9.6 | No, but should work | |
| | | 10 | Yes | Field Tested, May still be a few rough edges |
| | | 11 | No, but should work at 10 does | |
| | Oracle | 12 | Yes | Field Tested, May still be a few rough edges |

Ensure you have the database appropriate driver in the `${HOME}/.hive-sre/aux_libs` directory.

Expand Down
Loading

0 comments on commit 9728565

Please sign in to comment.