Changelog

Untagged

1.6.0 (2021-12-01)

Features

teradata hashing implementation (#324) (b74e03e)

Bug Fixes

Include StringIO into teradata ibis compiler.py (#336) (1dba63b)
Issue348 casting (#349) (1560c7e)

Documentation

add local development nox docs (#342) (80d26c6)

1.5.0 (2021-10-19)

Features

added kerberos service name flag for Impala connections, fixed bug in row validation with YAML (#320) (351994c)
Track DVT GCS connections (#326) (b384b1f)

Bug Fixes

Issue323 row hash (#328) (1a03ad7)

Documentation

add new release process (#332) (6015127)
Added python install commands (#264) (0936d84)

1.4.0 (2021-09-30)

Features

add state manager client (#311) (e893ea5)
Allow user to specify a format for stdout (#242) (#293) (f0a9fa1)
Allow user to specify a format for stdout T2 (#242) (#296) (ec1af22)
cast aggregates (#306) (e3da4c3)
Issue262 impala connect (#281) (eaa052f)
logic to deploy dvt on Cloud Run (#280) (9076286)
promote 3.9 to main version (as it is in Cloudtops now for local testing) and add a small unit test for persoanl use (#292) (eb0f21a)
Refactor CLI to fit Command Pattern (#303) (f6d2b9d)
Updated Cloud Functions sample (#297) (923413d)

Bug Fixes

updated code so that BQ target schema would not set to None for FileSystem to BQ validations (#309) (5016d65)

1.3.2 (2021-06-29)

Documentation

add secrets logic to ci (#273) (3c21ee5)
Issue263 Installation doc updates (#270) (0328c0e)

1.3.1 (2021-06-28)

Documentation

clean setup (#272) (08d393b)
Update docs with examples (#261) (fd90096)

1.3.0 (2021-06-28)

Features

add table matching score as a param incase adjusted is needed (#267) (b02aed5)
CI/CD Release to PyPi via Cloud Build (#258) (0870fc7)

Bug Fixes

correct issues blocking impala and hive (#266) (5110d1f)

1.2.0 (2021-05-27)

Features

add data source for Cloud Spanner (#206) (c63f68e)
added an optional beta flag in CLI (#249) (e8e75de)
Added FileSystem connection type (#254) (be7824d)

Bug Fixes

Cli tools bug fix (#253) (b41e625)
Remove JSON arguments in CLI (#247) (5a309f7)
Update connections.md (#248) (9c1ae40)
Update Readme.md (#257) (c968024)

1.1.8

Adding and documenting find-tables CLI feature with schema filter
Correct filter errors caused by SQL Alchemy errors
Adding beta calculated fields logic

1.1.7

Adding tests to validate BIGNUMERIC BQ type behavior

1.1.6

Minor fix for Teradata client from breaking IBis changes

1.1.5

Add support for running raw queries against a connection
Upgraded Ibis to v1.4 with large client organizational and design changes
Added support for "use_no_lock_tables" Teradata config to optionally avoid table locking

1.1.4

Added an options to add key:value labels to validation runs
Oracle and SQL Alchemy now support RawSql filters
Add support for Cloud Functions in samples
Added schema information to result set

1.1.3

Release find-tables logic too help build table lists
Teradata client improvements
Remove rarely used dependencies into extras

1.1.2

Teradata numeric column and general bug fixes
Fix Ibis query compliation order causing cross join

1.1.1

Bug fixes to support case insensitivity
Allow null values to be handled in grouped columns
Oracle client improvements

1.1.0

Added Row validations for cell level validation with primary keys
Client support for Oracle, SQL Server, Postgres, and GCS files

1.0

Support for Column and GroupedColumn validations
Allow custom filter via YAML config
BigQuery result handlers supported
Client support for BigQuery, MySQL, and Teradata

0.1.1 (release date TBD)

Bug Fixes

update BigQuery dependencies to fix group-by results handler #64

Documentation

remove references to unsupported validations from README #63
includes wheel file installation steps in README #57
add filters and data sources to README #56

Internal / Testing Changes

move ibis addons to third-party directory #61

0.1.0 (2020-07-16)

Initial alpha release.

Features

Add data-validation CLI, which can run from CLI arguments, store a configuration YAML file, or run from a run-config YAML file.
Add support for querying Teradata.
Add support for querying BigQuery.
Write report output to BigQuery.

Dependencies

To use Teradata support, you must manually install the teradatasql PIP package.

Documentation

See the README.md file for getting started instructions.