Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Recap can now convert BigQuery table schemas to Recap StructTypes. Some notes: 1. Nested types are supported (RECORD, STRUCT) 2. Repeated/ARRAYs are supported 3. JSON types are treated as STRING 4. STRING and BYTES have a max length of 65KiB by default For (4), I had a really hard time nailing down the exact max string size in BQ. [This](https://cloud.google.com/bigquery/docs/reference/standard-sql/data-types) page says they have a 2 byte header on strings/bytes, which I assume is to store the byte length. Thus I went with 65KiB. I'm also using [bigquery-emulator](https://github.com/goccy/bigquery-emulator) to test. I've only included integration tests. Closes #285
- Loading branch information