Skip to content

Releases: snowflakedb/snowflake-kafka-connector

0.5.2

29 Oct 20:16
Compare
Choose a tag to compare
  • New Feature:
    • Topic2Table map validation
  • Fix Bug:
    • BouncyCastle class not found issue
    • Wrong file extension name of broken record
    • Null Pointer Exception issue

0.5.1

07 Oct 20:34
Compare
Choose a tag to compare
  • Fix issues:
    • can't read topic2table map
    • wrong format when process union types of AVRO record
  • New feature:
    • Support compatible SF tables

0.5.0

27 Sep 21:55
Compare
Choose a tag to compare
  • Support topic regex
  • Connector will not drop Table/Stage/Pipe anymore.
  • New Topic to Table name mapping rule:
    1. if topic2table map contains topic name, use corresponding table name
    2. or, if topic name doesn't contain illegal characters, use topic name to be table name
    3. or, replace all illegal character by "_", and append "_" and Math.abs(<topic name>.hashCode()) to the end of table name
  • Fix bug:
    • Can't decrypt RSA private key generated by OpenSSL 1.1.1
    • Key doesn't show in Meta data
    • Can't handle Null Value

0.4.0

04 Sep 22:17
Compare
Choose a tag to compare
  • Upgrade Snowflake JDBC to 3.9.1 (OCSP)
  • RSA private key
    • Support Encrypted RSA private key
    • Support original private key format (no need remove header/footer and line breaks)
  • Include more record details in record_metadata column
    • Header
    • Key
    • Timestamp
    • Schema ID (if using Schema Registry)
  • Handle broken input record: Now, if the input record is not valid JSON/AVRO data, it will be sent to table stage directly without crashing connector task.
  • Add connector version checker : connector will automatically check the latest version number from Maven repo, and warn user if an update is available
  • Make the Flush, Purge and Status Check processes to be asynchronous

0.3.2

09 Jul 18:46
Compare
Choose a tag to compare

Support Schema Registry authentication method "USER_INFO" in SnowflakeAvroConverter

0.3.1

30 Jun 22:47
Compare
Choose a tag to compare
  • upgrade Snowflake JDBC to 3.8.4
  • upgrade Snowflake Ingest SDK to 0.9.6
  • fix the error message for name validation
  • add JVM Proxy options
    • "jvm.proxy.host": proxy host
    • "jvm.proxy.port": proxy port