Skip to content

Latest commit

 

History

History
39 lines (27 loc) · 1.99 KB

ingest_issues.md

File metadata and controls

39 lines (27 loc) · 1.99 KB

Ingest issue

List of extra situations/exceptions during feature set ingest with relation to the source, target, setting for InferOption.default() or InferOption.Null.

BTW: in case of InferOption.default(), the data types are defined based on discovery during the preview (it is operation before the own ingest).

Experience from these test cases:

  • TS202-205
  • TS303-305
  • TS404-405

ParquetTarget

Target Source InferOptions.default() InferOptions.Null
Parquet TSx02: DataFrame Ok Ok
Parquet TSx03: CSV Ok Ok
Parquet TSx04: Parquet ArrowTypeError: ("Expected bytes, got a 'datetime.date' object", 'Conversion failed for column party-establishment with type object') Ok
Parquet TSx05: SQL(MySQL) Ok Ok

RedisTarget - TBD.

Target Source InferOptions.default() InferOptions.Null
Redis TSx02: DataFrame ?? ??
Redis TSx03: CSV ?? ??
Redis TSx04: Parquet Ok ??
Redis TSx05: SQL(MySQL) ?? ??

SQLTarget (MySQL) - TBD.

SQLTarget (Postgres) - TBD.

CSVTarget - TBD.

KafkaTarget - TBD.