You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Convert to parquet, and try to load with something like:
LOAD LABEL logs.poc1 ( DATA INFILE("file:///poc.parquet") INTO TABLE test FORMAT AS "parquet" ( a, b)) WITH BROKER allin1broker;
LOAD LABEL logs.poc2 ( DATA INFILE("file:///poc.parquet") INTO TABLE test_gen FORMAT AS "parquet" ( a, b)) WITH BROKER allin1broker;
The generated parquet when inspected with parquet-tool show this (also attached, need to rename): poc.parquet.txt
the first load to table test without generated column succeed, but the later with the c generated column field failed with error:
type:ETL_RUN_FAIL; msg:Cannot cast '<slot 4>' from VARCHAR to MAP<VARCHAR(65533),VARCHAR(65533)>
StarRocks version (Required)
3.3.1-2b87854 (all in one docker)
BTW its seems unclear in the docs on how to streamload a csv to table with MAP field. I tried several format but it either reports errors or the map isn't correctly parsed. One way I find is using str_to_map in the columns header but that format seems to be hard to convert to when my value string contains many symbols like ':', '|' etc, not exactly sure how to escape.
The text was updated successfully, but these errors were encountered:
Frefreak
changed the title
error when using parquet broker load to table with generated field from MAP
error when using parquet broker load to table with generated column from MAP
Aug 13, 2024
Steps to reproduce the behavior (Required)
with an arbitrary csv like this:
Convert to parquet, and try to load with something like:
The generated parquet when inspected with parquet-tool show this (also attached, need to rename):
poc.parquet.txt
Expected behavior (Required)
both load succeed
Real behavior (Required)
the first load to table test without generated column succeed, but the later with the c generated column field failed with error:
StarRocks version (Required)
3.3.1-2b87854 (all in one docker)
BTW its seems unclear in the docs on how to streamload a csv to table with MAP field. I tried several format but it either reports errors or the map isn't correctly parsed. One way I find is using
str_to_map
in the columns header but that format seems to be hard to convert to when my value string contains many symbols like ':', '|' etc, not exactly sure how to escape.The text was updated successfully, but these errors were encountered: