Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kusto fails to process TSVs with escaped tabs #28

Open
yogilad opened this issue Sep 8, 2023 · 0 comments
Open

Kusto fails to process TSVs with escaped tabs #28

yogilad opened this issue Sep 8, 2023 · 0 comments
Labels
bug Something isn't working

Comments

@yogilad
Copy link
Owner

yogilad commented Sep 8, 2023

Kusto does not support Windows's quotation escaped TSV format, so Tabular data with escaped tabs causes an error about varying column numbers.

Options to fix - provide user with Clipboard Tabular-Data processing options:

  1. Default - as today - works for most users
  2. Convert TSV to CSV - CPU costly but has Unicode Support
  3. Get ASCII / LATIN1 ASCII - works best with English / Numeric data
  4. Get Code Page ASCII data - works for local machines (Was unable to figure this out yet)

Example code for converting Tabular data to Latin1CSV:

 var stream = Clipboard.GetData(DataFormats.CommaSeparatedValue) as MemoryStream;
 var bytes = stream.ToArray();
 var data = System.Text.ASCIIEncoding.Latin1.GetString(bytes);
@yogilad yogilad added the bug Something isn't working label Sep 8, 2023
@yogilad yogilad changed the title Kusto fails to process TSVs with escaped tabs due Kusto fails to process TSVs with escaped tabs Sep 16, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant