New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[QUESTION] How do I read Databricks Catalog tables (delta) with delta kernel? #3348

Open

jexp opened this issue Jul 9, 2024 · 0 comments

Labels

jexp commented Jul 9, 2024

It seems that all the examples are using local delta-files.

How would I provide the correct auth (or PAT) and table locations to delta-kernel to read?
I guess somehow with the HadoopConfiguration?

Tried to start with the BaseTableReader examples, but didn't get far.

And passing an s3 location for the table path yielded just an error:

Exception in thread "main" java.lang.RuntimeException: org.apache.hadoop.fs.UnsupportedFileSystemException: No FileSystem for scheme "s3"
	at io.delta.kernel.internal.TableImpl.forPath(TableImpl.java:33)

The text was updated successfully, but these errors were encountered:

jexp added the bug label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment