-
Notifications
You must be signed in to change notification settings - Fork 80
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
JSON configuration and Jackson Streaming Object Processor #5225
Merged
Commits on Apr 11, 2024
-
JSON configuration and Processor
This PR adds a declarative JSON configuration object that allows users to specify the schema of a JSON message. It is meant to have good out-of-the-box defaults, while still allowing power users to modify some of the finer parsing details (should this int field be parseable from a string? should null values be allowed? what if a field is missing? etc). The JSON configuration layer is not tied to any specific implementation; it is introspectible, and could have alternative implementations with other parsing backends. (I could imagine a DHE use-case where they do code-generation based on the JSON configuration, somewhat like the DHE avro ObjectProcessor code generator.) Out of the box, there's an ObjectProcessor implementation based on the Jackson streaming APIs; that is, the data flows from byte[]s (or InputStream, relevant for very-large-files) to the output WritableChunks without the need for the intermediating Jackson databind layer (TreeNode). This saves a large layer of allocation that our current kafka json_spec layer relies upon. The ObjectProcessor layer means that this can be used in other places that expose ObjectProcessor layers and want 1-to-1 record-to-row (currently, Kafka). Part of deephaven#5222
Configuration menu - View commit details
-
Copy full SHA for 1320749 - Browse repository at this point
Copy the full SHA 1320749View commit details -
Configuration menu - View commit details
-
Copy full SHA for bb1d02e - Browse repository at this point
Copy the full SHA bb1d02eView commit details
Commits on Apr 15, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 5c7dde9 - Browse repository at this point
Copy the full SHA 5c7dde9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 44f4bc9 - Browse repository at this point
Copy the full SHA 44f4bc9View commit details -
Configuration menu - View commit details
-
Copy full SHA for c567c21 - Browse repository at this point
Copy the full SHA c567c21View commit details -
Configuration menu - View commit details
-
Copy full SHA for 60fad28 - Browse repository at this point
Copy the full SHA 60fad28View commit details
Commits on Apr 16, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 2358a24 - Browse repository at this point
Copy the full SHA 2358a24View commit details -
Configuration menu - View commit details
-
Copy full SHA for 50ec4cb - Browse repository at this point
Copy the full SHA 50ec4cbView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5dc5aa8 - Browse repository at this point
Copy the full SHA 5dc5aa8View commit details -
Configuration menu - View commit details
-
Copy full SHA for 26ff817 - Browse repository at this point
Copy the full SHA 26ff817View commit details -
Configuration menu - View commit details
-
Copy full SHA for 14eadba - Browse repository at this point
Copy the full SHA 14eadbaView commit details
Commits on Apr 17, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 5c65852 - Browse repository at this point
Copy the full SHA 5c65852View commit details -
Configuration menu - View commit details
-
Copy full SHA for 979bdfa - Browse repository at this point
Copy the full SHA 979bdfaView commit details -
Configuration menu - View commit details
-
Copy full SHA for fd3f6ed - Browse repository at this point
Copy the full SHA fd3f6edView commit details
Commits on Apr 18, 2024
-
Configuration menu - View commit details
-
Copy full SHA for a16b30f - Browse repository at this point
Copy the full SHA a16b30fView commit details
Commits on May 13, 2024
-
Configuration menu - View commit details
-
Copy full SHA for f564bc4 - Browse repository at this point
Copy the full SHA f564bc4View commit details
Commits on May 21, 2024
-
Configuration menu - View commit details
-
Copy full SHA for f4c674e - Browse repository at this point
Copy the full SHA f4c674eView commit details
Commits on May 22, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 6f45aa7 - Browse repository at this point
Copy the full SHA 6f45aa7View commit details
Commits on May 23, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 6d4ebef - Browse repository at this point
Copy the full SHA 6d4ebefView commit details
Commits on May 24, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 32841a5 - Browse repository at this point
Copy the full SHA 32841a5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7a1a2d3 - Browse repository at this point
Copy the full SHA 7a1a2d3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2d73895 - Browse repository at this point
Copy the full SHA 2d73895View commit details -
Configuration menu - View commit details
-
Copy full SHA for c6f098b - Browse repository at this point
Copy the full SHA c6f098bView commit details
Commits on May 28, 2024
-
Configuration menu - View commit details
-
Copy full SHA for cf81769 - Browse repository at this point
Copy the full SHA cf81769View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8d1e377 - Browse repository at this point
Copy the full SHA 8d1e377View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5828f1a - Browse repository at this point
Copy the full SHA 5828f1aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5022c2d - Browse repository at this point
Copy the full SHA 5022c2dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 88db86d - Browse repository at this point
Copy the full SHA 88db86dView commit details
Commits on May 29, 2024
-
Configuration menu - View commit details
-
Copy full SHA for f4b60c2 - Browse repository at this point
Copy the full SHA f4b60c2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 52e5932 - Browse repository at this point
Copy the full SHA 52e5932View commit details -
Configuration menu - View commit details
-
Copy full SHA for dbb66de - Browse repository at this point
Copy the full SHA dbb66deView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0c0760e - Browse repository at this point
Copy the full SHA 0c0760eView commit details -
Configuration menu - View commit details
-
Copy full SHA for c9c20e0 - Browse repository at this point
Copy the full SHA c9c20e0View commit details -
Configuration menu - View commit details
-
Copy full SHA for f979b56 - Browse repository at this point
Copy the full SHA f979b56View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2338fa0 - Browse repository at this point
Copy the full SHA 2338fa0View commit details -
Configuration menu - View commit details
-
Copy full SHA for 34dda0c - Browse repository at this point
Copy the full SHA 34dda0cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 9fccd9d - Browse repository at this point
Copy the full SHA 9fccd9dView commit details -
Configuration menu - View commit details
-
Copy full SHA for c4cae88 - Browse repository at this point
Copy the full SHA c4cae88View commit details
Commits on May 30, 2024
-
Configuration menu - View commit details
-
Copy full SHA for a389e88 - Browse repository at this point
Copy the full SHA a389e88View commit details -
Configuration menu - View commit details
-
Copy full SHA for 91c2990 - Browse repository at this point
Copy the full SHA 91c2990View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1526eb4 - Browse repository at this point
Copy the full SHA 1526eb4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 30ef952 - Browse repository at this point
Copy the full SHA 30ef952View commit details -
Configuration menu - View commit details
-
Copy full SHA for c0ab02a - Browse repository at this point
Copy the full SHA c0ab02aView commit details
Commits on Jun 11, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 08e44de - Browse repository at this point
Copy the full SHA 08e44deView commit details -
Configuration menu - View commit details
-
Copy full SHA for aeb4628 - Browse repository at this point
Copy the full SHA aeb4628View commit details
Commits on Jun 12, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 6a6f383 - Browse repository at this point
Copy the full SHA 6a6f383View commit details -
Configuration menu - View commit details
-
Copy full SHA for c7fc14b - Browse repository at this point
Copy the full SHA c7fc14bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 10b7794 - Browse repository at this point
Copy the full SHA 10b7794View commit details
Commits on Jun 13, 2024
-
Configuration menu - View commit details
-
Copy full SHA for c26304e - Browse repository at this point
Copy the full SHA c26304eView commit details -
Configuration menu - View commit details
-
Copy full SHA for fb9d759 - Browse repository at this point
Copy the full SHA fb9d759View commit details -
Configuration menu - View commit details
-
Copy full SHA for 258a8b8 - Browse repository at this point
Copy the full SHA 258a8b8View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1683d9e - Browse repository at this point
Copy the full SHA 1683d9eView commit details -
Configuration menu - View commit details
-
Copy full SHA for c53262c - Browse repository at this point
Copy the full SHA c53262cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3cf7e9f - Browse repository at this point
Copy the full SHA 3cf7e9fView commit details
Commits on Jun 14, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 7e81e41 - Browse repository at this point
Copy the full SHA 7e81e41View commit details
Commits on Jun 18, 2024
-
Configuration menu - View commit details
-
Copy full SHA for b319512 - Browse repository at this point
Copy the full SHA b319512View commit details
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.