Performance Improvement for Documents, Interval Adjustements, Adjustements for UI Logic and Various Fixes #483

datomo · 2024-03-25T07:46:44Z

Summary

This PR adjusts the value representation for intervals to be more generic and fit to the previously introduced PolyValues.
Additionally it adjusts the serialization logic for PolyDocuments to improve the general document performance.
Further it fixes various bugs and adds missing logic to the webui module.

Changes

PolyInterval streamlined and adjustments
PolyDocument performance
Cleanup and streamlining of PolyValues

Bug Fixes

Filtered Source queries let to errors
Fixed Source deleting
Source fixes for removal of columns
Multimedia INSERT and UPDATE
Snapshot rollbacks leading to new snapshots -> infinite loop
ConcurrentModificationException on webui broadcast
Deployment of Placements and Constraints via UI and CLI
Various missing error handling and rollback errors
Transmitting of Config errors on enable to webui

…ions

…ality

…ary substitution for documents to improve performance

…for frontend

…, various fixes for arrays

core/src/main/java/org/polypheny/db/algebra/logical/relational/LogicalRelJoin.java

plugins/sql-language/src/main/java/org/polypheny/db/sql/SqlLanguagePlugin.java

…lize for interval

into document-fix

…to fix media update and insert, speed up

…oval

…concurrent modification exception with broadcast in frontend

plugins/neo4j-adapter/src/main/java/org/polypheny/db/adapter/neo4j/util/Translator.java

plugins/mongodb-adapter/src/main/java/org/polypheny/db/adapter/mongodb/MongoEnumerator.java

…e neo4j tranformations

… document-fix

…ug examples for now

… document-fix

into document-fix

vogti

Thx, @datomo, for this PR!

datomo and others added 23 commits March 17, 2024 01:21

adjusting documentValues comp string to fix caching

d546c29

mini adjustement to document webui component, some refactoring

ceddf42

various optimizations for map and doc serializations and deserializat…

4017792

…ions

Fix issue with resetting docker containers on startup

7d77055

fix for rex filter in sources

cdba0ad

some performance testing for serialization, while preserving function…

192214c

…ality

enabled namespace.collection.command( syntax for mql, switched to bin…

c1bda7c

…ary substitution for documents to improve performance

added omitting of db. keyword for mql queries

693e7ff

adjustment to typed json deserializer to improve caching

01ac879

fix mongo docbench edge case with missing quotes

1cb33cb

changed editor config to adjusted one

cf6acd7

removed all interval types except millis and month

b1fdb04

adjustment to fixed mapping of intervals

3b0987d

partial fix for restoring

644d0a3

added missing adapter specific restores

495625e

removed unused fields from joins

b5389c8

fixed special query monitoringType errors and limit clauses

5f13135

fixed joint trim logic

2f058e4

bug fixes for joins and additional parameter for queryType of result …

a210df8

…for frontend

adjustement to IntervalTypes

a6927d6

streamlined interval logic and adjusted test with well-defined syntax…

88fba63

…, various fixes for arrays

fixed parsing logic, handling and various tests regarding intervals

05ccdb5

fix for config update

e4e1950

gartens reviewed Mar 25, 2024

View reviewed changes

core/src/main/java/org/polypheny/db/algebra/logical/relational/LogicalRelJoin.java Outdated Show resolved Hide resolved

fixed graph logic and parsing, added some error handling

c625131

gartens reviewed Mar 26, 2024

View reviewed changes

plugins/sql-language/src/main/java/org/polypheny/db/sql/SqlLanguagePlugin.java Outdated Show resolved Hide resolved

gartens and others added 4 commits March 26, 2024 10:23

Fix SQL query splitting

1e7a73e

minor adjustments for stability, fixed images and videos, fixed norma…

dfd3e29

…lize for interval

Merge branch 'document-fix' of https://github.com/polypheny/Polypheny-DB

3aadd78

into document-fix

fixed edge-cases for limit parsing

7dfe55c

datomo added 9 commits April 4, 2024 21:15

fixed wrong constraint name

f5eb2e2

minor QoL adjustment

3b27c04

added missing existing transactions and statements for webui updates …

8887779

…to fix media update and insert, speed up

moved PolyLong into correct folder added own hashcode for values back

b813e75

adjustment of placement webui model to fix placement modification

e0ac963

fix informationmanager for non-relationa queries

74d44ee

fix for rollback with data sources and fix for data source column rem…

1f4ba2f

…oval

fix for config errors and added missing rollback for constraint testing

509ff33

fixed some edge-cases on casting with parameterization and potential …

80648a3

…concurrent modification exception with broadcast in frontend

vogti reviewed Apr 7, 2024

View reviewed changes

plugins/neo4j-adapter/src/main/java/org/polypheny/db/adapter/neo4j/util/Translator.java Outdated Show resolved Hide resolved

vogti reviewed Apr 7, 2024

View reviewed changes

plugins/mongodb-adapter/src/main/java/org/polypheny/db/adapter/mongodb/MongoEnumerator.java Outdated Show resolved Hide resolved

datomo added 3 commits April 8, 2024 00:14

fix for null values in rexliteral

94b7dc4

minor adjustment to mongo functions, reformatting and cleanup for som…

021e5d6

…e neo4j tranformations

Merge branch 'document-fix' of github.com:polypheny/Polypheny-DB into…

a5df4f3

… document-fix

datomo marked this pull request as ready for review April 8, 2024 07:30

vogti and others added 12 commits April 8, 2024 11:07

Add additional SQL function tests

3e3aeea

Rename monitoring plugin

9cf0eed

Remove unnecessary license

ace2547

Fixed PI and USER queries, disabled and marked subquery and BETWEEN b…

0232611

…ug examples for now

Merge branch 'document-fix' of github.com:polypheny/Polypheny-DB into…

55290ba

… document-fix

Fixed unnecessary getter for record

9b1ab57

added missing escape

e1c4e18

added constraint validity test on create

ecb3b39

Minor formatting adjustments and adjust year in copyright

e153166

disabled some of the new tests for failing stores

9b31286

Merge branch 'document-fix' of https://github.com/polypheny/Polypheny-DB

5a52cc2

into document-fix

added correct "exclude" tag

e34e1ff

vogti approved these changes Apr 8, 2024

View reviewed changes

vogti merged commit 250079c into master Apr 8, 2024
38 checks passed

vogti deleted the document-fix branch April 8, 2024 15:09

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Performance Improvement for Documents, Interval Adjustements, Adjustements for UI Logic and Various Fixes #483

Performance Improvement for Documents, Interval Adjustements, Adjustements for UI Logic and Various Fixes #483

datomo commented Mar 25, 2024 •

edited

Loading

vogti left a comment

Performance Improvement for Documents, Interval Adjustements, Adjustements for UI Logic and Various Fixes #483

Performance Improvement for Documents, Interval Adjustements, Adjustements for UI Logic and Various Fixes #483

Conversation

datomo commented Mar 25, 2024 • edited Loading

Summary

Changes

Bug Fixes

vogti left a comment

Choose a reason for hiding this comment

datomo commented Mar 25, 2024 •

edited

Loading