Skip to content

Commit

Permalink
feat(query): Reduce serialisation memory usage when spilling to local…
Browse files Browse the repository at this point in the history
… disk (databendlabs#16580)

* set_size

Signed-off-by: coldWater <forsaken628@gmail.com>

* TempDirManager alignment

Signed-off-by: coldWater <forsaken628@gmail.com>

* BlocksEncoder

Signed-off-by: coldWater <forsaken628@gmail.com>

* DmaWriteBuf

Signed-off-by: coldWater <forsaken628@gmail.com>

* fix

Signed-off-by: coldWater <forsaken628@gmail.com>

* enable_dio

Signed-off-by: coldWater <forsaken628@gmail.com>

* Alignment

Signed-off-by: coldWater <forsaken628@gmail.com>

* no dio read

Signed-off-by: coldWater <forsaken628@gmail.com>

* test

Signed-off-by: coldWater <forsaken628@gmail.com>

* one read

Signed-off-by: coldWater <forsaken628@gmail.com>

* refactor

Signed-off-by: coldWater <forsaken628@gmail.com>

* fix

Signed-off-by: coldWater <forsaken628@gmail.com>

---------

Signed-off-by: coldWater <forsaken628@gmail.com>
  • Loading branch information
forsaken628 authored Oct 14, 2024
1 parent 42bca6b commit 7548f99
Show file tree
Hide file tree
Showing 15 changed files with 600 additions and 231 deletions.
25 changes: 18 additions & 7 deletions Cargo.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

4 changes: 4 additions & 0 deletions Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -48,6 +48,10 @@ run-debug: build
run-debug-management: build
bash ./scripts/ci/deploy/databend-query-management-mode.sh

kill:
killall databend-query
killall databend-meta

build:
bash ./scripts/build/build-debug.sh

Expand Down
Loading

0 comments on commit 7548f99

Please sign in to comment.