Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Mysticeti persistence tracker #1

Open
12 of 15 tasks
andll opened this issue Jun 20, 2023 · 0 comments
Open
12 of 15 tasks

Mysticeti persistence tracker #1

andll opened this issue Jun 20, 2023 · 0 comments
Assignees
@andll

Comments

@andll
Copy link
Collaborator

andll commented Jun 20, 2023 •
edited
Loading

Mysticeti persistence

  • Write blocks to wal
  • Wal iterator
  • Read wal in block store on startup
  • Other wal operations for core, proper recovery for core data structures
  • Recovery for certificate aggregator
  • Recovery for commit interpreter
  • Recovery for committed certificates aggregator
  • Real certified transactions handler for main.rs (log transactions to certified.txt)
  • Real commit handler for main.rs (log transactions to committed.txt)
  • Periodic cleanup wal reader mmap’s
  • Block store cache eviction, ensure not OOM during long run
  • Larger wal::MAP_SIZE
  • Keep some blocks after replay in cache

Later

  • Corner cases for wal, discard last entry(s) if they are corrupted
  • Index file, do not replay main wal from the start
@andll andll self-assigned this Jun 20, 2023
@andll andll changed the title Mysticeti persistence Mysticeti persistence tracker Jun 20, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@andll andll

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@andll