Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Improvement] use sqllite or h2 or dinky server database to cache db data and mertrics data #3201

Closed
2 of 3 tasks
Zzm0809 opened this issue Feb 29, 2024 · 3 comments
Closed
2 of 3 tasks
Labels
Discussing The problem is being discussed Invalid Invalid Optimization Optimization function
Milestone

Comments

@Zzm0809
Copy link
Contributor

Zzm0809 commented Feb 29, 2024

Search before asking

  • I had searched in the issues and found no similar optimization requirement.

Description

en:

Currently, paimon is used as a cache medium for data source information and monitoring data. However, paimon's strong dependence on hadoop leads to a series of dependency and data problems that need to be optimized.

  • Option 1: Use spi method to expand and add new cache media of type sqllite or h2
  • Option 2: Directly use sqllite or h2 to replace paimon

cn:

当前使用 paimon 作为数据源信息和监控数据的缓存介质和监控数据存储介质,但是 paimon 强依赖 hadoop 导致一系列依赖和数据问题, 需要优化,且目前会导致内存泄露
方案一: 使用 spi 方式进行扩展新增类型为 sqllite 或者 h2 的缓存介质, 默认优先使用 dinky 服务的数据库存储介质
方案 二: 直接使用 sqllite 或者 h2 替换掉 paimon

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@Zzm0809 Zzm0809 added Waiting for reply Waiting for reply Optimization Optimization function Discussing The problem is being discussed and removed Waiting for reply Waiting for reply labels Feb 29, 2024
@Zzm0809 Zzm0809 added this to the Roadmap milestone Feb 29, 2024
@gaoyan1998 gaoyan1998 moved this to ToDo in Dinky Roadmap Mar 13, 2024
@gaoyan1998 gaoyan1998 modified the milestones: Roadmap, 1.1.0 Mar 13, 2024
Copy link

github-actions bot commented May 1, 2024

Hello @, this issue has not been active for more than 30 days. This issue will be closed in 7 days if there is no response. If you have any questions, you can comment and reply.

你好 @, 这个 issue 30 天内没有活跃,7 天后将关闭,如需回复,可以评论回复。

@github-actions github-actions bot added the Invalid Invalid label May 1, 2024
@Zzm0809 Zzm0809 changed the title [Improvement] use sqllite or h2 to cache db data and mertrics data [Improvement] use sqllite or h2 or dinky server database to cache db data and mertrics data May 28, 2024
@Zzm0809 Zzm0809 removed the Invalid Invalid label May 31, 2024
@github-actions github-actions bot added the Invalid Invalid label Jul 1, 2024
Copy link

github-actions bot commented Jul 1, 2024

Hello @, this issue has not been active for more than 30 days. This issue will be closed in 7 days if there is no response. If you have any questions, you can comment and reply.

你好 @, 这个 issue 30 天内没有活跃,7 天后将关闭,如需回复,可以评论回复。

@Zzm0809
Copy link
Contributor Author

Zzm0809 commented Jul 18, 2024

已完成 #3613

@Zzm0809 Zzm0809 closed this as completed Jul 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Discussing The problem is being discussed Invalid Invalid Optimization Optimization function
Projects
Archived in project
Development

No branches or pull requests

2 participants