Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DSIP-38] Optimize dependency tree #16838

Open
wants to merge 7 commits into
base: dev
Choose a base branch
from

Conversation

SbloodyS
Copy link
Member

@SbloodyS SbloodyS commented Nov 25, 2024

Purpose of the pull request

close #16098

Brief change log

  • Removing plugin's repeated dependence in libs directory
  • Removing unused dependency
  • Removing data quality code was not deleted.

The binary package apache-dolphinscheduler-dev-SNAPSHOT-bin.tar.gz size is 912M with the following file

$ du -sh *
 72K    LICENSE
 84K    NOTICE
 44K    alert-server
 25M    api-server
 16K    bin
4.0K    conf
247M    libs
5.5M    licenses
 48K    master-server
 12K    mvnw
8.0K    mvnw.cmd
721M    plugins
 26M    standalone-server
772K    tools
 25M    ui
 44K    worker-server

Verify this pull request

This pull request is code cleanup without any test coverage.

(or)

This pull request is already covered by existing tests, such as (please describe tests).

(or)

This change added tests and can be verified as follows:

(or)

Pull Request Notice

Pull Request Notice

If your pull request contain incompatible change, you should also add it to docs/docs/en/guide/upgrede/incompatible.md

@SbloodyS SbloodyS added the DSIP label Nov 25, 2024
@SbloodyS SbloodyS added this to the 3.3.0 milestone Nov 25, 2024
@SbloodyS SbloodyS self-assigned this Nov 25, 2024
@github-actions github-actions bot added UI ui and front end related backend test labels Nov 25, 2024
@github-actions github-actions bot removed the UI ui and front end related label Nov 25, 2024
@github-actions github-actions bot added the e2e e2e test label Nov 25, 2024
Copy link

sonarcloud bot commented Nov 25, 2024

@@ -1438,7 +1437,7 @@ private TaskDefinitionLog buildNormalSqlTaskDefinition(String taskName, DataSour
sqlParameters.setLocalParams(Collections.emptyList());
taskDefinition.setTaskParams(JSONUtils.toJsonString(sqlParameters));
taskDefinition.setCode(CodeGenerateUtils.genCode());
taskDefinition.setTaskType(SqlTaskChannelFactory.NAME);
taskDefinition.setTaskType("SQL");
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We need to use enum or constant, otherwise once the type has been changed, it's hard to know we need to make change here.

@@ -63,13 +63,19 @@

<dependency>
<groupId>org.apache.dolphinscheduler</groupId>
<artifactId>dolphinscheduler-datasource-all</artifactId>
<artifactId>dolphinscheduler-common</artifactId>
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's better to change dolphinscheduler-datasource-all to provided rather than remove it, once we remove it, no one can find the module relation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Improvement] Optimize dependency tree
2 participants