Skip to content
This repository has been archived by the owner on Jul 10, 2024. It is now read-only.

SUBMARINE-1408. Fix ubuntu low disk space issue #1104

Closed
wants to merge 3 commits into from

Conversation

cdmikechen
Copy link
Contributor

@cdmikechen cdmikechen commented Sep 17, 2023

What is this PR for?

Recently, in the github actions, there is less and less space left in ubuntu, which leads to a no disk space exception in one of the steps of the workflow.
Therefore, we need to remove unneeded packages and files from the ubuntu to make as much space as possible for python packages, docker images, and k8s.

What type of PR is it?

Hot Fix

Todos

  • - Reduce ubuntu disk space.
  • - don't update accpted_time while agent is processing to avoid unit test errors on ·accpted_time·.

What is the Jira issue?

https://issues.apache.org/jira/browse/SUBMARINE-1408

How should this be tested?

CI test

Screenshots (if appropriate)

Before:
image
After:
image

Questions:

  • Do the license files need updating? No
  • Are there breaking changes for older versions? No
  • Does this need new documentation? No

@codecov
Copy link

codecov bot commented Sep 17, 2023

Codecov Report

Merging #1104 (282251b) into master (42785be) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #1104   +/-   ##
=======================================
  Coverage   66.83%   66.83%           
=======================================
  Files         130      130           
  Lines        6320     6320           
=======================================
  Hits         4224     4224           
  Misses       2096     2096           
Flag Coverage Δ
python-integration 53.97% <ø> (ø)
python-unit 47.86% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@cdmikechen cdmikechen changed the title SUBMARINE-1408. Reduce ci storage SUBMARINE-1408. Fix ubuntu low disk space issue Sep 17, 2023
@asfgit asfgit closed this in 6ed412e Sep 18, 2023
cdmikechen added a commit that referenced this pull request Sep 23, 2023
### What is this PR for?
Recently, in the github actions, there is less and less space left in ubuntu, which leads to a no disk space exception in one of the steps of the workflow.
Therefore, we need to remove unneeded packages and files from the ubuntu to make as much space as possible for python packages, docker images, and k8s.

### What type of PR is it?
Hot Fix

### Todos
* [x] - Reduce ubuntu disk space.
* [x] - don't update `accpted_time` while agent is processing to avoid unit test errors on ·accpted_time·.

### What is the Jira issue?
https://issues.apache.org/jira/browse/SUBMARINE-1408

### How should this be tested?
CI test

### Screenshots (if appropriate)
Before:
<img width="478" alt="image" src="https://github.com/apache/submarine/assets/12069428/eea00bd5-8ddb-4759-918e-06e4ed821916">
After:
<img width="421" alt="image" src="https://github.com/apache/submarine/assets/12069428/5aac5f25-16bb-43a5-b93d-7e9729e9c55e">

### Questions:
* Do the license files need updating? No
* Are there breaking changes for older versions? No
* Does this need new documentation? No

Author: cdmikechen <cdmikechen@apache.org>

Signed-off-by: cdmikechen <cdmikechen@apache.org>

Closes #1104 from cdmikechen/reduce-ci-storage and squashes the following commits:

282251b [cdmikechen] free disk space
6f9d7f9 [cdmikechen] Remove accpted_time update
2682226 [cdmikechen] repalce 10G to 1G
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant