-
Notifications
You must be signed in to change notification settings - Fork 21
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Tons of rate limit errors / sccache-actions can be slow because of github storage #50
Comments
FYI, the first build: And the second build (re-trigger): And there are 1440 C/C++ misses! Here you are the log from the first build, and you can see there are tons of rate limits after a specific step. That drastically drops the hit rate of the second build. |
There are very little thing we can do for this. Sccache & Ghac are designed like this: too much small object will lead to rate limit. Try setup a s3 bucket if the speed is critical to you. |
Ok. Then I will use sccache locally and then upload to GitHub action cache like I previously did. |
topjohnwu/Magisk#7052 seems a nice idea! We can add this feature in
|
@Xuanwo is that something you could implement ? :) |
In order to work around this, I had to implement my own sccache logic and not rely on this action, here it is if it helps anyone:
A 2h C++ build now takes less than 1 hour. Hth, See it live here: https://github.com/f3d-app/f3d-superbuild/blob/main/.github/actions/f3d-superbuild/action.yml |
what about integrating this into sccache action itself ? :) |
That would be great, but I've never written a line of typescript in my life. Maybe the maintainer will want to integrate such a change. |
@Xuanwo would you be up for this task ? :) |
(added a link to the action on our repo) |
Hi all, seeing the same issue with the file fragmentation. I've also run into the Note we've also tried using a remote S3, though since github secrets can't be used on public Pull Request events, that option isn't viable for actually open source projects. This seems like a straightforward and useful implementation.
Question to @mwestphal: Why is there a need to start the sccache server (given that it will start on the first compile request)? Question for the |
I need to recover the location sccache will look for the its own cache ( |
@sylvestre here's a toy I made on a fork of this action. https://github.com/0o-de-lally/sccache-action/tree/local It will just cache the contents into a bundle called "sccache". It's minimalist, there are no key options. It will instead delete the cache every time and overwrite it (github doesn't allow just updating a cache). This suits my needs. Anyone else that wants to try it it's a zero config:
cc. @mwestphal |
the official sccache action apparently sucks Mozilla-Actions/sccache-action#50 (reference)
I found that my action's cache hit rate is too low (especially for c/c++). I enable debug log and saw tons of rate limits. How to solve this?
The text was updated successfully, but these errors were encountered: