Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support pex3 cache operation at the distribution level. #2528

Open
3 tasks
jsirois opened this issue Sep 13, 2024 · 2 comments
Open
3 tasks

Support pex3 cache operation at the distribution level. #2528

jsirois opened this issue Sep 13, 2024 · 2 comments

Comments

@jsirois
Copy link
Member

jsirois commented Sep 13, 2024

It would be useful to be able to manipulate distributions in the Pex cache since these are the chief contributors to cache size and the cache items most directly identifiable to an end user since they ask for them in requirements.

Subject to spelling, the actions would be:

  • pex3 cache add a distribution to prep for offline use.
  • pex3 cache remove one or more distributions safely (paying mind to unzipped_pexes and venvs symlinks).
  • pex3 cache list to list distributions and their sizes much like the broader pex3 cache info.
@jsirois jsirois self-assigned this Oct 2, 2024
jsirois added a commit that referenced this issue Oct 5, 2024
Use a `dbs` cache entry for all databases starting with PEP-691
fingerprints and hide this cache entry as a choice when purging
individual entries using `pex3 cache purge`.

Work towards #2528.
@jsirois
Copy link
Member Author

jsirois commented Oct 7, 2024

Arguably even better would be the ability to prune items not recently used. This requires the least understanding of Pex cache internals and is likely the most familiar metric. I'll land this capability 1st since it requires much of the same infrastructure needed to support the OP.

jsirois added a commit to jsirois/pex that referenced this issue Nov 4, 2024
@jsirois
Copy link
Member Author

jsirois commented Nov 4, 2024

#2586 provides most of the infra needed for this.

jsirois added a commit that referenced this issue Nov 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant