Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Choose base container and add instructions for updating #11

Closed
egrace479 opened this issue May 10, 2024 · 9 comments
Closed

Choose base container and add instructions for updating #11

egrace479 opened this issue May 10, 2024 · 9 comments
Labels
documentation Improvements or additions to documentation question Further information is requested structure Refactoring or architecture, general code organization

Comments

@egrace479
Copy link
Member

We will provide a base container with instructions for participants to update it and submit with their model.

How do we implement that in CodaBench?

@egrace479 egrace479 added documentation Improvements or additions to documentation question Further information is requested structure Refactoring or architecture, general code organization labels May 10, 2024
@egrace479 egrace479 added this to the Functional Challenge Bundle milestone May 10, 2024
@egrace479
Copy link
Member Author

We have a base container. It seems we may do a whitelist for requirements. This is a bigger discussion, ongoing with A3D3 and iHarp.

@work4cs
Copy link
Collaborator

work4cs commented Jul 3, 2024

Need to maintain the security for docker.

@work4cs
Copy link
Collaborator

work4cs commented Aug 7, 2024

We have a base container. It seems we may do a whitelist for requirements. This is a bigger discussion, ongoing with A3D3 and iHarp.

I feel it is hard to include all the possible requirements in the whitelist. Participants may use some packages we have not thought of and we do not want to limit what the participants can use.

@egrace479
Copy link
Member Author

I feel it is hard to include all the possible requirements in the whitelist. Participants may use some packages we have not thought of and we do not want to limit what the participants can use.

The solution we discussed with the larger group resulted in a whitelist check that will exit with the message that a package is not allowed and they should contact us through GitHub to request it be added to the whitelist if needed.

Current whitelist proposal includes container packages and our baseline model requirements (as well as packages initially included by A3D3). @work4cs, please comment on the PR with any other packages you think should be included. Thanks!

@egrace479
Copy link
Member Author

Note that we are also going to be using a shared container with A3D3 and iHarp, so we should make sure they are compatible (A3D3's). @work4cs, can you suggest any changes to theirs that may be necessary for us (such as installing PIL and tqdm)?

@work4cs
Copy link
Collaborator

work4cs commented Aug 13, 2024

We have a dockerfile. The important thing might be to have pip install pillow tqdm pandas scikit-learn pyyaml

@work4cs
Copy link
Collaborator

work4cs commented Aug 20, 2024

May I ask what the published shared docker we can use right now? docker ihsaanullah/fair_universe:latest in A3D3's github page is a container pushed 6 months ago based on docker hub?

@work4cs
Copy link
Collaborator

work4cs commented Aug 28, 2024

the latest shared container docker pull ghcr.io/a3d3-institute/hdr-image:latest in a3d3 github

@egrace479
Copy link
Member Author

Link to the A3D3 container has been added to the repo and it is used in the challenge, so this is done.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation question Further information is requested structure Refactoring or architecture, general code organization
Projects
None yet
Development

No branches or pull requests

2 participants