Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add argparser recipe to use commnad line arguments and select opeartions #1

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

mshaikh786
Copy link

Hi David,
Here is a suggestion to included argument parsing so that selective operations can be passed via command line to allow restart of the process where it left off (ball park).
Regards
Mohsin

@davidrpugh
Copy link

@mshaikh786 I had a glance through the PR. I think it makes sense to create a mechanism that allows the user to specify which of the train, val, or test sets that they wish to prepare. Preparing the training data is particularly time consuming and if has already been done, then there is no reason to do it again. I also like the idea to implement this mechanism as optional boolean flags.

However, I think that the default behavior (i.e., what happens when user runs a script with no args) should be to build everything; but we should allow users to disable the build for training, validation, or testing of data sets if they wish.

Something like to following UI for typical use case...

$ python build-imagenet-datasets.py

...and then something like the following for use who wants to build only validation dataset.

$ python build-imagenet-datasets.py --no-train --no-test

@davidrpugh
Copy link

@mshaikh786 take a look at PR #2 which implements the ideas from this PR along the lines of my comment above.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants