Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Per-city chip catalogs #32

Open
pkerins opened this issue Sep 27, 2019 · 1 comment
Open

Per-city chip catalogs #32

pkerins opened this issue Sep 27, 2019 · 1 comment
Assignees
Labels
enhancement New feature or request housekeeping organization, rather than execution per se

Comments

@pkerins
Copy link
Contributor

pkerins commented Sep 27, 2019

Having a master chip catalog has been convenient, but at this point it has become impractically large and cumbersome. As a result, following work on incorporating multiprocessing into chip creation, we are officially moving to per-city catalogs, ie one catalog per city containing all chips for that city. The naming convention will be chip_catalog_city.csv; catalogs will be housed in a dedicated folder in the data_root directory; currently this would be /data/phase_iv/catalogs/.

The code base requires a small amount of additional infrastructure to handle these separate catalogs. Additionally, the original master catalog needs to be disaggregated into appropriate per-city catalogs, named properly and saved to file in the appropriate locations.

@pkerins pkerins added enhancement New feature or request housekeeping organization, rather than execution per se labels Sep 27, 2019
@pkerins pkerins self-assigned this Sep 27, 2019
@pkerins
Copy link
Contributor Author

pkerins commented Nov 14, 2019

To clarify, in addition to the creation of the files themselves, I want some accessor functionality in the code base so that the user can simply pass a list of cities and get back a catalog with all chips from said cities. (Tempting to have this perform filtering as well, eg return only specified images from specified cities, but ultimately the catalog files have to be loaded anyway, so might as well keep things modular.)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request housekeeping organization, rather than execution per se
Projects
None yet
Development

No branches or pull requests

1 participant