You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
As more datasets are generated within a datastore directory, it takes longer to search for a pre-existing dataset on each query. Instead of searching through each .ini file (which requires opening, searching, closing each file), you should write a sort of master record file. Such a file might have one line for each dataset in the datastore specifying the configuration of that dataset. Then, querying the datastore only requires opening that single file and reading the lines. I expect that would proceed much faster.
The text was updated successfully, but these errors were encountered:
As more datasets are generated within a datastore directory, it takes longer to search for a pre-existing dataset on each query. Instead of searching through each .ini file (which requires opening, searching, closing each file), you should write a sort of master record file. Such a file might have one line for each dataset in the datastore specifying the configuration of that dataset. Then, querying the datastore only requires opening that single file and reading the lines. I expect that would proceed much faster.
The text was updated successfully, but these errors were encountered: