Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Store more metadata about datagetter fetch #31

Open
michaelwood opened this issue Nov 19, 2021 · 2 comments
Open

Store more metadata about datagetter fetch #31

michaelwood opened this issue Nov 19, 2021 · 2 comments

Comments

@michaelwood
Copy link
Member

Look at etag and last-modified http response headers to work out if a file has changed. Datastore related.

Last-Modified:
ETag:
@michaelwood
Copy link
Member Author

Insights not expiring cached files

@michaelwood michaelwood mentioned this issue Dec 7, 2021
Closed
@michaelwood
Copy link
Member Author

Of 398 files 87 didn't provide last-modified in the header. Most of these are google docs or special feeds.

michaelwood added a commit that referenced this issue Jan 31, 2022
@michaelwood
get: Add fetching the last-modified and etag from webserver
ee41da4 
Add trying to fetch the last-modified and etag from the webserver to
help us with cache management and programmatically getting the last
modified date of the file for use in dashboard.

Related: #31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@michaelwood