-
It would be good to have a paragraph in the README on whether cookies are saved across requests and if it's possible to persist them. |
Beta Was this translation helpful? Give feedback.
Answered by
B4nan
Jul 11, 2023
Replies: 1 comment
-
There is no state, this is still just a http client, nothing else, its up to you to manage this. Or use some tool on top of this, e.g. crawlee uses got-scraping internally to do requests with HttpCrawler (or its extensions, e.g. CheerioCrawler), where you have tooling for cookie/session management. |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
olalonde
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
There is no state, this is still just a http client, nothing else, its up to you to manage this. Or use some tool on top of this, e.g. crawlee uses got-scraping internally to do requests with HttpCrawler (or its extensions, e.g. CheerioCrawler), where you have tooling for cookie/session management.
https://crawlee.dev/docs/guides/session-management