You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Restructure the program into proper components (Classes, mostly). Other changes will go along with that.
Component - Web Request Handler #1 . Concerned with making web requests and ensuring response validity. Invalid responses may involve retries and/or skips.
Component - Data Processor #10 . Concerned with taking all the raw web request data and converting it into a useful object mode.
Component - Scraper Task #12 . Concerned with invoking the Web Request Handler, Data Processor, and Database Handler, in order and with the proper linking and data transformation (if required) between steps.
Component - Scheduler #14 . Concerned with keeping a task running consistently at the correct time. (May be as simple as 'wait until X')
Component - Main Loop #13 . Concerned with running the Scraper Task running at its scheduled time, indefinitely.
The text was updated successfully, but these errors were encountered:
Restructure the program into proper components (Classes, mostly). Other changes will go along with that.
The text was updated successfully, but these errors were encountered: