News ingestion for news corpus
The list of source news includes:
- Yahoo Finance News
- Seeking Alpha News and Articles
- Morningstar News
- Barons News
- Wall Street Journal News (WSJ)
- Benzinga News
- Wikipedia
- Google News (i.e. scraping news directly to google)
The ingestion using several methods such as web scraping (either Python Selenium or BeautifulSoup) and API from RapidAPI