Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

news-please - an integrated web crawler and information extractor for news that just works

A very simple news crawler with a funny name

Lightweight scraper for Google News

A korean news crawler built to ingest large amounts of news data.

A news crawler for BBC News, Reuters and New York Times.

This Python package can be used to systematically extract multiple data elements (e.g., title, keywords, text) from news sources around the world in over 50 languages.

Newsfeeds website using nodejs as server and mongo as storage backends, including a simple recommendation system. 基于Node.js的新闻聚合网站, 支持基于用户行为推荐新闻.

The spider crawls moneycontrol.com and economictimes.com to fetch news of input companies and also scores and classifies the companies to raise an early warning signal

News crawler là một công cụ giúp bạn có thể crawl dữ liệu của một trang tin tức.

Use python scrapy build crawler for real-time Taiwan NEWS website.

📰 Search engine for news in NodesJS

Generate large textual corpora for almost any language by crawling the web

텍스트 분석용 데이터 수집을 위한 웹스크래핑 도구를 제공합니다.

A Fast and lightweight Python API that search for articles on Google News and returns a JSON response.

Article title, authors, date and body extraction dataset.

11/09/2020 - Complete directory for Pundits Review web application. https://www.punditsreview.com/

Config based news crawler using Google Puppeteer

Research Project to analyse the knowledge about Alcoholics Anonymous in public

📰 NEWS_CRAWLER: Automate Your News Updates! 📰 A NodeJS web crawler that generates personalized newsletters using SendGrid and OpenAI APIs. Ideal for staying on top of web trends and automating your news feed.