Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

This project is a multi-threaded web crawler implemented in Java that efficiently explores websites using Jsoup for HTML parsing and ExecutorService for concurrent URL processing. It supports depth control, manages crawled URLs, and ensures that the crawler can resume from a previous state using a persistent state file.

A web crawler that send notifications to you!

網頁爬蟲

CodeBRT is an AI program generation plugin for VSCode. It helps you quickly generate code through AI, thus improving development efficiency.

🍛 Curry é um WebCrawler escrito em Golang com finalidade de verificar o valor do câmbio de Dólar para Real (USDxBRL) em algumas lojas no Paraguay.

🌧 🐛.🌿 Web crawler to get data from weather, bugs and plant!

A multi threaded web crawler library that is generic enough to allow different engines to be swapped in.

Kotlin library to fetch and parse Tibia.com pages.

An advanced web crawler in Python

Inverted Indexer, web crawler, sort, search and poster steamer written using Python for information retrieval.

Helpful web scraper for hardverapro.hu

An automated scholarly literature pipeline that systematically searches, downloads, and analyzes academic papers while extracting key scientific parameters and organizing research data into structured formats for research purposes.

Tool to crawl .onion websites. Console & Web UI

Gjenskapning av NRKs side 199 fra Tekst-TV

Web scraper, crawler and parser in C#. Designed as simple, declarative and scalable web scraping solution.

Scrape products from various Indian e-commerce web sites and export it as csv.

This application leverages Playwright and Crawlee for web automation and data extraction of YouTube playlists, allowing users to visualize metrics such as views and durations. Deployed on Apify using Docker.

Notification updates as new show times listed in BMS