Create agents that monitor and act on your behalf. Your agents are standing by!

🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.

Python scraper based on AI

LLM based autonomous agent that conducts local and web research on any topic and generates a comprehensive report with citations.

A cli tool to browse and play anime

List of libraries, tools and APIs for web scraping and data processing.

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

Analysis of Bot Protection systems with available countermeasures 🚿. How to defeat anti-bot system 👻 and get around browser fingerprinting scripts 🕵️‍♂️ when scraping the web?

Web Scraper in Go, similar to BeautifulSoup

Scrapoxy is a super proxy aggregator, allowing you to manage all proxies in one place 🎯, rather than spreading it across multiple scrapers 🕸️. It also smartly handles traffic routing 🔀 to minimize bans and increase success rates 🚀.

The web scraping open project repository aims to share knowledge and experiences about web scraping with Python

Undetectable, Lightning-Fast, and Adaptive Web Scraping for Python

Vision utilities for web interaction agents 👀

👻 Experimental library for scraping websites using OpenAI's GPT API.

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

Persistent HTTP cache for python requests

LinkedIn enumeration tool to extract valid employee names from an organization through search engine scraping

Creating Scrapy scrapers via the Django admin interface

Lightweight library for scraping web-sites with LLMs

Suck the InTernet