Download website to local directory (including all css, images, js, etc.)

Website Cloner - Utilizes powerful Go routines to clone websites to your computer within seconds.

🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON.

Uscrapper Vanta: Dive deeper into the web with this powerful open-source tool. Extract valuable insights with ease and efficiency, from both surface and deep web sources. Empower your data mining and analysis with Vanta's advanced capabilities. Fast, reliable, and user-friendly, Uscrapper Vanta is the ultimate choice for researchers and analysts.

Plugin for website-scraper which returns html for dynamic websites using puppeteer

CMS, WebSite, Application and Ecommerce Development Tool Using JavaScript

🕸 generates RSS feeds of any website a d servers to the web! Docker. Automatic scraping, use the built-in configs or create your own. Rolling release for speedy updates.

Wayback Machine Downloader. 🔥 Download your entire archived websites from the Internet Archive Wayback Machine.

DPULSE - Tool for complex approach to domain OSINT

A server to collect & archive websites that also supports video downloads

ScrapeGPT is a RAG-based Telegram bot designed to scrape and analyze websites, then answer questions based on the scraped content. The bot utilizes Retrieval Augmented Generation and webscraping to return natural language answers to the user's queries.

Python-based web crawling script with randomized intervals, user-agent rotation, and proxy server IP rotation to outsmart website bots and prevent blocking.

🌱 goClone - clone websites in seconds

Plugin for website-scraper which returns html for dynamic websites using PhantomJS.

Automatically curates and posts content to LinkedIn. It can optionally use web scraping to gather data, which is then fed to ChatGPT to craft engaging LinkedIn posts.

Evaluate JavaScript on a URL through headless Chrome browser.

Scraper for https://marvelsnapzone.com to retrieve metadata of Marvel SNAP cards.

Now you can keep track of your followers from YouTube, Instagram and Twitter accounts - Followers scraper API on AWS serverless

JSON collection of scraped file extensions, along with their description and type, from FileInfo.com

A spider to crawl webpages