Simple Web Scraper

Disclaimer: Web scraping can be illegal. This app was created for educational purposes only. Any misuse of this application or the source code is sole responsibility of the user. The author is not liable for any sort of damages the user causes. Please use it responsibly.

Live Preview

You can test the app live here https://still-dawn-41412.herokuapp.com/

Requirements

Latest NodeJS must be installed on your computer. This app was tested with NodeJS version v11.8.0

How to run the API

1. In your terminal, navigate to the api directory.
2. Run npm install to install all dependencies.
3. Run npm run dev to start the app.

How to run the Client

1. In another terminal, navigate to the client directory.
2. Run npm install to install all dependencies.
3. Run npm start to start the app

Check if they are connected

1. With the two apps running, open your browser in http://localhost:3000/. If you see a webpage saying Welcome to React, it means the FrontEnd is working.
2. In a new tab, open your browser in http://localhost:8000/. If you see a webpage saying Backend is running, it means the BackEnd is working.

How to Use the App

1. Open the webpage you want to scrape the data from. Identify the data and copy the selector by right clicking on it and selecting "Inspect".
2. Input the URL and the selector in the Application and click fetch. It should return the text written in that selector.