V1.0

Features

1. Scrape data from otodom.pl and otomoto.pl
2. Parse scraped data and export them to JSON file
3. Easy configuration, just use url with all filters included

Technologies:

Backend

• Python
  • Typer
  • requests
  • beautifulsoup4

Installation

Clone repository

git clone https://github.com/DEENUU1/otodom-otomoto-scraper.git

Create virtual env

python -m venv venv 

Activate virtual env

.\venv\Scripts\activate

Install libraries

pip install -r requirements.txt

Change directory

cd app

Run script

python main.py <url> <page_limit> (default 1) <export_to> (default json)

For example:

python main.py https://www.otodom.pl/pl/wyniki/sprzedaz/mieszkanie/cala-polska?viewType=listing

python main.py https://www.otomoto.pl/osobowe 10 json