Skip to content

MySQl/MariaDB Backup, convert to Parquet, using PHP CodeIgniter4 Framework, Python, and Clickhouse.

License

Notifications You must be signed in to change notification settings

MahlukEdanKurangGairah/simple-backup-ci4-clickhouse

Repository files navigation

SIMPLE BACKUP CI CLICKHOUSE

What is SIMPLE BACKUP CI CLICKHOUSE?

SIMPLE BACKUP CI CLICKHOUSE is application to backup MySQL/MariaDB database, run on linux. run on CLI using:

  • CodeIgniter 4 framework.
  • Clickhouse converter from MySQL table to parquet.
  • Python as worker executable.

Installation & updates

  • run git clone https://github.com/MahlukEdanKurangGairah/simple-backup-ci4-clickhouse.git
  • cd simple-backup-ci4-clickhouse
  • ./composer.phar install then ./composer.phar update

download clickhouse and place it on Executable folder

cd app/Executable && curl https://clickhouse.com/ | sh

install python and library on requirements.txt

  • cd app/Executable/sql2mysql' && pip install -r requirements.txt
  • cd app/Executable/parquet2cockroach' && pip install -r requirements.txt
  • cd app/Executable/parquet2mysql' && pip install -r requirements.txt

Setup

Configuration on app/Config/App.yaml. change mysql_conf (target to backup) and mysql_restore_conf (target to restore)

configure username and password mysql for target backup and target restore

  • app/Config/client_backup.cnf
  • app/Config/client_restore.cnf

Run

/usr/bin/php public/index.php

backup folder will placed in backup_folder with 2 folder 'struktur' and 'parquet'

Warning

This application under heavy development, use as yu wise.

About

MySQl/MariaDB Backup, convert to Parquet, using PHP CodeIgniter4 Framework, Python, and Clickhouse.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published