Skip to content

Computational DeFogging framework building off of previous research. U of U Summer Program for Undergraduate Research (SPUR) 2024.

License

Notifications You must be signed in to change notification settings

amirzarandi/claravisio

 
 

Repository files navigation

ClaraVisio: Computational DeFogging via Image-to-Image Translation on a Free-Floating Fog Dataset

ClaraVisio (or Clara for short; Latin for "clear sight") builds on top of two previous attempts: StereoFog by Anton Pollock and FogEye by David Moody, Laura Parke, Chandler Welch, with the aim of collecting data and developing a framework for Image-to-Image translation (I2I) of foggy pictures. This project was conducted under the supervision of Prof. Rajesh Menon at the Laboratory for Optical Nanotechnologies at the University of Utah during the summer of 2024 made possible by the University of Utah Summer Program for Undergraduate Research (SPUR). This work differs from previous research in using a novel free-floating fog dataset and a transformer-based model.


Table of Contents


Description

Placeholder text for the project description.

Back to the top


Image Capturing

*Placeholder text for the image capturing process.changed. *

Files are in raspberr_pi folder with the SOP

uses rclone to sync with google, configuration

to ssh into your raspberry pi 5:

to have the script running at boot up use

sudo crontab -e

added this code to bottom:

@reboot /path/to/python/script &

saved with CTRL+O and exit with CTRL+X

Back to the top


Model Training

Placeholder text for the model training process.

install conda from website

module use $HOME/MyModules
module load miniconda3/latest

to run jupyter notebooks you need to:

pip install notebook

Back to the top


Datasets

Placeholder text for the datasets.

StereoFog images: GDrive FogEye images: MSOneDrive - Only Available for U of U students/staff, contact us for premission; needs cleaning (only download directories that contain raw files) ClaraVisio images:

place inside a datasets/SteroFog directory and unzip

apt-get install unzip
unzip file.zip
python preprocess_stereofog_dataset.py --dataroot datasets/StereoFog/stereofog_images

need to run again to create a new split.

Back to the top


How to Use

Installation

git clone https://github.com/amirzarandi/claravisio
cd claravisio
python -m venv .venv

kill terminal then activate environment

pip install -r requirements.txt

train

python train.py --dataroot datasets/StereoFog/stereofog_images_processed --name AL1 --model pix2pix --direction BtoA --gpu_ids 0 --n_epochs 25



python train.py --dataroot .\datasets\stereofog_images --name stereo_pix2pix --model pix2pix --direction BtoA --gpu_ids -1 --n_epochs 1  # gpu_ids -1 is for devices that are not cuda enabled.
python test.py --dataroot .\datasets\stereofog_images --direction BtoA --model pix2pix --name stereo_pix2pix --gpu_ids -1

API Reference

Placeholder text for the API reference.

Back to the top


Getting Started

Placeholder text for getting started.

Back to the top


Results

Placeholder text for results.

Back to the top


Limitations

Placeholder text for limitations.

Back to the top


License

Placeholder text for license information.

Back to the top


Citation

Placeholder text for citation information.

Back to the top


References

Placeholder text for references.

Back to the top


Appendix

Placeholder text for the appendix.

Back to the top


Author Info

Placeholder text for author info.

Back to the top


About

Computational DeFogging framework building off of previous research. U of U Summer Program for Undergraduate Research (SPUR) 2024.

Topics

Resources

License

Stars

Watchers

Forks

Languages

  • Jupyter Notebook 92.0%
  • Python 8.0%