Skip to content

This system provides the facility to convert roughly hand-drawn humam face sketch image on canvas into a realistic face image by using image generative AI in a real-time.

License

Notifications You must be signed in to change notification settings

offfahad/human-face-sketch-to-real

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Face Sketch To Real (Sketch2Face.AI): A Deep Learning-Powered Image Translation Application

Introduction

Face Sketch To Real is a innovative image translation application which I developed for my final year project of BS Computer Science degree. All the project documentation and implementation of coding was made by a single developer, demonstrating comprehensive skills in machine learning, mobile application development, and backend integration.

Project Overview

Face Sketch To Real leverages state-of-the-art deep learning techniques, specifically Conditional Generative Adversarial Networks (CGANs) and the Image-To-Image Translation Alogorithm, to translate hand-drawn human face sketches into realistic images. The application targets both mobile and web platforms, offering users an intuitive and interactive interface for creating lifelike portraits from rough sketches.

Key Features

  • Advanced Deep Learning Model: The heart of Sketch2Real is a deep learning model trained on a custom dataset which I made by myself comprising approximately 5000 samples of human face sketches and their corresponding real images and all human faces images are AI Generted (No person exists in real life). The model has been trained for over 10,000 epochs, ensuring exceptional accuracy and realism in image translation. More epochs more accurate results in this model arcitecture.

  • Cross-Platform Compatibility: Built using the Flutter framework, Sketch2Real seamlessly caters to both mobile and web users, providing a consistent user experience across different devices and platforms.

  • Backend Infrastructure: The project incorporates a robust RESTful API developed with Flask, enabling seamless communication between the application frontend and the deep learning model. This backend infrastructure ensures efficient handling of user requests and data transmission during the image translation process.

  • User-Friendly Interface: Sketch2Real boasts an intuitive and visually appealing user interface, allowing users to effortlessly draw sketches, upload images, and interact with the application's various features. The interface supports real-time sketch editing, enabling users to refine their creations on the fly.

  • Authentication and Security: Firebase authentication is integrated into Sketch2Real, ensuring secure user login and data privacy. User authentication mechanisms provide a seamless and secure experience for accessing the application's features and functionalities.

  • State Management and Performance Optimization: The application leverages the GetX library for efficient state management, optimizing performance and resource utilization. This approach ensures smooth and responsive user interactions, even when handling complex image processing tasks.

Quick Demo Video

quick-face-to-sketch-live-demo.mp4

UI Of The Application

Onboarding Screens

Onboarding Screens

Login and Sign Up Screens

Login and Sign Up Screens

Forgot Password and OTP Screens

Forgot Password and OTP Screens

Home Screen (Draw Sketch Like This And Make It Into Realistic Face Image)

reuslts

Edit Profile and Drawing Practice Screen

WhatsApp Image 2024-05-10 at 21 25 48_11a8484b-imageonline co-merged

Model Training Results

Test Dataset Images

20epochs 100Epochs 200Epochs 300Epochs 600Epochs 800Epochs 1500Epochs 1800Epochs 2500Epochs 3000Epochs 3500Epochs 4500Epochs 5000Epochs 7500Epochs 10000Epochs

Unseen Imgae Result

I try to draw my face sketch and give it to model and results was very accurate and mind blowing! The first one is mine. 10000Epochs

More Unseen Images Results

sir-naveed-results random-girl sir-zafar-results

Credits

  • I took the model architecture concept from this paper named as "Image-To-Image Translation With Conditional Generative Adversarial Neural Networks" from https://arxiv.org/abs/1611.07004 because they have provided a commom framework you just have to change the dataset.
  • I trained my model on Google Colab Pro around for 3 months just on training phase due to limited GPU computing units even on the premium subscription.
  • The frontend was also very time taking task due to drawing concepts.
  • Gmail: mughalfahad544@gmail.com

License

This project is licensed under the MIT License - see the LICEMSE.md file for details.

About

This system provides the facility to convert roughly hand-drawn humam face sketch image on canvas into a realistic face image by using image generative AI in a real-time.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published