Skip to content

GDSC-DGU/2024-SolutionChallenge-earlips-frontend

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

Hits

๐Ÿ‘‹ Introduce team member

name major GDSC Email
HUICHAN SEO Computer Science LEAD gmlcks0513@dgu.ac.kr
HYEONJUNG HWANG Computer Science General ghkd4009@gmail.com
SEONHO LEE Multi Media Engineering Core retsgo01@gmail.com
EUNSEO LIM Imformation Comunication Engineering General eunseolim1018@naver.com


UN-SDGs that our solution is solving for

Our solution aims to provide hearing-impaired individuals with equal opportunities to express their thoughts freely through a pronunciation correction process. This process converts pronunciation into text for visual feedback, uses AI to detail areas needing improvement, and transforms the user's pronunciation into vibrations to provide tactile feedback. With our pronunciation correction process, we strive to eliminate the fear of speaking among the hearing-impaired and create a world where they can express their thoughts freely.

Our approach aligns with promoting inclusive education (SDG 4) and reducing inequalities (SDG 10). We aim to contribute to a more inclusive and equitable world where everyone can freely express their thoughts, enjoy quality education, and experience reduced inequalities.

Project Introduction

image

Architecture

image

โœจ Demo

โฌ‡๏ธ Click For Watch the video!

Watch the video

Our App APK

APK Download Link

Home Screen Learning Screen Phoneme Screen Word Screen
Home Screen ํ•™์ŠตํŽ˜์ด์ง€ ๋ฐœ์Œ๊ธฐํ˜ธ ๋‹จ์–ดํ•™์Šตํ•˜๊ธฐ

Home Screen : Pronunciation score and daily learning graphs
Learning Screen: Learning logs by date
Phoneme Screen : Visuals and guides for phoneme articulation
Word Screen : Features sound-to-vibration buttons , GIFs for pronunciation practice, interactive phoneme guides with Google's Gemini, detailed phoneme explanations, and voice recording with result review

Sentance Screen(fix) Paragraph Screen Script Screen live Screen(fix)
แ„†แ…ฎแ†ซแ„Œแ…กแ†ผแ„’แ…กแ†จแ„‰แ…ณแ†ธ แ„†แ…ฎแ†ซแ„ƒแ…กแ†ซแ„’แ…กแ†จแ„‰แ…ณแ†ธแ„’แ…กแ„€แ…ต แ„ƒแ…ขแ„‡แ…ฉแ†ซแ„†แ…กแ†ซแ„ƒแ…ณแ†ฏแ„€แ…ฉแ„€แ…งแ†ฏแ„€แ…ชแ„€แ…กแ†น แ„…แ…กแ„‹แ…ตแ„‡แ…ณ

Sentence Screen: Same layout as the Word Screen.
Paragraph Screen: Allows users to record their voice for a given script and receive feedback.
Script Screen: Users can write their own scripts and record their voice for feedback.
Live Screen: Displays the user's pronunciation in real time.

๐ŸŽฏ Commit Convention

  • feat: Add a new feature
  • fix: Bug fix
  • docs: Documentation updates
  • style: Code formatting, missing semicolons, cases where no code change is involved
  • refactor: Code refactoring
  • test: Test code, adding refactoring tests -hore: Build task updates, package manager updates

๐Ÿ’ก PR Convetion

์•„์ด์ฝ˜ ์ฝ”๋“œ ์„ค๋ช…
๐ŸŽจ :art Improving structure/format of the code
โšก๏ธ :zap Performance improvement
๐Ÿ”ฅ :fire Code/file deletion
๐Ÿ› :bug Bug fix
๐Ÿš‘ :ambulance Critical fix
โœจ :sparkles New features
๐Ÿ’„ :lipstick Adding/updating UI/style files
โช :rewind Reverting changes
๐Ÿ”€ :twisted_rightwards_arrows Branch merging
๐Ÿ’ก :bulb Adding/updating comments
๐Ÿ—ƒ :card_file_box Database-related modifications

Flutter Project Build Instructions

flutter pub get
flutter run

## If you encounter any issues in iOS build, follow these steps to clean your build cache for iOS
cd ios
rm Podfile.lock
rm Podfile
rm -rf Pods
pod cache clean --all
cd ..
flutter clean
flutter pub get
cd ios
pod install
flutter pub get
flutter run

## If you encounter any issues in Android build, follow these steps to clean your build cache for Android 
cd android
./gradlew clean
cd ..
flutter clean
flutter pub get
flutter run

๐Ÿ› ๏ธ Tech

Flutter Dart FastAPI Google Cloud Firebase http uuid PyMySQL Scikit-learn

โ˜๏ธ OpenSource

  • AI : openai/whisper-large-v3 (Hugging Face)
  • Flutter

๐Ÿ•ธ๏ธ Generative AI

  • AI : Gemini - We implemented a feature that uses Gemini to explain phonetic symbols in text