Skip to content

Retrieval Augmented Generation (RAG) based Chatbot developed for the Lightning Fast AI Hackathon

License

Notifications You must be signed in to change notification settings

Ashish-Soni08/PillPal

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

60 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

PillPal💊

PillPal_Logo

Problem Statement

Have you ever come across the thin piece of folded paper that is part of every drug prescription box. Usually the text is in very small print and typically provides information about dosages, side effects, storage instructions and much more. They are hard to read and understand and requires some effort to get answers to common questions that you as a patient might have.

Solution

Create a product that answers these questions and actually makes the medical information more accessible and easier to understand - enter PillPal💊

A Retrieval Augmented Generation (RAG) based chatbot that answers questions based on the PDF document.

Environement Setup

python -V
# Output: Python 3.12.1
# create a environment named -> samba-ai
python -m venv samba-ai
# activate the environment
source samba-ai/bin/activate
# deactivate the virtual environment
deactivate
# create a Jupyter Notebook kernel
pip install jupyter ipykernel
# add the virtual environment as a kernel for the jupyter notebook
python -m ipykernel install --user --name=samba-ai --display-name="Py3.12-samba-ai"
# verify kernel installation
jupyter kernelspec list
jupyter kernelspec uninstall samba-ai

ARCHITETURE OF THE APPLICATION

DATA SOURCES

MODEL PROVIDERS

SambaNova Cloud

EMBEDDING MODEL

  • Model ID: jina-embeddings-v3
  • Developed by: JINA AI
  • Max Input Tokens: 8192
  • Max Output Dimensions: 1024
  • Model Card
  • LlamaIndex Docs

RERANK MODEL

GROQ

  • Model ID: llama-guard-3-8b
  • Developed by: META
  • Context Window: 8,192 tokens
  • Model Card
  • Groq Docs

Built for

Lightning Fast AI Hackathon

Hackathon_Banner

Resources

Ideal Chunk Size of a RAG System

Metadata Customization

export PYTHONPATH=$(pwd)
gradio frontend/app.py --demo-name=pillpal_bot

About

Retrieval Augmented Generation (RAG) based Chatbot developed for the Lightning Fast AI Hackathon

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published