aneesh-aparajit / fedGPT Public

Notifications You must be signed in to change notification settings
Fork 1
Star 4

An implementation of training nanoGPT through Federated Learning and implementing Differential Privacy

4 stars 1 fork Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 19 Commits
conf		conf
data/legal		data/legal
fedGPT		fedGPT
nbs		nbs
.gitignore		.gitignore
LICENSE		LICENSE
README.md		README.md
main.py		main.py
requirements.txt		requirements.txt
setup.py		setup.py

Repository files navigation

fedGPT

An implementation of training nanoGPT through Federated Learning and implementing Differential Privacy

Todo

Datasets
- IID
- Non-IID (with LDA partition)

Sources of Dataset

Legal Dataset: https://www.kaggle.com/datasets/ananyapam7/legalai
Multilingual Dataset: HuggingFace Oscar Dataset

About

An implementation of training nanoGPT through Federated Learning and implementing Differential Privacy

text-generation gpt differential-privacy federated-learning

Report repository

Releases

No releases published

Packages

No packages published

Languages