This notebook is about using distilbert model for fake news detection task.
Distilbert-base-uncased finetuned on the fake news dataset with below Hyperparameters
learning rate 5e-5,
batch size 32,
num_train_epochs=2,
Model uploaded @ DistilBert-FakeNews
Dataset available @ Fake News dataset