Skip to content
This repository has been archived by the owner on Mar 4, 2021. It is now read-only.

otter18/nti2021-ai-semi-final

Repository files navigation

Russian Multi-Sentence Reading Comprehension Task

A solutions for NTI Contest by @otter18

Description

  • bert_base_multilingual_cased.ipynb - simpletransformers.ClassificationModel
  • RuBERT.ipynb - RuBERT model (code is similar to bert_base_multilingual_cased.ipynb)
  • sentence_RuBERT.ipynb - sentence_RuBERT model (code is similar to bert_base_multilingual_cased.ipynb)
  • bert&pytorch.ipynb - custom nn.Module with BertTokenizer and linear layer
  • sberbank_ai_gpt3.ipynb - unsuccessful (so far) attempt to use sberbank-ai/rugpt3small_based_on_gpt2 model

Tools developed for this project

  • tg_logger (useful for Google Colab because it resets the VM frequently), [pypi], [repo]