Difference between ATEPC models

[kerolzeeq]

Hello, I'm a bit curious and I have 2 questions on the ATEPC models.

1. What's the difference and similarities between LCF-ATEPC model and FAST-LCF-ATEPC model?

2. What's the difference and similarities between the normal LCF-ATEPC model and LCFS-ATEPC model?

[yangheng95]

They basicly share the samilar architectures.
The fast* model use one bert for global and local context, and only forward once.
The *s models use syntax-based SRD
See ref: https://www.sciencedirect.com/science/article/pii/S0925231220312534
https://aclanthology.org/2020.acl-main.293/

[kerolzeeq]

Understood. Thanks a lot!

[cheng940929]

They basicly share the samilar architectures. The fast* model use one bert for global and local context, and only forward once. The *s models use syntax-based SRD See ref: https://www.sciencedirect.com/science/article/pii/S0925231220312534 https://aclanthology.org/2020.acl-main.293/

Plus, is *s models way better than standard lcf-atepc?

[ghost]

Plus, is *s models way better than standard lcf-atepc?

I would like to know too!
What do you recommend to use *s models for?

[yangheng95]

It is recommanded to use *s models for English language. Generally, *s models are not necessary for large dataset.

[ghost]

Where do I find and how do I initialise the *s models? available_checkpoints(show_ckpts=True) only shows one checkpoint per language for APC:

{'multilingual': {'id': '',
  'Training Model': 'FAST-LSA-T-V2-Deberta',
  'Training Dataset': 'APCDatasetList.Multilingual',
  'Language': 'Multilingual',
  'Description': 'Trained on RTX3090',
  'Available Version': '1.10.5+',
  'Checkpoint File': 'fast_lcf_bert_Multilingual_acc_87.18_f1_83.11.zip',
  'Author': 'H, Yang (hy345@exeter.ac.uk)'},
 'multilingual2': {'id': '',
  'Training Model': 'FAST-LSA-T-V2-Deberta',
  'Training Dataset': 'APCDatasetList.Multilingual',
  'Language': 'Multilingual',
  'Description': 'Trained on RTX3090',
  'Available Version': '1.10.5+',
  'Checkpoint File': 'fast_lcf_bert_Multilingual_acc_82.66_f1_82.06.zip',
  'Author': 'H, Yang (hy345@exeter.ac.uk)'},
 'english': {'id': '',
  'Training Model': 'FAST-LSA-T-V2-Deberta',
  'Training Dataset': 'APCDatasetList.English',
  'Language': 'English',
  'Description': 'Trained on RTX3090',
  'Available Version': '1.10.5+',
  'Checkpoint File': 'fast_lsa_t_v2_English_acc_82.21_f1_81.81.zip',
  'Author': 'H, Yang (hy345@exeter.ac.uk)'},
 'chinese': {'id': '',
  'Training Model': 'FAST-LSA-T-V2-Deberta',
  'Training Dataset': 'APCDatasetList.Chinese',
  'Language': 'Chinese',
  'Description': 'Trained on RTX3090',
  'Available Version': '1.10.5+',
  'Checkpoint File': 'fast_lsa_t_v2_Chinese_acc_96.0_f1_95.1.zip',
  'Author': 'H, Yang (hy345@exeter.ac.uk)'}}