Skip to content

Commit

Permalink
Update semantic_role_labeling.md (#628)
Browse files Browse the repository at this point in the history
  • Loading branch information
yuanheTian authored Jun 23, 2024
1 parent d35079b commit 1e7b8a5
Showing 1 changed file with 15 additions and 2 deletions.
17 changes: 15 additions & 2 deletions english/semantic_role_labeling.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,12 +14,25 @@ Example:

Models are typically evaluated on the [OntoNotes benchmark](http://www.aclweb.org/anthology/W13-3516) based on F1.

| Model | F1 | Paper / Source |
| ------------- | :-----:| --- |
| Model | F1 | Paper / Source | Code |
| ------------- | :-----:| --- | --- |
| Tian et al., (2022) + XLNet | 87.67 | [Syntax-driven Approach for Semantic Role Labeling](https://aclanthology.org/2022.lrec-1.772/) | [Official](https://github.com/synlp/SRL-MM) |
| He et al., (2018) + ELMO | 85.5 | [Jointly Predicting Predicates and Arguments in Neural Semantic Role Labeling](http://aclweb.org/anthology/P18-2058) |
| (He et al., 2017) + ELMo (Peters et al., 2018) | 84.6 | [Deep contextualized word representations](https://arxiv.org/abs/1802.05365) |
| Tan et al. (2018) | 82.7 | [Deep Semantic Role Labeling with Self-Attention](https://arxiv.org/abs/1712.01586) |
| He et al. (2018) | 82.1 | [Jointly Predicting Predicates and Arguments in Neural Semantic Role Labeling](http://aclweb.org/anthology/P18-2058) |
| He et al. (2017) | 81.7 | [Deep Semantic Role Labeling: What Works and What’s Next](http://aclweb.org/anthology/P17-1044) |

### CoNLL-2005

Models are typically evaluated on the [CoNLL-2005 dataset](https://www.cs.upc.edu/~srlconll/soft.html) based on F1.

| Model | F1 | Paper / Source | Code |
| ------------- | :-----:| --- | --- |
| Tian et al., (2022) + XLNet | 89.80 | [Syntax-driven Approach for Semantic Role Labeling](https://aclanthology.org/2022.lrec-1.772/) | [Official](https://github.com/synlp/SRL-MM) |
| He et al., (2018) + ELMO | 87.4 | [Jointly Predicting Predicates and Arguments in Neural Semantic Role Labeling](http://aclweb.org/anthology/P18-2058) |
| He et al. (2018) | 83.9 | [Jointly Predicting Predicates and Arguments in Neural Semantic Role Labeling](http://aclweb.org/anthology/P18-2058) |
| Tan et al. (2018) | 82.9 | [Deep Semantic Role Labeling with Self-Attention](https://arxiv.org/abs/1712.01586) |
| He et al. (2017) | 81.5 | [Deep Semantic Role Labeling: What Works and What’s Next](http://aclweb.org/anthology/P17-1044) |

[Go back to the README](../README.md)

0 comments on commit 1e7b8a5

Please sign in to comment.