-
Notifications
You must be signed in to change notification settings - Fork 1
/
log.txt
132 lines (92 loc) · 4.06 KB
/
log.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
tf-idf
Corpus 1:
Overall accuracy: 0.817156
Cri Dis Oth Pol Str
Precision 0.780000 0.955056 0.48 0.736111 0.888889
Recall 0.886364 0.913978 0.80 0.848000 0.722892
F-1 0.829787 0.934066 0.60 0.788104 0.797342
Support 44.000000 93.000000 15.00 125.000000 166.000000
Corpus 2:
Overall accuracy: 0.788591
I O
Precision 0.626374 0.859903
Recall 0.662791 0.839623
F-1 0.644068 0.849642
Support 86.000000 212.000000
Corpus 3:
Overall accuracy: 0.908805
Ent Fin Sci Spo USN Wor
Precision 0.666667 0.880952 0.868421 1.0 0.876543 0.957265
Recall 0.800000 0.860465 0.846154 1.0 0.887500 0.949153
F-1 0.727273 0.870588 0.857143 1.0 0.881988 0.953191
Support 10.000000 43.000000 39.000000 28.0 80.000000 118.000000
------------------------------
GloVe (pre-trained)
Corpus 1:
Overall accuracy: 0.866817
Cri Dis Oth Pol Str
Precision 0.780000 0.977528 0.600000 0.840278 0.903704
Recall 0.886364 0.956044 0.789474 0.883212 0.802632
F-1 0.829787 0.966667 0.681818 0.861210 0.850174
Support 44.000000 91.000000 19.000000 137.000000 152.000000
Corpus 2:
Overall accuracy: 0.802013
I O
Precision 0.527473 0.922705
Recall 0.750000 0.816239
F-1 0.619355 0.866213
Support 64.000000 234.000000
Corpus 3:
Overall accuracy: 0.823899
Ent Fin Sci Spo USN Wor
Precision 0.666667 0.904762 0.710526 0.928571 0.777778 0.854701
Recall 0.615385 0.775510 0.794118 1.000000 0.741176 0.900901
F-1 0.640000 0.835165 0.750000 0.962963 0.759036 0.877193
Support 13.000000 49.000000 34.000000 26.000000 85.000000 111.000000
------------------------------
fastText (pre-trained)
Corpus 1:
Overall accuracy: 0.862302
Cri Dis Oth Pol Str
Precision 0.840000 0.955056 0.640000 0.805556 0.911111
Recall 0.893617 0.965909 0.842105 0.892308 0.773585
F-1 0.865979 0.960452 0.727273 0.846715 0.836735
Support 47.000000 88.000000 19.000000 130.000000 159.000000
Corpus 2:
Overall accuracy: 0.812081
I O
Precision 0.582418 0.913043
Recall 0.746479 0.832599
F-1 0.654321 0.870968
Support 71.000000 227.000000
Corpus 3:
Overall accuracy: 0.871069
Ent Fin Sci Spo USN Wor
Precision 0.666667 0.880952 0.710526 0.928571 0.864198 0.931624
Recall 0.615385 0.860465 0.818182 1.000000 0.795455 0.947826
F-1 0.640000 0.870588 0.760563 0.962963 0.828402 0.939655
Support 13.000000 43.000000 33.000000 26.000000 88.000000 115.000000
------------------------------
word2vec
Corpus 1:
Overall accuracy: 0.841986
Cri Dis Oth Pol Str
Precision 0.800000 0.955056 0.520000 0.770833 0.918519
Recall 0.930233 0.894737 0.812500 0.888000 0.756098
F-1 0.860215 0.923913 0.634146 0.825279 0.829431
Support 43.000000 95.000000 16.000000 125.000000 164.000000
Corpus 2:
Overall accuracy: 0.805369
I O
Precision 0.626374 0.884058
Recall 0.703704 0.843318
F-1 0.662791 0.863208
Support 81.000000 217.000000
Corpus 3:
Overall accuracy: 0.849057
Ent Fin Sci Spo USN Wor
Precision 0.500000 0.880952 0.789474 0.821429 0.851852 0.897436
Recall 0.352941 0.840909 0.769231 0.958333 0.821429 0.954545
F-1 0.413793 0.860465 0.779221 0.884615 0.836364 0.925110
Support 17.000000 44.000000 39.000000 24.000000 84.000000 110.000000
------------------------------