ABCDEFGHI
1
2
Task 1
3
Total teams:9
4
Total submissions:
26
5
TeamFileF1 ScorePrecisionRecall
6
UA
pp_0.65_10_3.csv
0.37150.41110.3389
7
UApp_0.7_9_2.csv0.37100.49670.2961
8
siatsiatrun1.txt0.36910.30050.4782
9
siatsiatrun3.txt0.36800.30260.4695
10
UApp_0.65_6.csv0.35590.36300.3492
11
siatsiatrun2.txt0.29640.25220.3595
12
LeiBirun_bm25.txt0.29230.30000.2850
13
LeiBi
run_weighting.txt
0.29170.26870.3191
14
JNLPrun3.txt0.28130.32110.2502
15
nigambm25P3M3.txt0.28090.25870.3072
16
JNLPrun2.txt0.27810.31440.2494
17
DSSRDSSR_01.txt0.26570.24470.2906
18
JNLPrun1.txt0.26390.24460.2866
19
DSSRDSSR_03.txt0.24610.22670.2692
20
TUWBRTUWBR_LM_law0.23670.18950.3151
21
LeiBi
run_clustering.txt
0.23060.23670.2249
22
TUWBRTUWBR_LM0.22060.16830.3199
23
nigam
sbertP3M3RS.txt
0.15420.14200.1686
24
nigam
s2vecP3M3RS.txt
0.14840.13670.1623
25
DSSRDSSR_02.txt0.13170.12130.1441
26
LLNTU
2022.task1.LLNTUtfidCos
0.00000.00000.0000
27
LLNTU
2022.task1.LLNTUtanadaT
0.00000.00000.0000
28
LLNTU
2022.task1.LLNTU3q4clii
0.00000.00000.0000
29
Uottawa
Task1Run3_UottawaLegalBert.txt
0.00000.00000.0000
30
Uottawa
Task1Run1_UottawaMB25.txt
0.00000.00000.0000
31
Uottawa
Task1Run2_UottawaSentTrans.txt
0.00000.00000.0000
32
33
34
Task 2
35
Total teams:5
36
Total submissions:
14
37
TeamFileF1 ScorePrecisionRecall
38
NM
monot5-ensemble.txt
0.67830.69640.6610
39
NMmonot5-3b.txt0.67570.72120.6356
40
JNLP
run2_bert_amr_remove_reduntdant_filter.txt
0.66940.65320.6864
41
JNLP
run3_bert_BM25.txt
0.66120.64520.6780
42
jljyrun2_task2.txt0.65140.71000.6017
43
jljyrun3_task2.txt0.65140.71000.6017
44
JNLP
run1_bert_amr_remove_reduntdant.txt
0.64520.61540.6780
45
jljyrun1_task2.txt0.63300.69000.5847
46
NM
monot5-base.txt
0.63250.63790.6271
47
UA
res_score-0.95_max-1.txt
0.54460.61050.4915
48
UA
res_score-0.5_max-1.txt
0.53630.78690.4068
49
UA
res_score-0.95_max-5.txt
0.41210.30490.6356
50
nigambm25EF.txt0.32040.19800.8390
51
nigambm25BC.txt0.21040.13000.5508
52
53
54
Task 3
55
Total teams:5
56
Total submissions:
15
57
TeamsidF2PrecRecallMAPR_5R_10R_30
58
HUKBHUKB20.82040.81800.84050.84310.84730.87790.9466
59
HUKBHUKB10.79080.65320.89010.87250.89310.90840.9618
60
OVGUOVGU_run30.77900.77810.80540.83640.83210.87790.9389
61
OVGUOVGU_run10.77320.77450.79620.81670.85500.88550.9466
62
OVGUOVGU_run20.77180.77320.80080.82720.82440.87020.9466
63
JNLP
JNLP.longformer
0.76990.68650.83780.79340.83970.91600.9618
64
JNLP
JNLP.electra_longformer
0.76770.63860.86250.76290.80150.80150.8015
65
JNLP
JNLP.electra_legal
0.76700.63560.86070.80880.83970.90840.9618
66
UAUA_TFIDF20.76380.80730.76410.82870.82440.85500.9084
67
UAUA_TFIDF10.76070.81650.75490.82870.82440.85500.9084
68
UAUA_BM250.75660.81650.75030.82680.80920.86260.9237
69
HUKBHUKB30.75120.78900.75340.83030.85500.89310.9542
70
LLNTULLNTU0066cc0.64160.67430.63910.70000.72520.74050.7634
71
LLNTULLNTUffd700**0.59750.38230.71210.64320.71760.74810.7939
72
LLNTULLNTUffcc000.57980.37160.69220.62950.70230.73280.7786
73
74
75
Task 4
76
Total teams:6
77
Total submissions:
18
78
TeamsidCorrectAccuracy
Total questions:
109
79
-BaseLine580.5321
80
LLNTULLNTUmojCraw1070.9817
Submission not accepted as it relies on external data sources
81
KISKIS2740.6789
82
HUKBHUKB1730.6697
83
KISKIS1720.6606
84
KISKIS3720.6606
85
HUKBHUKB2690.6330
86
HUKBHUKB3690.6330
87
LLNTU
LLNTUdeNgram
660.6055
88
LLNTULLNTUdiffSim630.5780
89
OVGUOVGU3630.5780
90
UAUA_e590.5413
91
UAUA_r590.5413
92
UAUA_structure590.5413
93
JNLPJNLP1580.5321
94
JNLPJNLP2580.5321
95
OVGUOVGU2580.5321
96
JNLPJNLP3560.5138
97
OVGUOVGU1520.4771