Leaderboard

Leaderboards on Development set

Task SI

RankTeamF1PrecisionRecall
1PALI0.523490.496440.55365
2ApplicaAI0.509110.420420.64523
3aschern0.499900.445280.56978
4Hitachi0.486140.429440.56009
5TTUI0.451860.402450.51510
6LTIatCMU0.443750.434580.45332
7YNUtaoxin0.443240.428230.45933
8Fragarach0.442720.416810.47207
9UESTCICSA0.441730.432080.45183
10UPB0.435930.343310.59697
11FakeSolomon0.428610.432380.42490
12SWEAT0.425090.429730.42055
13NoPropaganda0.424100.415060.43354
14YNUHPCC0.422730.320820.61954
15DREAM0.421500.426620.41650
16newsSweeper0.407360.438290.38050
17TakeLab0.390610.388500.39273
18syrapropa0.390110.379120.40177
19SkoltechNLP0.367000.349900.38586
20WMD0.363380.332550.40051
21atulcst0.362910.381450.34610
22CyberWallE0.359980.264520.56325
23LS0.354930.224070.85331
24AAA0.346800.306060.40004
25UTMNandOCAS0.343450.236510.62690
26NLFIIT0.329790.233600.56061
27NTUAAILS0.312130.279460.35346
28CUNLP0.277810.582310.18242
29Murgila0.257350.183890.42851
30HunAlize0.244510.377530.18080
31BPGC0.235310.251870.22079
32UniversityOfBirmingham0.169470.230740.13391
33PsuedoProp0.061640.122420.04119
34Baseline0.011020.110040.00580
35SocCogCom0.007860.099660.00409
36Inno0.006380.093610.00330
37Raghavan0.004030.002030.33445
38California0.003890.059190.00201
Note that the gold labels for the task SI can de extracted from the input files for task TC.
This will not be the case for the test set, since we will release the input data for task TC after closing the submissions for task SI.
Submissions to task SI using the gold labels for task TC will not be accepted and the team might be disqualified.

Task TC

RankTeamF1F1 Appeal_to_AuthorityF1 Appeal_to_fear-prejudiceF1 Bandwagon,Reductio_ad_hitlerumF1 Black-and-White_FallacyF1 Causal_OversimplificationF1 DoubtF1 Exaggeration,MinimisationF1 Flag-WavingF1 Loaded_LanguageF1 Name_Calling,LabelingF1 RepetitionF1 SlogansF1 Thought-terminating_ClichesF1 Whataboutism,Straw_Men,Red_Herring
1PALI0.666980.416670.409090.750000.355560.400000.578130.486110.788240.781300.762150.615940.583330.457140.27027
2aschern0.662280.400000.404490.500000.285710.279070.657340.552630.769230.791600.732980.553030.666670.333330.32653
3Hitachi0.651930.125000.369570.750000.222220.500000.629630.565790.813950.779910.711590.469750.676060.190480.40909
4FakeSolomon0.645340.181820.363640.888890.210530.350000.558820.452050.738850.757000.746110.666670.531250.285710.12121
5CyberWallE0.625590.083330.252630.500000.148150.360000.491800.441180.720000.738870.730990.686750.550720.352940.15789
6syrapropa0.625590.190480.336450.333330.157890.390240.517480.513890.762500.754050.721130.591640.563380.105260.06452
7Fragarach0.604890.142860.409090.571430.129030.340430.510340.506850.741180.771190.704960.382110.457140.166670.06061
8Inno0.601130.117650.408160.615380.357140.341460.528570.437500.779660.765650.706200.346670.597010.181820.15385
9Duth0.578550.095240.344090.500000.111110.428570.487180.461540.644300.761220.703200.230770.553850.153850.11111
10NLFIIT0.576670.000000.179490.500000.000000.190480.476680.440680.713450.747990.724410.275860.354840.000000.00000
11UESTCICSA0.575730.000000.387100.000000.000000.266670.464790.396550.632260.741480.650410.483660.588240.363640.09524
12Entropy0.571030.133330.311110.000000.181820.292680.535950.451610.748540.752190.664990.281940.468750.200000.10000
13UPB0.571030.111110.354170.571430.083330.250000.431140.496240.720500.731520.708230.134720.515150.000000.00000
14SocCogCom0.570090.000000.329110.571430.214290.285710.539880.456690.771080.706480.643800.317760.301890.129030.06452
15DiSaster0.569140.000000.309520.000000.000000.304350.494250.460530.726190.706960.696810.278850.531250.000000.00000
16TTUI0.563500.083330.378950.000000.064520.307690.508670.412120.753090.713900.698320.277510.450000.000000.00000
17YNUHPCC0.561620.125000.260870.545450.285710.260870.557140.365220.719510.694550.700270.237440.424240.250000.20513
18JUST0.539040.000000.340000.000000.250000.434780.444440.388060.705130.702780.588520.372470.406250.307690.14634
19Murgila0.535280.176470.224720.444440.133330.300000.372880.425530.695120.712100.661380.245450.405800.315790.22642
20NTUAAILS0.532460.066670.213330.444440.071430.171430.516130.436360.730340.697610.598980.271930.271190.000000.08000
21WMD0.523050.190480.268290.400000.000000.068970.397660.351150.630950.715670.577020.400000.156860.000000.00000
22BPGC0.504230.000000.285710.000000.000000.117650.485550.339620.716580.661920.548910.073620.259260.111110.00000
23CUNLP0.486360.000000.297030.000000.166670.130430.439020.358970.540230.655910.555560.236450.307690.000000.00000
24hseteam0.413950.000000.111110.428570.072730.076920.262860.322580.575160.636490.428150.224000.266670.000000.04762
25HunAlize0.410160.000000.092310.000000.000000.333330.411760.222220.535030.561300.407520.053190.000000.000000.00000
26UMSIForeseer0.396990.000000.098040.000000.205130.259260.315070.243590.693640.538840.552880.148440.237290.000000.00000
27SWEAT0.305740.000000.000000.000000.000000.000000.000000.000000.000000.468300.000000.000000.000000.000000.00000
28Baseline0.265290.000000.093750.000000.000000.072290.192000.116790.082760.405800.000000.384980.000000.000000.00000
29LS0.262330.000000.090910.000000.000000.087910.196720.129500.082760.391960.000000.393090.000000.062500.00000
30SkoltechNLP0.262330.000000.090910.000000.000000.087910.196720.129500.082760.391960.000000.393090.000000.062500.00000
31TakeLab0.253060.000000.000000.000000.000000.000000.064260.000000.000000.429160.246970.013700.000000.000000.00000
Scroll the table to the right to check the F1 values for each Technique.


Note that the leaderboard is updated every 20 minutes, therefore your submission may not be listed right away.

Organisers

  • Giovanni Da San Martino, Qatar Computing Research Institute
  • Alberto Barrón-Cedeño, University of Bologna
  • Preslav Nakov, Qatar Computing Research Institute
  • Henning Wachsmuth, Paderborn University
  • Rostislav Petrov, A Data Pro

Contact