Leaderboard

Leaderboards on Development set

Task SI

RankTeamF1PrecisionRecall
1Hitachi0.4482620.4091030.495712
2UESTCICSA0.3992400.4415240.364347
3Fragarach0.3971140.3291660.500413
4syrapropa0.3901140.3791150.401769
5LS0.3549330.2240670.853305
6Baseline0.0078620.0996630.004092
7SocCogCom0.0078620.0996630.004092
8WMD0.0078620.0996630.004092
9Raghavan
Note that the gold labels for the task SI can de extracted from the input files for task TC.
This will not be the case for the test set, since we will release the input data for task TC after closing the submissions for task SI.
Submissions to task SI using the gold labels for task TC will not be accepted and the team might be disqualified.

Task TC

RankTeamF1PrecisionRecallF1 Appeal_to_AuthorityF1 Appeal_to_fear-prejudiceF1 Bandwagon,Reductio_ad_hitlerumF1 Black-and-White_FallacyF1 Causal_OversimplificationF1 DoubtF1 Exaggeration,MinimisationF1 Flag-WavingF1 Loaded_LanguageF1 Name_Calling,LabelingF1 RepetitionF1 SlogansF1 Thought-terminating_ClichesWhataboutism,Straw_Men,Red_Herring
1Hitachi0.6046510.6046510.6046510.00.340.28571428571428570.148148148148148170.368421052631578870.56250000000000010.42748091603053440.78453038674033140.75328083989501320.69586374695863750.28723404255319150.57142857142857140.142857142857142850.1212121212121212
2syrapropa0.5748840.5748840.5748840.20.309278350515463930.00.133333333333333330.28571428571428570.5029940119760480.44736842105263160.76744186046511630.7438016528925620.6905370843989770.234234234234234230.53521126760563390.00.0
3SocCogCom0.5265120.5265120.5265120.00.36559139784946240.00.00.064516129032258080.45962732919254660.311475409836065530.70520231213872830.68930817610062890.60714285714285710.295358649789029540.095238095238095230.083333333333333330.0
4hseteam0.3665120.3665120.3665120.00.00.00.00.00.06315789473684210.0481927710843373450.484374999999999940.52268907563025210.30034129692832770.036809815950920240.00.00.0
5Baseline0.2623260.2623260.2623260.00.090909090909090910.00.00.087912087912087920.19672131147540980.12949640287769780.082758620689655170.391959798994974850.00.39308855291576670.00.06250.0
6LS0.2623260.2623260.2623260.00.090909090909090910.00.00.087912087912087920.19672131147540980.12949640287769780.082758620689655170.391959798994974850.00.39308855291576670.00.06250.0
7UESTCICSA0.2623260.2623260.2623260.00.090909090909090910.00.00.087912087912087920.19672131147540980.12949640287769780.082758620689655170.391959798994974850.00.39308855291576670.00.06250.0
Scroll the table to the right to check the F1 values for each Technique.


Note that the leaderboard is updated every 20 minutes, therefore your submission may not be listed right away.

Organisers

  • Giovanni Da San Martino, Qatar Computing Research Institute
  • Alberto Barrón-Cedeño, University of Bologna
  • Preslav Nakov, Qatar Computing Research Institute
  • Henning Wachsmuth, Paderborn University
  • Rostislav Petrov, A Data Pro

Contact