EDNIL (2020)

Event Detection from News in Indian Languages

Evaluation

Task 1 will be evaluated using F1 score as it is a classification task.
In Task 2 the F1 score of individual arguments will be taken into consideration and then it will be averaged out. The strings that are an exact match will only be considered as True.
For example: If the PLACE argument in Test data is New Delhi and the output of the PLACE argument for test data by the participant’s method is Delhi then it won’t be considered a match.
The evaluation of all the five languages will be done separately.