Home

The FactA task at EVALITA 2016 aims at providing a complete evaluation framework for event factuality profiling, a crucial aspect of event interpretation. An event reported in a text can be interpreted as factual (i.e. the event took place), counterfactual (i.e. the event did not take place) or non-factual (i.e. the event is speculative).
The factuality value of an event results from three aspects, i.e. the certainty of the source, the time of the event, and its polarity.

Examples:


The Main Task of FactA focuses on the newswire domain; the training and test datasets are both composed of news articles. In addition to this, we also propose a Pilot Task on factuality profiling on social media texts (in particular, Tweets).

ANNOUNCEMENTS

  • Test data available
    Test data have been distributed to registered participants.
    Posted Sep 14, 2016, 2:29 AM by Manuela Speranza
  • Technical reports submission
    New date for the submission of the technical reports: October 19th.
    Posted Jul 13, 2016, 8:17 AM by Anne-Lyse Minard
  • Training data available
    The training data for FactA have been released. Also the annotation guidelines and an updated version of the task guidelines have been released
    Posted Jun 9, 2016, 7:47 AM by Manuela Speranza
  • Task Guidelines
    The official task guidelines are now available on the Documentation page.
    Posted May 6, 2016, 9:05 AM by Anne-Lyse Minard
  • Call for Interest
    The Evalita Call for Interest is open. Please visit the EVALITA web site for more information, and indicate your intention to participate before April 20th 2016, by filling out the form at: http://www.evalita.it/2016/CFI
    Posted Apr 1, 2016, 12:43 AM by Manuela Speranza
Showing posts 1 - 5 of 5. View more »

IMPORTANT DATES

April 1st, 2016
Call for Interest opens
April 20th, 2016
Call for Interest closes
May 15th, 2016
Online registration opens 
May 30th, 2016
Development data available to participants
September 12th, 2016
Test data available, registration closes
September 19th, 2016
System results due to organizers
September 26th, 2016
Assessment returned to participants
October 19th, 2016
Technical reports due to organizers
December 7th, 2016
Final workshop (after CLIC-2016)