Thinking beyond event extraction is at the heart of the research being carried out at NewsReader. To assess and advance the state of the art in ordering events, we are organising a SemEval shared task around creating TimeLines. Specifically, SemEval-2015 Task 4: TimeLine: Cross-Document Event Ordering (pilot task). We have made available a set of annotated documents with associated events and timelines for participants to develop a temporal event ordering system on. During the SemEval evaluation period (5 – 20 December 2014), we…