Open Knowledge Extraction Challenge 2017

Speck, René; Röder, Michael; Oramas, Sergio; Espinosa-Anke, Luis; Ngonga Ngomo, Axel-Cyrille

doi:http://dx.doi.org/10.1007/978-3-319-69146-6_4

Open Knowledge Extraction Challenge 2017

Citation

Speck R, Röder M, Oramas S, Espinosa-Anke L, Ngonga Ngomo AC. Open Knowledge Extraction Challenge 2017. In: Semantic Web Challenges. 4th SemWebEval Challenge at ESWC 2017; 2017 May 28-Jun 1; Portoroz, Slovenia. p. 35-48. DOI: 10.1007/978-3-319-69146-6_4

Abstract

The Open Knowledge Extraction Challenge invites researchers and practitioners from academia as well as industry to compete to the aim of pushing further the state of the art of knowledge extraction from text for the Semantic Web. The challenge has the ambition to provide a reference framework for research in this field by redefining a number of tasks typically from information and knowledge extraction by taking into account Semantic Web requirements and has the goal to test the performance of knowledge extraction systems. This year, the challenge goes in the third round and consists of three tasks which include named entity identification, typing and disambiguation by linking to a knowledge base depending on the task. The challenge makes use of small gold standard datasets that consist of manually curated documents and large silver standard datasets that consist of automatically generated synthetic documents. The performance measure of a participating system is twofold base on (1) Precision, Recall, F1-measure and on (2) Precision, Recall, F1-measure with respect to the runtime of the system.