Dr. Christian M. Meyer

Bridging the gap between extractive
and abstractive summaries:

Creation and evaluation of coherent extracts from heterogeneous sources

Abstract. Coherent extracts are a novel type of summary combining the advantages of manually created abstractive summaries, which are fluent but difficult to evaluate, and low-quality automatically created extractive summaries, which lack coherence and structure. We use a corpus of heterogeneous documents to address the issue that in­for­ma­tion seekers usually face – a variety of different types of in­for­ma­tion sources. We directly extract in­for­ma­tion from these, but minimally redact and meaningfully order it to form a coherent text. Our qualitative and quantitative evaluations show that quantitative results are not sufficient to judge the quality of a summary and that other quality criteria, such as coherence, should also be taken into account. We find that our manually created corpus is of high quality and that it has the potential to bridge the gap between reference corpora of abstracts and automatic methods producing extracts. Our corpus is available to the research community for further development.

Submitted: 15.07.2016 | Published: 13.12.2016
Boxplot of our qualitative judgments.
Boxplot of our qualitative judgments.