Understanding Human Preferences for Summary Designs in Online Debates Domain

Abstract

Research on automatic text summarization has primarily focused on summarizing news, web pages, scientific papers, etc. While in some of these text genres, it is intuitively clear what constitutes a good summary, the issue is much less clear cut in social media scenarios like online debates, product reviews, etc., where summaries can be presented in many ways. As yet, there is no analysis about which summary representation is favored by readers. In this work, we empirically analyze this question and elicit readers' preferences for the different designs of summaries for online debates. Seven possible summary designs in total were presented to 60 participants via an online study. Participants were asked to read and assign preference scores to each summary design. The results indicated that the combination of Chart Summary and Side-By-Side Summary is the most preferred summary design. This finding is important for future work in automatic text summarization of online debates.

Keywords: summary design, automatic summarization, summary representation, text mining, information extraction

References

Download paper (PDF) Download BibTeX

@article{2016_Sanchan_Bontcheva_Aker,
  author    = {Sanchan, Nattapong and Bontcheva, Kalina and Aker, Ahmet},
  title     = {Understanding Human Preferences for Summary Designs in Online Debates Domain},
  journal   = {Polibits},
  volume    = {54},
  pages     = {79--85},
  year      = {2016},
  doi       = {10.17562/PB-54-10},
  url       = {http://dx.doi.org/10.17562/PB-54-10}
}

Sanchan, N., Bontcheva, K., and Aker, A. (2016). Understanding Human Preferences for Summary Designs in Online Debates Domain. Polibits, 54:79–85.

More information

The corpus used in this paper is related to the climate change domain — the story behind this domain can be found in this article.

This paper is a continuing work in the Domain-Focused Summarization of Polarized Debates project:

1. Understanding Human Preferences for Summary Designs in Online Debates Domain
2. Gold Standard Online Debates Summaries and First Experiments Towards Automatic Summarization of Online Debate Data
3. Automatic Summarization of Online Debates
4. An Adoption of a Contradiction Detection Task to Assist the Summarization of Online Debates