Using full-text content to characterize and identify best seller books: A study of early 20th-century literature

PLoS One. 2024 Apr 26;19(4):e0302070. doi: 10.1371/journal.pone.0302070. eCollection 2024.

Abstract

Artistic pieces can be studied from several perspectives, one example being their reception among readers over time. In the present work, we approach this interesting topic from the standpoint of literary works, particularly assessing the task of predicting whether a book will become a best seller. Unlike previous approaches, we focused on the full content of books and considered visualization and classification tasks. We employed visualization for the preliminary exploration of the data structure and properties, involving SemAxis and linear discriminant analyses. To obtain quantitative and more objective results, we employed various classifiers. Such approaches were used along with a dataset containing (i) books published from 1895 to 1923 and consecrated as best sellers by the Publishers Weekly Bestseller Lists and (ii) literary works published in the same period but not being mentioned in that list. Our comparison of methods revealed that the best-achieved result-combining a bag-of-words representation with a logistic regression classifier-led to an average accuracy of 0.75 both for the leave-one-out and 10-fold cross-validations. Such an outcome enhances the difficulty in predicting the success of books with high accuracy, even using the full content of the texts. Nevertheless, our findings provide insights into the factors leading to the relative success of a literary work.

Publication types

  • Historical Article
  • Research Support, Non-U.S. Gov't

MeSH terms

  • Books* / history
  • History, 20th Century
  • Humans
  • Literature / history

Grants and funding

G. D. da S. acknowledges São Paulo Research Foundation (FAPESP) from Brazil for sponsorship (grant no. 2021/01744-0). B. C. e S. acknowledges Coordination for the Improvement of Higher Education (CAPES) from Brazil for sponsorship Finance Code 001. L. da F. C. thanks Brazilian National Council for Scientific and Technological Development (CNPq) (grant no. 307085/2018-0) and São Paulo Research Foundation (FAPESP) (grant grant 15/22308-2). D. R. A. acknowledges financial support from Brazilian National Council for Scientific and Technological Development (CNPq) (grant no. 311074/2021-9) and São Paulo Research Foundation (FAPESP) (grant no. 2020/06271-0). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.