Impact assessment of the rational selection of training and test sets on the predictive ability of QSAR models

SAR QSAR Environ Res. 2017 Dec;28(12):1011-1023. doi: 10.1080/1062936X.2017.1397056. Epub 2017 Nov 14.

Abstract

This study performed an analysis of the influence of the training and test set rational selection on the quality and predictively of the quantitative structure-activity relationship (QSAR) model. The study was carried out on three different datasets of Influenza Neuraminidase (H1N1) inhibitors. The three datasets were divided into training and test sets using three rational selection methods: based on k-means, Kennard-Stone algorithm and Activity and the results were compared with Random selection. Then, a total of 31,490 mathematical models were developed and those models that presented a determination coefficient higher than: r2train > 0.8, r2loo > 0.7, r2test > 0.5 and minimum standard deviation (SD) and minimum root-mean square error (RMS) were selected. The selected models were validated using the internal leave-one-out method and the predictive capacity was evaluated by the external test set. The results indicate that random selection could lead to erroneous results. In return, a rational selection allows for obtaining more reliable conclusions. The QSAR models with major predictive power were found using the k-means algorithm and selection by activity.

Keywords: Kennard–Stone; QSAR; based on activity; k-means; random selection; rational partition of dataset.

MeSH terms

  • Algorithms
  • Antiviral Agents / analysis
  • Antiviral Agents / chemistry*
  • Influenza A Virus, H1N1 Subtype
  • Models, Molecular
  • Neuraminidase / antagonists & inhibitors*
  • Quantitative Structure-Activity Relationship*

Substances

  • Antiviral Agents
  • Neuraminidase