Classifying bio-concentration factor with random forest algorithm, influence of the bio-accumulative vs. non-bio-accumulative compound ratio to modelling result, and applicability domain for random forest model

SAR QSAR Environ Res. 2014;25(12):967-81. doi: 10.1080/1062936X.2014.969310. Epub 2014 Dec 6.

Abstract

In environmental risk assessment, the bio-concentration factor (BCF) is a widely used parameter in the estimation of the bio-accumulation potential of chemicals. BCF data often have an uneven distribution of classes (bio-accumulative vs. non-bio-accumulative), which could severely bias the classification results towards the prevailing class. The present study focuses on the influence of uneven distribution of the classes in training phase of Random Forest (RF) classification models. Three different training set designs were used and descriptors selected to the models based on the occurrence frequency in RF trees and considering the mechanistic aspects they reflect. Models were compared and their classification performance was analysed, indicating good predictive characteristics (sensitivity = 0.90 and specificity = 0.83) for the balanced set; also imbalanced sets have their strengths in certain application scenarios. The confidence of classifications was assessed with a new schema for the applicability domain that makes use of the RF proximity matrix by analysing the similarity between the predicted compound and the training set of the model. All developed models were made available in the transparent, accessible and reproducible way in QsarDB repository (http://dx.doi.org/10.15152/QDB.116).

Keywords: applicability domain; bio-concentration factor; classification; imbalanced data set; proximity matrix; random forest.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Algorithms*
  • Hazardous Substances / chemistry
  • Hazardous Substances / metabolism*
  • Models, Chemical*
  • Quantitative Structure-Activity Relationship
  • Risk Assessment / methods
  • Water Pollutants, Chemical / chemistry
  • Water Pollutants, Chemical / metabolism*

Substances

  • Hazardous Substances
  • Water Pollutants, Chemical