Chemistry:Applicability domain

From HandWiki

The applicability domain (AD) (for both chemistry and machine learning) of a QSAR model is the physico-chemical, structural or biological space, knowledge or information on which the training set of the model has been developed, and for which it is applicable to make predictions for new compounds.

The purpose of AD is to state whether the model's assumptions are met, and for which chemicals the model can be reliably applicable. In general, this is the case for interpolation rather than for extrapolation. Up to now there is no single generally accepted algorithm for determining the AD: a comprehensive survey can be found in a Report and Recommendations of ECVAM Workshop 52.[1] There exists a rather systematic approach for defining interpolation regions.[2] The process involves the removal of outliers and a probability density distribution method using kernel-weighted sampling. Another widely used approach for the structural AD of the regression QSAR models is based on the leverage calculated from the diagonal values of the hat matrix of the modeling molecular descriptors.[3][4][5] A recent rigorous benchmarking study of several AD algorithms identified standard-deviation of model predictions as the most reliable approach.[6] To investigate the AD of a training set of chemicals one can directly analyse properties of the multivariate descriptor space of the training compounds or more indirectly via distance (or similarity) metrics. When using distance metrics care should be taken to use an orthogonal and significant vector space. This can be achieved by different means of feature selection and successive principal components analysis.

Notes

  1. Netzeva T, Worth A, Aldenberg T, Benigni R, Cronin M, Gramatica P, Jaworska J, Kahn S, Klopman G, Marchant C, Myatt G, Nikolova-Jeliazkova N, Patlewicz G, Perkins R, Roberts D, Schultz T, Stanton D, van de Sandt J, Tong W, Veith G, Yang C: Current status of methods for defining the applicability domain of (Quantitative) Structure–Activity Relationships. Altern Lab Anim 2005, 33: 1-19
  2. Jaworska J, Nikolova-Jeliazkova N, Aldenberg T: QSAR applicability domain estimation by projection of the training set descriptor space: a review. Altern Lab Anim 2005, 33(5):445-459
  3. Atkinson AC, Plots, Transformations and Regression, Clarendon Press, Oxford, 1985, p.282
  4. Tropsha A, Gramatica P, Gombar VK, The importance of being Earnest: Validation is the absolute essential for successful application and interpretation of QSPR models. QSAR Comb.Sci. 2003, 22: 69-77
  5. Gramatica P, Principles of QSAR models validation: internal and external QSAR Comb.Sci. 2007, 26(5): 694-701
  6. Tetko IV, Sushko I, Pandey AK, Zhu H, Tropsha A, Papa E, Oberg T, Todeschini R, Fourches D, Varnek A. Critical assessment of QSAR models of environmental toxicity against Tetrahymena pyriformis: focusing on applicability domain and overfitting by variable selection. J Chem Inf Model. 2008 Sep;48(9):1733-46.