Z-factor

From HandWiki
Short description: Measure of statistical effect size


The Z-factor is a measure of statistical effect size. It has been proposed for use in high-throughput screening (HTS), where it is also known as Z-prime,[1] to judge whether the response in a particular assay is large enough to warrant further attention.

Background

In HTS, experimenters often compare a large number (hundreds of thousands to tens of millions) of single measurements of unknown samples to positive and negative control samples. The particular choice of experimental conditions and measurements is called an assay. Large screens are expensive in time and resources. Therefore, prior to starting a large screen, smaller test (or pilot) screens are used to assess the quality of an assay, in an attempt to predict if it would be useful in a high-throughput setting. The Z-factor is an attempt to quantify the suitability of a particular assay for use in a full-scale HTS.

Definition

Z-factor

The Z-factor is defined in terms of four parameters: the means ([math]\displaystyle{ \mu }[/math]) and standard deviations ([math]\displaystyle{ \sigma }[/math]) of samples (s) and controls (c). Given these values ([math]\displaystyle{ \mu_s }[/math], [math]\displaystyle{ \sigma_s }[/math], and [math]\displaystyle{ \mu_c }[/math], [math]\displaystyle{ \sigma_c }[/math]), the Z-factor is defined as:

[math]\displaystyle{ \text{Z-factor} = 1 - {3 (\sigma_s + \sigma_c) \over | \mu_s - \mu_c |} }[/math]

For assays of agonist/activation type, the control (c) data ([math]\displaystyle{ \mu_c }[/math], [math]\displaystyle{ \sigma_c }[/math]) in the equation are substituted with the positive control (p) data ([math]\displaystyle{ \mu_p }[/math], [math]\displaystyle{ \sigma_p }[/math]) which represent maximal activated signal; for assays of antagonist/inhibition type, the control (c) data ([math]\displaystyle{ \mu_c }[/math], [math]\displaystyle{ \sigma_c }[/math]) in the equation are substituted with the negative control (n) data ([math]\displaystyle{ \mu_n }[/math], [math]\displaystyle{ \sigma_n }[/math]) which represent minimal signal.

In practice, the Z-factor is estimated from the sample means and sample standard deviations

[math]\displaystyle{ \text{Estimated Z-factor} = 1 - {3 (\hat{\sigma}_s + \hat{\sigma}_c) \over | \hat{\mu}_s - \hat{\mu}_c |} }[/math]

Z'-factor

The Z'-factor (Z-prime factor) is defined in terms of four parameters: the means ([math]\displaystyle{ \mu }[/math]) and standard deviations ([math]\displaystyle{ \sigma }[/math]) of both the positive (p) and negative (n) controls ([math]\displaystyle{ \mu_p }[/math], [math]\displaystyle{ \sigma_p }[/math], and [math]\displaystyle{ \mu_n }[/math], [math]\displaystyle{ \sigma_n }[/math]). Given these values, the Z'-factor is defined as:

[math]\displaystyle{ \text{Z'-factor} = 1 - {3 (\sigma_p + \sigma_n) \over | \mu_p - \mu_n |} }[/math]

The Z'-factor is a characteristic parameter of the assay itself, without intervention of samples.

Interpretation

The Z-factor defines a characteristic parameter of the capability of hit identification for each given assay. The following categorization of HTS assay quality by the value of the Z-Factor is a modification of Table 1 shown in Zhang et al. (1999);[2] note that the Z-factor cannot exceed one.

Z-factor value Related to screening Interpretation
1.0 An ideal assay
1.0 > Z ≥ 0.5 An excellent assay Note that if [math]\displaystyle{ \sigma_p = \sigma_n }[/math], 0.5 is equivalent to a separation of 12 standard deviations between [math]\displaystyle{ \mu_p }[/math] and [math]\displaystyle{ \mu_n }[/math].
0.5 > Z > 0 A marginal assay
0 A "yes/no" type assay
< 0 Screening essentially impossible There is too much overlap between the positive and negative controls for the assay to be useful.

Note that by the standards of many types of experiments, a zero Z-factor would suggest a large effect size, rather than a borderline useless result as suggested above. For example, if σpn=1, then μp=6 and μn=0 gives a zero Z-factor. But for normally-distributed data with these parameters, the probability that the positive control value would be less than the negative control value is less than 1 in 105. Extreme conservatism is used in high throughput screening due to the large number of tests performed.

Limitations

The constant factor 3 in the definition of the Z-factor is motivated by the normal distribution, for which more than 99% of values occur within three times standard deviations of the mean. If the data follow a strongly non-normal distribution, the reference points (e.g. the meaning of a negative value) may be misleading.

Another issue is that the usual estimates of the mean and standard deviation are not robust; accordingly many users in the high-throughput screening community prefer the "Robust Z-prime" which substitutes the median for the mean and the median absolute deviation for the standard deviation.[3] Extreme values (outliers) in either the positive or negative controls can adversely affect the Z-factor, potentially leading to an apparently unfavorable Z-factor even when the assay would perform well in actual screening .[4] In addition, the application of the single Z-factor-based criterion to two or more positive controls with different strengths in the same assay will lead to misleading results .[5] The absolute sign in the Z-factor makes it inconvenient to derive the statistical inference of Z-factor mathematically.[6] A recently proposed statistical parameter, strictly standardized mean difference (SSMD), can address these issues.[5][6][7] One estimate of SSMD is robust to outliers.

See also

References

  1. "Orbitrap LC-MS - US". https://www.thermofisher.com/us/en/home/industrial/mass-spectrometry/liquid-chromatography-mass-spectrometry-lc-ms/lc-ms-systems/orbitrap-lc-ms.html. 
  2. Zhang, JH; Chung, TDY; Oldenburg, KR (1999). "A simple statistical parameter for use in evaluation and validation of high throughput screening assays". Journal of Biomolecular Screening 4 (2): 67–73. doi:10.1177/108705719900400206. PMID 10838414. 
  3. Birmingham, Amanda (August 2009). "Statistical Methods for Analysis of High-Throughput RNA Interference Screens". Nat Methods 6 (8): 569–575. doi:10.1038/nmeth.1351. PMID 19644458. 
  4. "Alternative Statistical Parameter for High-Throughput Screening Assay Quality Assessment". Journal of Biomolecular Screening 12 (2): 229–34. 2007. doi:10.1177/1087057106296498. PMID 17218666. 
  5. 5.0 5.1 "Integrating experimental and analytic approaches to improve data quality in genome-wide RNAi screens". Journal of Biomolecular Screening 13 (5): 378–89. 2008. doi:10.1177/1087057108317145. PMID 18480473. 
  6. 6.0 6.1 Zhang, XHD (2007). "A pair of new statistical parameters for quality control in RNA interference high-throughput screening assays". Genomics 89 (4): 552–61. doi:10.1016/j.ygeno.2006.12.014. PMID 17276655. 
  7. Zhang, XHD (2008). "Novel analytic criteria and effective plate designs for quality control in genome-wide RNAi screens". Journal of Biomolecular Screening 13 (5): 363–77. doi:10.1177/1087057108317062. PMID 18567841. 

Further reading