List of statistical tests

From HandWiki
Short description: none


Explanation of properties

  • Scaling of data: One of the properties of the tests is the scale of the data, which can be interval-based, ordinal or nominal.[1] Nominal scale is also known as categorical.[2] Interval scale is also known as numerical.[2] When categorical data has only two possibilities, it is called binary or dichotomous.[3]
  • Assumptions, parametric and non-parametric: There are two groups of statistical tests, parametric and non-parametric. The choice between these two groups needs to be justified. Parametric tests assume that the data follow a particular distribution, typically a normal distribution, while non-parametric tests make no assumptions about the distribution.[4] Non-parametric tests have the advantage of being more resistant to misbehaviour of the data, such as outliers.[4] They also have the disadvantage of being less certain in the statistical estimate.[4]
  • Type of data: Statistical tests use different types of data.[3] Some tests perform univariate analysis on a single sample with a single variable. Others compare two or more paired or unpaired samples. Unpaired samples are also called independent samples. Paired samples are also called dependent. Finally, there are some statistical tests that perform analysis of relationship between multiple variables like regression.[3]
  • Number of samples: The number of samples of data.
  • Exactness: A test can be exact or be asymptotic delivering approximate results.

List of statistical tests

Test name Scaling Assumptions Data Samples Exact Special case of Application conditions
One sample t-test interval normal univariate 1 No[5] Location test
Paired difference test paired 2 Location test
Unpaired t-test interval normal unpaired 2 No[5] Location test Homoscedasticity[6]
Welch's t-test interval normal unpaired 2 No[5] Location test
Paired t-test interval normal paired 2 No Location test
F-test interval normal unpaired 2
Z-test (one mean) interval normal univariate[7] 1 No variance is known
Z-test (two means) interval normal 2 No variances are known
Permutation test interval non-parametric unpaired ≥2 Yes
Kruskal-Wallis H test ordinal non-parametric unpaired ≥2 Yes small sample size[8]
Mann–Whitney U test ordinal non-parametric unpaired 2 Kruskal-Wallis test[9]
Wilcoxon signed-rank test interval non-parametric paired ≥1 Location test
Sign test ordinal non-parametric paired 2
Friedman test ordinal non-parametric paired >2 Location test
χ2 test nominal[3] non-parametric[10] No Contingency table,
sample size > ca. 60,[3]
any cell content ≥ 5,[11]
marginal totals fixed[11]
Pearson's χ2 test nominal/ordinal non-parametric No χ2 test
Median test ordinal non-parametric No Pearson's χ2 test
Multinomial test nominal non-parametric univariate 1 Yes Location test
McNemar's test binary non-parametric[12] paired 2 Yes Cochran's Q test[13]
Cochran's Q test binary non-parametric paired ≥2
Binomial test binary non-parametric univariate 1 Yes Multinomial test
Siegel–Tukey test ordinal non-parametric unpaired 2
Chow test interval parametric linear regression 2 No Time series
Fisher's exact test nominal non-parametric unpaired ≥2[11] Yes Contingency table,
marginal totals fixed[11]
Barnard's exact test nominal non-parametric unpaired 2 Yes Contingency table
Boschloo's test nominal non-parametric unpaired 2 Yes Contingency table
Shapiro–Wilk test interval univariate 1 Normality test sample size between 3 and 5000[14]
Kolmogorov–Smirnov test interval 1 Normality test distribution parameters known[14]
Shapiro-Francia test interval univariate 1 Normality test Simplification of Shapiro–Wilk test
Lilliefors test interval 1 Normality test

See also

References

  1. Cite error: Invalid <ref> tag; no text was provided for refs named avijit
  2. 2.0 2.1 "What is the difference between categorical, ordinal and interval variables?". https://stats.oarc.ucla.edu/other/mult-pkg/whatstat/what-is-the-difference-between-categorical-ordinal-and-interval-variables/. 
  3. 3.0 3.1 3.2 3.3 3.4 Cite error: Invalid <ref> tag; no text was provided for refs named choosing
  4. 4.0 4.1 4.2 Huth, R.; Pokorná, L. (1 March 2004). "Parametric versus non-parametric estimates of climatic trends" (in en). Theoretical and Applied Climatology 77 (1): 107–112. doi:10.1007/s00704-003-0026-3. ISSN 1434-4483. Bibcode2004ThApC..77..107H. https://link.springer.com/article/10.1007/s00704-003-0026-3. 
  5. 5.0 5.1 5.2 de Winter, J.C.F. (2019). "Using the Student's t-test with extremely small sample sizes". Practical Assessment, Research, and Evaluation 18. doi:10.7275/e4r6-dj05. 
  6. "t-Test für unabhängige Stichproben" (in de-DE). https://www.empirical-methods.hslu.ch/entscheidbaum/unterschiede/zentrale-tendenz/t-test-fuer-unabhaengige-stichproben/. 
  7. Kanji, Gopal K. (1995). 100 statistical tests (Reprint ed.). London: Sage Publ. ISBN 0803987048. 
  8. Choi, Won; Lee, Jae Won; Huh, Myung-Hoe; Kang, Seung-Ho (11 January 2003). "An Algorithm for Computing the Exact Distribution of the Kruskal–Wallis Test" (in en). Communications in Statistics - Simulation and Computation 32 (4): 1029–1040. doi:10.1081/SAC-120023876. ISSN 0361-0918. https://www.tandfonline.com/doi/abs/10.1081/SAC-120023876. 
  9. McKight, Patrick E.; Najab, Julius (30 January 2010). "Kruskal-Wallis Test" (in en). The Corsini Encyclopedia of Psychology. Wiley. p. 1. doi:10.1002/9780470479216.corpsy0491. ISBN 978-0-470-17024-3. 
  10. McHugh, Mary L. (15 June 2013). "The Chi-square test of independence". Biochemia Medica 23 (2): 143–149. doi:10.11613/BM.2013.018. PMID 23894860. 
  11. 11.0 11.1 11.2 11.3 Warner, Pamela (1 October 2013). "Testing association with Fisher's Exact test" (in en). Journal of Family Planning and Reproductive Health Care 39 (4): 281–284. doi:10.1136/jfprhc-2013-100747. ISSN 1471-1893. PMID 24062499. https://srh.bmj.com/content/39/4/281.short. 
  12. Károly, Héberger; Róbert, Rajkó (1999). Pair-Correlation Method with parametric and non-parametric test-statistics for variable selection. Description of computer program and application for environmental data case studies. szef. pp. 82–91. https://publicatio.bibl.u-szeged.hu/6242/. 
  13. Carpi, Angelo; Rossi, Giuseppe; Coscio, Giancarlo Di; Iervasi, Giorgio; Nicolini, Andrea; Carpi, Federico; Mechanick, Jeffrey I.; Bartolazzi, Armando (2010). "Galectin-3 detection on large-needle aspiration biopsy improves preoperative selection of thyroid nodules: a prospective cohort study". Annals of Medicine 42 (1): 70–78. doi:10.3109/07853890903439778. ISSN 1365-2060. PMID 20001505. 
  14. 14.0 14.1 Ahmad, Fiaz; Khan, Rehan Ahmad (8 September 2015). "A power comparison of various normality tests". Pakistan Journal of Statistics and Operation Research 11 (3): 331–345. doi:10.18187/pjsor.v11i3.845. ISSN 1816-2711. https://www.pjsor.com/index.php/pjsor/article/view/845.