Freedman–Diaconis rule

From HandWiki

In statistics, the Freedman–Diaconis rule can be used to select the width of the bins to be used in a histogram.[1] It is named after David A. Freedman and Persi Diaconis. For a set of empirical measurements sampled from some probability distribution, the Freedman-Diaconis rule is designed roughly to minimize the integral of the squared difference between the histogram (i.e., relative frequency density) and the density of the theoretical probability distribution.

The general equation for the rule is:

[math]\displaystyle{ \text{Bin width}=2\, { \text{IQR}(x) \over{ \sqrt[3]{n} }} }[/math]

where [math]\displaystyle{ \operatorname{IQR}(x) }[/math] is the interquartile range of the data and [math]\displaystyle{ n }[/math] is the number of observations in the sample [math]\displaystyle{ x. }[/math]

Other approaches

With the factor 2 replaced by approximately 2.59, the Freedman-Diaconis rule asymptotically matches Scott's normal reference rule for data sampled from a normal distribution.

Another approach is to use Sturges' rule: use a bin so large that there are about [math]\displaystyle{ 1+\log_2n }[/math] non-empty bins (Scott, 2009).[2] This works well for n under 200, but was found to be inaccurate for large n.[3] For a discussion and an alternative approach, see Birgé and Rozenholc.[4]

References

  1. Freedman, David; Diaconis, Persi (December 1981). "On the histogram as a density estimator: L2 theory". Probability Theory and Related Fields 57 (4): 453–476. doi:10.1007/BF01025868. ISSN 0178-8051. 
  2. Scott, D.W. (2009). "Sturges' rule". WIREs Computational Statistics 1 (3): 303–306. doi:10.1002/wics.35. 
  3. Hyndman, R.J. (1995). "The problem with Sturges' rule for constructing histograms". http://robjhyndman.com/papers/sturges.pdf. 
  4. Birgé, L.; Rozenholc, Y. (2006). "How many bins should be put in a regular histogram". ESAIM: Probability and Statistics 10: 24–45. doi:10.1051/ps:2006001. http://www.numdam.org/item?id=PS_2006__10__24_0.