Quartile

From HandWiki
Short description: Statistic which divides data into four same-sized parts for analysis


In statistics, a quartile is a type of quantile which divides the number of data points into four parts, or quarters, of more-or-less equal size. The data must be ordered from smallest to largest to compute quartiles; as such, quartiles are a form of order statistic. The three main quartiles are as follows:

  • The first quartile (Q1) is defined as the middle number between the smallest number (minimum) and the value that falls between the 25th and 75th percentiles of the sample (which cuts off the first quarter of all the samples). It is also known as the lower quartile, as 25% of the data is below this point.
  • The second quartile (Q2) is the median of a data set; thus 50% of the data lies below this point.
  • The third quartile (Q3) is the middle value between the value that cuts off the last quarter of samples and the highest value (maximum) of the data set. It is known as the upper quartile, as 75% of the data lies below this point.[1]

Along with the minimum and maximum of the data (which are also quartiles), the three quartiles described above provide a five-number summary of the data. This summary is important in statistics because it provides information about both the center and the spread of the data. Knowing the lower and upper quartile provides information on how big the spread is and if the dataset is skewed toward one side. Since quartiles divide the number of data points evenly, the range is usually not the same between quartiles (i.e. usually Q3-Q2Q2-Q1) and is instead known as the interquartile range (IQR), defined as the difference between the 75th and 25th percentiles. While the maximum and minimum also show the spread of the data, the upper and lower quartiles can provide more detailed information on the location of specific data points, the presence of outliers in the data, and the difference in spread between the middle 50% of the data and the outer data points.[2]

Definitions

Boxplot (with quartiles and an interquartile range) and a probability density function (pdf) of a normal N(0,1σ2) population
Symbol Names Definition
Q1
splits off the lowest 25% of data from the highest 75%
Q2
  • second quartile
  • median
  • 50th percentile
cuts data set in half
Q3
  • third quartile
  • upper quartile
  • 75th percentile
splits off the highest 25% of data from the lowest 75%

Computing methods

Discrete distributions

For discrete distributions, there is no universal agreement on selecting the quartile values.[3]

Method 1

  1. Use the median to divide the ordered data set into two-halves.
    • If there are an odd number of data points in the original ordered data set, do not include the median (the central value in the ordered list) in either half.
    • If there are an even number of data points in the original ordered data set, split this data set exactly in half.
  2. The lower quartile value is the median of the lower half of the data. The upper quartile value is the median of the upper half of the data.

This rule is employed by the TI-83 calculator boxplot and "1-Var Stats" functions.

Method 2

  1. Use the median to divide the ordered data set into two-halves.
    • If there are an odd number of data points in the original ordered data set, include the median (the central value in the ordered list) in both halves.
    • If there are an even number of data points in the original ordered data set, split this data set exactly in half.
  2. The lower quartile value is the median of the lower half of the data. The upper quartile value is the median of the upper half of the data.

The values found by this method are also known as "Tukey's hinges";[4] see also midhinge.

Method 3

  1. If there are even numbers of data points, then Method 3 starts off the same as Method 1 or Method 2 above and you can choose to include or not include the median as a datapoint. If you choose to include the median as a new datapoint, proceed to step 2 or 3 of Method 3 because you now have an odd number of datapoints.
  2. If there are (4n+1) data points, then the lower quartile is 25% of the nth data value plus 75% of the (n+1)th data value; the upper quartile is 75% of the (3n+1)th data point plus 25% of the (3n+2)th data point.
  3. If there are (4n+3) data points, then the lower quartile is 75% of the (n+1)th data value plus 25% of the (n+2)th data value; the upper quartile is 25% of the (3n+2)th data point plus 75% of the (3n+3)th data point.

Method 4

If we have an ordered dataset [math]\displaystyle{ x_1, x_2, ..., x_n }[/math], we can interpolate between data points to find the [math]\displaystyle{ p }[/math]th empirical quantile if [math]\displaystyle{ x_i }[/math] is in the [math]\displaystyle{ i/(n+1) }[/math] quantile. If we denote the integer part of a number [math]\displaystyle{ a }[/math] by [math]\displaystyle{ \lfloor a \rfloor }[/math], then the empirical quantile function is given by,

[math]\displaystyle{ q(p/4) = x_{k} + \alpha(x_{k+1} - x_{k}) }[/math],

where [math]\displaystyle{ k = \lfloor p(n+1)/4 \rfloor }[/math] and [math]\displaystyle{ \alpha = p(n+1)/4 - \lfloor p(n+1)/4 \rfloor }[/math].[1]

To find the first, second, and third quartiles of the dataset we would evaluate [math]\displaystyle{ q(0.25) }[/math], [math]\displaystyle{ q(0.5) }[/math], and [math]\displaystyle{ q(0.75) }[/math] respectively.

Example 1

Ordered Data Set: 6, 7, 15, 36, 39, 40, 41, 42, 43, 47, 49

Method 1 Method 2 Method 3 Method 4
Q1 15 25.5 20.25 15
Q2 40 40 40 40
Q3 43 42.5 42.75 43

Example 2

Ordered Data Set: 7, 15, 36, 39, 40, 41

As there are an even number of data points, the first three methods all give the same results.

Method 1 Method 2 Method 3 Method 4
Q1 15 15 15 13
Q2 37.5 37.5 37.5 37.5
Q3 40 40 40 40.25

Continuous probability distributions

Quartiles on a cumulative distribution function of a normal distribution

If we define a continuous probability distributions as [math]\displaystyle{ P(X) }[/math] where [math]\displaystyle{ X }[/math] is a real valued random variable, its cumulative distribution function (CDF) is given by

[math]\displaystyle{ F_X(x) = P(X \leq x) }[/math].[1]

The CDF gives the probability that the random variable [math]\displaystyle{ X }[/math] is less than the value [math]\displaystyle{ x }[/math]. Therefore, the first quartile is the value of [math]\displaystyle{ x }[/math] when [math]\displaystyle{ F_X(x) = 0.25 }[/math], the second quartile is [math]\displaystyle{ x }[/math] when [math]\displaystyle{ F_X(x) = 0.5 }[/math], and the third quartile is [math]\displaystyle{ x }[/math] when [math]\displaystyle{ F_X(x) = 0.75 }[/math].[5] The values of [math]\displaystyle{ x }[/math] can be found with the quantile function [math]\displaystyle{ Q(p) }[/math] where [math]\displaystyle{ p = 0.25 }[/math] for the first quartile, [math]\displaystyle{ p = 0.5 }[/math] for the second quartile, and [math]\displaystyle{ p = 0.75 }[/math] for the third quartile. The quantile function is the inverse of the cumulative distribution function if the cumulative distribution function is monotonically increasing.

Outliers

There are methods by which to check for outliers in the discipline of statistics and statistical analysis. Outliers could be a result from a shift in the location (mean) or in the scale (variability) of the process of interest.[6] Outliers could also be evidence of a sample population that has a non-normal distribution or of a contaminated population data set. Consequently, as is the basic idea of descriptive statistics, when encountering an outlier, we have to explain this value by further analysis of the cause or origin of the outlier. In cases of extreme observations, which are not an infrequent occurrence, the typical values must be analyzed. In the case of quartiles, the Interquartile Range (IQR) may be used to characterize the data when there may be extremities that skew the data; the interquartile range is a relatively robust statistic (also sometimes called "resistance") compared to the range and standard deviation. There is also a mathematical method to check for outliers and determining "fences", upper and lower limits from which to check for outliers.

After determining the first and third quartiles and the interquartile range as outlined above, then fences are calculated using the following formula:

[math]\displaystyle{ \text{Lower fence} = Q_1 - 1.5(\mathrm{IQR}) \, }[/math]
[math]\displaystyle{ \text{Upper fence} = Q_3 + 1.5(\mathrm{IQR}), \, }[/math]
Boxplot Diagram with Outliers

where Q1 and Q3 are the first and third quartiles, respectively. The lower fence is the "lower limit" and the upper fence is the "upper limit" of data, and any data lying outside these defined bounds can be considered an outlier. Anything below the Lower fence or above the Upper fence can be considered such a case. The fences provide a guideline by which to define an outlier, which may be defined in other ways. The fences define a "range" outside which an outlier exists; a way to picture this is a boundary of a fence, outside which are "outsiders" as opposed to outliers. It is common for the lower and upper fences along with the outliers to be represented by a boxplot. For a boxplot, only the vertical heights correspond to the visualized data set while horizontal width of the box is irrelevant. Outliers located outside the fences in a boxplot can be marked as any choice of symbol, such as an "x" or "o". The fences are sometimes also referred to as "whiskers" while the entire plot visual is called a "box-and-whisker" plot.

When spotting an outlier in the data set by calculating the interquartile ranges and boxplot features, it might be simple to mistakenly view it as evidence that the population is non-normal or that the sample is contaminated. However, this method should not take place of a hypothesis test for determining normality of the population. The significance of the outliers vary depending on the sample size. If the sample is small, then it is more probable to get interquartile ranges that are unrepresentatively small, leading to narrower fences. Therefore, it would be more likely to find data that are marked as outliers.[7]

Computer software for quartiles

Environment Function Quartile Method
Microsoft Excel QUARTILE.EXC Method 4
Microsoft Excel QUARTILE.INC Method 3
TI-8X series calculators 1-Var Stats Method 1
R fivenum Method 2
Python numpy.percentile Method 3
Python pandas.DataFrame.describe Method 3

Excel:

The Excel function QUARTILE(array, quart) provides the desired quartile value for a given array of data, using Method 3 from above. In the Quartile function, array is the dataset of numbers that is being analyzed and quart is any of the following 5 values depending on which quartile is being calculated. [8]

Quart Output QUARTILE Value
0 Minimum value
1 Lower Quartile (25th percentile)
2 Median
3 Upper Quartile (75th percentile)
4 Maximum value

MATLAB:

In order to calculate quartiles in Matlab, the function quantile(A,p) can be used. Where A is the vector of data being analyzed and p is the percentage that relates to the quartiles as stated below. [9]

p Output QUARTILE Value
0 Minimum value
0.25 Lower Quartile (25th percentile)
0.5 Median
0.75 Upper Quartile (75th percentile)
1 Maximum value

See also

References

External links