Fairness measure

From HandWiki

Fairness measures or metrics are used in network engineering to determine whether users or applications are receiving a fair share of system resources. There are several mathematical and conceptual definitions of fairness.

Transmission Control Protocol fairness

Congestion control mechanisms for new network transmission protocols or peer-to-peer applications must interact well with Transmission Control Protocol (TCP). TCP fairness requires that a new protocol receive a no larger share of the network than a comparable TCP flow. This is important as TCP is the dominant transport protocol on the Internet, and if new protocols acquire unfair capacity they tend to cause problems such as congestion collapse. This was the case with the first versions of RealMedia's streaming protocol: it was based on UDP and was widely blocked at organizational firewalls until a TCP-based version was developed. TCP throughput unfairness over WiFi is a critical problem and needs further investigations.[1]

Jain's fairness index

Raj Jain's equation,

[math]\displaystyle{ \mathcal{J} (x_1, x_2, \dots, x_n) = \frac{( \sum_{i=1}^n x_i )^2}{n \cdot \sum_{i=1}^n {x_i}^2}=\frac{\overline{\mathbf{x}}^2}{\overline{\mathbf{x}^2}}=\frac{1}{1+\widehat{c_{\rm v}}^2} }[/math]

rates the fairness of a set of values where there are [math]\displaystyle{ n }[/math] users, [math]\displaystyle{ x_i }[/math] is the throughput for the [math]\displaystyle{ i }[/math]th connection, and [math]\displaystyle{ \widehat{c_{\rm v}} }[/math] is the sample coefficient of variation . The result ranges from [math]\displaystyle{ \tfrac{1}{n} }[/math] (worst case) to 1 (best case), and it is maximum when all users receive the same allocation. This index is [math]\displaystyle{ \tfrac{k}{n} }[/math] when [math]\displaystyle{ k }[/math] users equally share the resource, and the other [math]\displaystyle{ n-k }[/math] users receive zero allocation.

This metric identifies underutilized channels and is not unduly sensitive to atypical network flow patterns.[2]

To achieve a given fairness level [math]\displaystyle{ F }[/math], one approximate method is to let [math]\displaystyle{ x_k=A \cdot k^\alpha }[/math], where

[math]\displaystyle{ \alpha=\frac{1-F+\sqrt{1-F}}{F} }[/math]

and A is an arbitrary factor, typically used for normalization. This gives an allocation with a fairness close to F, and the allocation can then be refined to get even closer. Note this also allows for a prioritization of allocation, as the [math]\displaystyle{ x_k }[/math]s will be sorted.

An exact method is to let [math]\displaystyle{ x_k=A \cdot e^{2\alpha k} }[/math], where [math]\displaystyle{ \alpha }[/math] solves

[math]\displaystyle{ \frac{\tanh(n\alpha)}{n\tanh(\alpha)}=F }[/math].

A simple way to calculate [math]\displaystyle{ \alpha }[/math] is to use Newton's Method on [math]\displaystyle{ \ln\left ( \frac{\tanh(n\alpha)-\tanh(\alpha)}{(nF-1)\cdot \tanh(\alpha)} \right )=0 }[/math], which converges consistently and fairly quickly.

Both of these methods give non-integer allocations, generally, and sometimes integer allocations are required. This can be done by using one of the above allocation methods, rounding down each allocation to the nearest integer ([math]\displaystyle{ x_k'=\left \lfloor x_k \right \rfloor }[/math]), and then iteratively allocating one unit to a user, with the probability that user k receives it is proportional to [math]\displaystyle{ x_k-\left \lfloor x_k \right \rfloor }[/math].

Max-min fairness

Main page: Max-min fairness

Max-min fairness is said to be achieved by an allocation if and only if the allocation is feasible and an attempt to increase the allocation of any flow necessarily results in the decrease in the allocation of some other flow with an equal or smaller allocation. A max-min fair allocation is achieved when bandwidth is allocated equally and in infinitesimal increments to all flows until one is satisfied, then amongst the remainder of the flows and so on until all flows are satisfied or the bandwidth is exhausted.

Fairly shared spectrum efficiency

In packet radio wireless networks, The fairly shared spectrum efficiency (FSSE) can be used as a combined measure of fairness and system spectrum efficiency. The system spectral efficiency is the aggregate throughput in the network divided by the utilized radio bandwidth in hertz. The FSSE is the portion of the system spectral efficiency that is shared equally among all active users (with at least one backlogged data packet in queue or under transmission). In case of scheduling starvation, the FSSE would be zero during certain time intervals. In case of equally shared resources, the FSSE would be equal to the system spectrum efficiency. To achieve max-min fairness, the FSSE should be maximized.

FSSE is useful especially when analyzing advanced radio resource management (RRM) schemes, for example channel adaptive scheduling, for cellular networks with best-effort packet data service. In such system it may be tempting to optimize the spectrum efficiency (i.e. the throughput). However, that might result in scheduling starvation of "expensive" users at far distance from the access point, whenever another active user is closer to the same or an adjacent access point. Thus the users would experience unstable service, perhaps resulting in a reduced number of happy customers. Optimizing the FSSE results in a compromise between fairness (especially avoiding scheduling starvation) and achieving high spectral efficiency.

If the cost of each user is known, in terms of consumed resources per transferred information bit, the FSSE measure may be redefined to reflect proportional fairness. In a proportional fair system, this "proportionally fair shared spectrum efficiency" (or "fairly shared radio resource cost") is maximized. This policy is less fair since "expensive" users are given lower throughput than others, but still scheduling starvation is avoided.

QoE fairness

The idea of QoE fairness is to quantify fairness among users by considering the Quality of Experience (QoE) as perceived by the end user. This is especially of importance in network management where operators want to keep their users sufficiently satisfied (i.e. high QoE) in a fair manner, see QoE management. Several approaches have been proposed to ensure network-wide QoE fairness especially for adaptive video streaming.[3][4]

In contrast to network related measures like throughput, QoE is typically not measured on ratio scales. Hence, fairness measures like Jain's fairness index cannot be applied, as the measurement scale requires to be a ratio scale with a clearly defined zero point (see examples of misuse for coefficients of variation). QoE may be measure on interval scales. A typical example is a 5-point mean opinion score (MOS) scale, with 1 indicating lowest quality and 5 indicating highest quality. While the coefficient of variation is meaningless, the standard deviation [math]\displaystyle{ \sigma }[/math] provides a measure of the dispersion of QoE among users.

Hossfeld et al. have proposed a QoE Fairness index which considers the lower bound [math]\displaystyle{ L }[/math] and the higher bound [math]\displaystyle{ H }[/math] of the rating scale.[5]

[math]\displaystyle{ F=1- \frac{2\sigma}{H-L} }[/math]

The QoE fairness index [math]\displaystyle{ F }[/math] has some desired properties like scale and metric independence. The unit of measurement does not matter. Any linear transformation of the QoE values does not change the value of the fairness index. The fairness index is bounded in the interval [math]\displaystyle{ [0;1] }[/math] with 1 indicating perfect QoE fairness – all users experience the same quality. 0 indicates total unfairness, e.g. 50% of users experience highest QoE [math]\displaystyle{ H }[/math] and 50% experience lowest QoE [math]\displaystyle{ L }[/math].

Product-based Fairness Indices

Product-based fairness indices are based on the general fairness formulation:

[math]\displaystyle{ \mathcal{A}(\mathbf{x})=\prod_{i=0}^n f\left(\frac{x_i}{\max(\mathbf{x})}\right) }[/math],

where [math]\displaystyle{ f }[/math] is an arbitrary transformation function. For [math]\displaystyle{ f }[/math] to be a valid transformation function: [math]\displaystyle{ f(x) \in [0,1] }[/math] for [math]\displaystyle{ 0 \leq x \leq 1 }[/math]. The resulting index thus has a value between 0 and 1. As Jain's fairness index is said to be unduly sensitive under atypical conditions, the product-based fairness can be defined arbitrarily to obtain a desired sensitivity.

An allocation that has fairness F according to the formulation above can be given by

[math]\displaystyle{ x_j=A \cdot f^{-1}\left (\exp\left (\ln(F) \cdot g(j)/\sum_{i=0}^{n}g(i) \right ) \right ) }[/math],

where [math]\displaystyle{ g(x) }[/math] is any non-decreasing function with [math]\displaystyle{ g(0)=0 }[/math] . it is often convenient to take g to be something like [math]\displaystyle{ g(x)=x^m }[/math]. Assuming f is increasing and [math]\displaystyle{ f(0)=0 }[/math] and [math]\displaystyle{ f(1)=1 }[/math], this gives a minimum to maximum ratio of about

[math]\displaystyle{ f^{-1}\left ( \exp\left ( \frac{m+1}{n}\ln(F) \right ) \right ) }[/math].

The linear product-based fairness index has [math]\displaystyle{ f(x)=x }[/math] and looks as follows:

[math]\displaystyle{ \mathcal{L}(\mathbf{x})=\frac{\prod_{i=0}^n x_i}{\max(\mathbf{x})^n} }[/math].

It is observed that [math]\displaystyle{ \mathcal{L}(\mathbf{x}) }[/math] is very sensitive for small values of [math]\displaystyle{ x_i/\max(\mathbf{x}) }[/math]. For example [math]\displaystyle{ \mathbf{h}=\{20,10,5,1\} }[/math] yields [math]\displaystyle{ \mathcal{L}(\mathbf{h})=0.00625 }[/math]

G's fairness index

The G's fairness index [math]\displaystyle{ \mathcal{I} }[/math] is primarily used by telecom operators in the context of bandwidth allocation[citation needed]. G's [math]\displaystyle{ k }[/math]th-order fairness index scales the fractions of the product-based fairness index by a powered sine transformation [math]\displaystyle{ f(x)=\sin(x\pi/2)^{\frac{1}{k}} }[/math]:

[math]\displaystyle{ \mathcal{G}_k(\mathbf{x})=\prod^n_{i=1}\sin\left(\frac{\pi x_i}{2\max(\mathbf{x})}\right)^{\frac{1}{k}} }[/math],

where [math]\displaystyle{ k \in \mathbb{R}^+ }[/math]. The first quadrant of the sine wave is used as a mapping function to inflate fractions . As such, the sensitivity of the product-based fairness is decreased for values close to [math]\displaystyle{ \max(\mathbf{x}) }[/math], while the index still outputs a value between 0 and 1.

Compared to Jain's fairness index, G's fairness index yields smaller values, it is more sensitive to potential unfair bandwidth distribution and can go to zero. In the context of networks, the latter is an advantage over Jain's fairness index when a few values in a set drop to low levels. Moreover, Jain's fairness index is deemed as an average user perception of fairness[6] whereas G's fairness index is focused more on equality within a group. For example, for [math]\displaystyle{ \mathbf{m}=\{20,20,20,0\} }[/math] we get [math]\displaystyle{ \mathrm{Jain}(\mathbf{m})=0.75 }[/math] and [math]\displaystyle{ \mathcal{G_1}(\mathbf{m})=0 }[/math].

Bossaer's fairness index

Whereas G's fairness index inflates the fractions closer to [math]\displaystyle{ \max(\mathbf{x}) }[/math], the Bossaer's fairness index inflates the fractions closer to 0. Bossaer's [math]\displaystyle{ k }[/math]th-order transformation function [math]\displaystyle{ f(x)=x^{\frac{1}{k}} }[/math] yields the fairness index:

[math]\displaystyle{ \mathcal{B}_k(\mathbf{x})=\prod_{i=1}^n\left(\frac{x_i}{\max(\mathbf{x})}\right)^{\frac{1}{k}} }[/math].

The linear product-based fairness indices is a special case of Bossaer's where [math]\displaystyle{ k=1 }[/math].

Causal fairness

Causal fairness measures the frequency with which two nearly identical users or applications who differ only in a set of characteristics with respect to which resource allocation must be fair receive identical treatment.[7]

Other metrics

Several other metrics have been defined, such as Worst Case Fairness.[8]

Notes

  1. Pokhrel, Shiva Raj; Panda, Manoj; Vu, Hai L.; Mandjes, Michel (2016). "TCP Performance over Wi-Fi: Joint Impact of Buffer and Channel Losses". IEEE Transactions on Mobile Computing 15 (5): 1279–1291. doi:10.1109/TMC.2015.2456883. 
  2. Jain, R.; Chiu, D.M.; Hawe, W. (1984). "A Quantitative Measure of Fairness and Discrimination for Resource Allocation in Shared Computer Systems". DEC Research Report TR-301. http://www1.cse.wustl.edu/~jain/papers/ftp/fairness.pdf. 
  3. Georgopoulos, Panagiotis; Elkhatib, Yehia; Broadbent, Matthew; Mu, Mu; Race, Nicholas (2013). "Towards network-wide QoE fairness using openflow-assisted adaptive video streaming". Proceedings of the 2013 ACM SIGCOMM workshop on Future human-centric multimedia networking. pp. 15–20. doi:10.1145/2491172.2491181. ISBN 9781450321839. 
  4. Petrangeli, Stefano; Claeys, Maxim; Latre, Steven; Famaey, Jeroen; De Turck, Filip (2014). "A multi-agent Q-Learning-based framework for achieving fairness in HTTP Adaptive Streaming". 2014 IEEE Network Operations and Management Symposium (NOMS). pp. 1–9. doi:10.1109/NOMS.2014.6838245. ISBN 978-1-4799-0913-1. 
  5. Hossfeld, Tobias; Skorin-Kapov, Lea; Heegaard, Poul E.; Varela, Martin (11 Oct 2016). "Definition of QoE fairness in shared systems". IEEE Communications Letters 21 (1): 184–187. doi:10.1109/LCOMM.2016.2616342. http://osf.io/xczvp/. Hobfeld, Tobias; Skorin-Kapov, Lea; Heegaard, Poul E.; Varela, Martin (19 Sep 2017). "Definition of QoE fairness in shared systems". Zenodo Preprint. doi:10.5281/zenodo.893343. https://zenodo.org/record/893344. 
  6. Throughput Fairness Index: An Explanation
  7. Galhotra, Sainyam; Brun, Yuriy; Meliou, Alexandra (2017). "Fairness testing: Testing software for discrimination". Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering. pp. 498–510. doi:10.1145/3106237.3106277. ISBN 9781450351058. 
  8. Bennett, J. C. R.; Hui Zhang (1996). "WF/sup 2/Q: Worst-case fair weighted fair queueing". Proceedings of IEEE INFOCOM '96. Conference on Computer Communications. 1. pp. 120. doi:10.1109/INFCOM.1996.497885. ISBN 978-0-8186-7293-4. 

Further reading