Parametric polymorphism

Short description: Basis of generic programming

In programming languages and type theory, parametric polymorphism allows a single piece of code to be given a "generic" type, using variables in place of actual types, and then instantiated with particular types as needed. Parametrically polymorphic functions and data types are sometimes called generic functions and generic datatypes, respectively, and they form the basis of generic programming.

Parametric polymorphism may be contrasted with ad hoc polymorphism. Parametrically polymorphic definitions are uniform: they behave identically regardless of the type they are instantiated at. In contrast, ad hoc polymorphic definitions are given a distinct definition for each type. Thus, ad hoc polymorphism can generally only support a limited number of such distinct types, since a separate implementation has to be provided for each type.

Basic definition

It is possible to write functions that do not depend on the types of their arguments. For example, the identity function [math]\displaystyle{ \mathsf{id}(x) = x }[/math] simply returns its argument unmodified. This naturally gives rise to a family of potential types, such as [math]\displaystyle{ \mathsf{Int} \to \mathsf{Int} }[/math], [math]\displaystyle{ \mathsf{Bool} \to \mathsf{Bool} }[/math], [math]\displaystyle{ \mathsf{String} \to \mathsf{String} }[/math], and so on. Parametric polymorphism allows [math]\displaystyle{ \mathsf{id} }[/math] to be given a single, most general type by introducing a universally quantified type variable:

[math]\displaystyle{ \mathsf{id} : \forall \alpha. \alpha \to \alpha }[/math]

The polymorphic definition can then be instantiated by substituting any concrete type for [math]\displaystyle{ \alpha }[/math], yielding the full family of potential types.

The identity function is a particularly extreme example, but many other functions also benefit from parametric polymorphism. For example, an [math]\displaystyle{ \mathsf{append} }[/math] function that concatenates two lists does not inspect the elements of the list, only the list structure itself. Therefore, [math]\displaystyle{ \mathsf{append} }[/math] can be given a similar family of types, such as [math]\displaystyle{ (([\mathsf{Int}], [\mathsf{Int}]) \to [\mathsf{Int}]) }[/math], [math]\displaystyle{ (([\mathsf{Bool}], [\mathsf{Bool}]) \to [\mathsf{Bool}]) }[/math], and so on, where [math]\displaystyle{ [T] }[/math] denotes a list of elements of type [math]\displaystyle{ T }[/math]. The most general type is therefore

[math]\displaystyle{ \mathsf{append} : \forall \alpha. [\alpha] \times [\alpha] \to [\alpha] }[/math]

which can be instantiated to any type in the family.

Parametrically polymorphic functions like [math]\displaystyle{ \mathsf{id} }[/math] and [math]\displaystyle{ \mathsf{append} }[/math] are said to be parameterized over an arbitrary type [math]\displaystyle{ \alpha }[/math]. Both [math]\displaystyle{ \mathsf{id} }[/math] and [math]\displaystyle{ \mathsf{append} }[/math] are parameterized over a single type, but functions may be parameterized over arbitrarily many types. For example, the [math]\displaystyle{ \mathsf{fst} }[/math] and [math]\displaystyle{ \mathsf{snd} }[/math] functions that return the first and second elements of a pair, respectively, can be given the following types:

[math]\displaystyle{ \begin{aligned} \mathsf{fst} & : \forall \alpha. \forall \beta. \alpha \times \beta \to \alpha \\ \mathsf{snd} & : \forall \alpha. \forall \beta. \alpha \times \beta \to \beta \end{aligned} }[/math]

In the expression [math]\displaystyle{ \mathsf{fst}((3, \mathsf{true})) }[/math], [math]\displaystyle{ \alpha }[/math] is instantiated to [math]\displaystyle{ \mathsf{Int} }[/math] and [math]\displaystyle{ \beta }[/math] is instantiated to [math]\displaystyle{ \mathsf{Bool} }[/math] in the call to [math]\displaystyle{ \mathsf{fst} }[/math], so the type of the overall expression is [math]\displaystyle{ \mathsf{Int} }[/math].

The syntax used to introduce parametric polymorphism varies significantly between programming languages. For example, in some programming languages, such as Haskell, the [math]\displaystyle{ \forall \alpha }[/math] quantifier is implicit and may be omitted. Other languages require types to be instantiated explicitly at some or all of a parametrically polymorphic function's call sites.

History

Parametric polymorphism was first introduced to programming languages in ML in 1975. Today it exists in Standard ML, OCaml, F#, Ada, Haskell, Mercury, Visual Prolog, Scala, Julia, Python, TypeScript, C++ and others. Java, C#, Visual Basic .NET and Delphi have each introduced "generics" for parametric polymorphism. Some implementations of type polymorphism are superficially similar to parametric polymorphism while also introducing ad hoc aspects. One example is C++ template specialization.

Predicativity, impredicativity, and higher-rank polymorphism

Rank-1 (predicative) polymorphism

In a predicative type system (also known as a prenex polymorphic system), type variables may not be instantiated with polymorphic types. Predicative type theories include Martin-Löf type theory and Nuprl. This is very similar to what is called "ML-style" or "Let-polymorphism" (technically ML's Let-polymorphism has a few other syntactic restrictions). This restriction makes the distinction between polymorphic and non-polymorphic types very important; thus in predicative systems polymorphic types are sometimes referred to as type schemas to distinguish them from ordinary (monomorphic) types, which are sometimes called monotypes.

A consequence of predicativity is that all types can be written in a form that places all quantifiers at the outermost (prenex) position. For example, consider the [math]\displaystyle{ \mathsf{append} }[/math] function described above, which has the following type:

[math]\displaystyle{ \mathsf{append} : \forall \alpha. [\alpha] \times [\alpha] \to [\alpha] }[/math]

In order to apply this function to a pair of lists, a concrete type [math]\displaystyle{ T }[/math] must be substituted for the variable [math]\displaystyle{ \alpha }[/math] such that the resulting function type is consistent with the types of the arguments. In an impredicative system, [math]\displaystyle{ T }[/math] may be any type whatsoever, including a type that is itself polymorphic; thus [math]\displaystyle{ \mathsf{append} }[/math] can be applied to pairs of lists with elements of any type—even to lists of polymorphic functions such as [math]\displaystyle{ \mathsf{append} }[/math] itself. Polymorphism in the language ML is predicative. This is because predicativity, together with other restrictions, makes the type system simple enough that full type inference is always possible.

As a practical example, OCaml (a descendant or dialect of ML) performs type inference and supports impredicative polymorphism, but in some cases when impredicative polymorphism is used, the system's type inference is incomplete unless some explicit type annotations are provided by the programmer.

Higher-rank polymorphism

Some type systems support an impredicative function type constructor even though other type constructors remain predicative. For example, the type [math]\displaystyle{ (\forall \alpha. \alpha \rightarrow \alpha) \rightarrow T }[/math] is permitted in a system that supports higher-rank polymorphism, even though [math]\displaystyle{ [\forall \alpha. \alpha \rightarrow \alpha] }[/math] may not be.

A type is said to be of rank k (for some fixed integer k) if no path from its root to a [math]\displaystyle{ \forall }[/math] quantifier passes to the left of k or more arrows, when the type is drawn as a tree. A type system is said to support rank-k polymorphism if it admits types with rank less than or equal to k. For example, a type system that supports rank-2 polymorphism would allow [math]\displaystyle{ (\forall \alpha. \alpha \rightarrow \alpha) \rightarrow T }[/math] but not [math]\displaystyle{ ((\forall \alpha. \alpha \rightarrow \alpha) \rightarrow T) \rightarrow T }[/math]. A type system that admits types of arbitrary rank is said to be "rank-n polymorphic".

Type inference for rank-2 polymorphism is decidable, but for rank-3 and above, it is not.

Impredicative polymorphism

Impredicative polymorphism (also called first-class polymorphism) is the most powerful form of parametric polymorphism. In formal logic, a definition is said to be impredicative if it is self-referential; in type theory, it refers to the ability for a type to be in the domain of a quantifier it contains. This allows the instantiation of any type variable with any type, including polymorphic types. An example of a system supporting full impredicativity is System F, which allows instantiating [math]\displaystyle{ \forall \alpha. \alpha \to \alpha }[/math] at any type, including itself.

In type theory, the most frequently studied impredicative typed λ-calculi are based on those of the lambda cube, especially System F.

Bounded parametric polymorphism

In 1985, Luca Cardelli and Peter Wegner recognized the advantages of allowing bounds on the type parameters. Many operations require some knowledge of the data types, but can otherwise work parametrically. For example, to check whether an item is included in a list, we need to compare the items for equality. In Standard ML, type parameters of the form ’’a are restricted so that the equality operation is available, thus the function would have the type ’’a × ’’a list → bool and ’’a can only be a type with defined equality. In Haskell, bounding is achieved by requiring types to belong to a type class; thus the same function has the type [math]\displaystyle{ \mathrm{Eq} \, \alpha \, \Rightarrow \alpha \, \rightarrow \left[\alpha \right] \rightarrow \mathrm{Bool} }[/math] in Haskell. In most object-oriented programming languages that support parametric polymorphism, parameters can be constrained to be subtypes of a given type (see the articles Subtype polymorphism and Generic programming).

See also

• Parametricity
• Polymorphic recursion
• Type class
• Trait (computer programming)

References

• Hindley, J. Roger (1969), "The principal type scheme of an object in combinatory logic", Transactions of the American Mathematical Society 146: 29–60, doi:10.2307/1995158 .
• "Une Extension de l'Interpretation de Gödel à l'Analyse, et son Application à l'Élimination des Coupures dans l'Analyse et la Théorie des Types" (in fr). 63. Amsterdam. 1971. pp. 63–92. doi:10.1016/S0049-237X(08)70843-7. ISBN 9780720422597. 
• Girard, Jean-Yves (1972) (in fr), Interprétation fonctionnelle et élimination des coupures de l'arithmétique d'ordre supérieur, Université Paris 7 .
• Reynolds, John C. (1974), "Towards a Theory of Type Structure", Colloque Sur la Programmation, Lecture Notes in Computer Science (Paris) 19: 408–425, doi:10.1007/3-540-06859-7_148, ISBN 978-3-540-06859-4, https://figshare.com/articles/journal_contribution/6611015 .
• Milner, Robin (1978). "A Theory of Type Polymorphism in Programming". Journal of Computer and System Sciences 17 (3): 348–375. doi:10.1016/0022-0000(78)90014-4. https://www.pure.ed.ac.uk/ws/files/15143545/1_s2.0_0022000078900144_main.pdf. 
• Cardelli, Luca; Wegner, Peter (December 1985). "On Understanding Types, Data Abstraction, and Polymorphism". ACM Computing Surveys 17 (4): 471–523. doi:10.1145/6041.6042. ISSN 0360-0300. http://lucacardelli.name/Papers/OnUnderstanding.A4.pdf. 
• Pierce, Benjamin C. (2002). Types and Programming Languages. MIT Press. ISBN 978-0-262-16209-8.