Skyline operator

Short description: Database filter

The skyline operator is the subject of an optimization problem and computes the Pareto optimum on tuples with multiple dimensions.

This operator is an extension to SQL proposed by Börzsönyi et al. to filter results from a database to keep only those objects that are not worse in multiple dimensions than any other. The name skyline comes from the view on Manhattan from the Hudson River, where those buildings can be seen that are not hidden by any other. A building is visible if it is not dominated by a building that is taller or closer to the river (two dimensions, distance to the river minimized, height maximized). Another application of the skyline operator involves selecting a hotel for a holiday. The user wants the hotel to be both cheap and close to the beach. However, hotels that are close to the beach may also be expensive. In this case, the skyline operator would only present those hotels that are not worse than any other hotel in both price and distance to the beach.

Formal specification

The skyline operator returns tuples that are not dominated by any other tuple. A tuple dominates another if it is at least as good in all dimensions and better in at least one dimension. Formally, we can think of each tuple as a vector [math]\displaystyle{ p,q \in \mathbb{R}^n }[/math]. [math]\displaystyle{ p }[/math] dominates [math]\displaystyle{ q }[/math] (written: [math]\displaystyle{ p \succ q }[/math]) if [math]\displaystyle{ p }[/math] is at least as good as [math]\displaystyle{ q }[/math] in every dimension, and superior in at least one: [math]\displaystyle{ p \succ q \Leftrightarrow \forall i \in [n]. p[i] \succeq q[i] \wedge \exists j \in [n]. p[j] \succ q[j]. }[/math] Dominance ([math]\displaystyle{ p \succ q }[/math]) can be defined as any strict partial ordering, for example greater (with [math]\displaystyle{ \succ := \gt }[/math] and [math]\displaystyle{ \succeq := \geq }[/math]) or less (with [math]\displaystyle{ \succ := \lt }[/math] and [math]\displaystyle{ \succeq := \leq }[/math]).

Assuming two dimensions and defining dominance in both dimensions as greater, we can compute the skyline in SQL-92 as follows:

WITH tuples(id,i,j) as (values(1,1,1),(1,2,1),(1,1,2))
SELECT * FROM tuples t1
WHERE NOT EXISTS (                    -- which is not dominated by
  SELECT * FROM tuples t2             -- a tuple that is
  WHERE t2.i >= t1.i and t2.j >= t1.j -- at least as good in all dimensions
    AND (t2.i > t1.i or t2.j > t1.j)  -- and better in at least one dimension
);

Proposed syntax

As an extension to SQL, Börzsönyi et al. proposed the following syntax for the skyline operator:

SELECT ... FROM ... WHERE ...
GROUP BY ... HAVING ...
SKYLINE OF [DISTINCT] d1 [MIN | MAX | DIFF],
                 ..., dm [MIN | MAX | DIFF]
ORDER BY ...

where d₁, ... d_m denote the dimensions of the skyline and MIN, MAX and DIFF specify whether the value in that dimension should be minimised, maximised or simply be different.

Without an SQL extension, the SQL query requires an antijoin with not exists:

SELECT ... FROM (...) q WHERE NOT EXISTS (
  SELECT * FROM (...) p WHERE p.d1 [<= | >=] q.d1 AND ... AND p.dm [<= | >=] q.dm
     AND (p.d1 [< | >] q.d1 OR ... OR p.dm [< | > ] q.dm ))

Implementation

The skyline operator can be implemented directly in SQL using current SQL constructs, but this has been shown to be very slow in disk-based database systems. Other algorithms have been proposed that make use of divide and conquer, indices, MapReduce and general-purpose computing on graphics cards. Skyline queries on data streams (i.e. continuous skyline queries) have been studied in the context of parallel query processing on multicores, owing to their wide diffusion in real-time decision making problems and data streaming analytics.

See also

• Pareto efficiency
• Multi-objective optimization
• Convex hull
• Nearest neighbor search
• Selection algorithm