XOR swap algorithm

From HandWiki
Short description: Binary arithmetic algorithm
With three XOR operations the binary values 1010 and 0011 are exchanged between variables.
Using the XOR swap algorithm to exchange nibbles between variables without the use of temporary storage

In computer programming, the exclusive or swap (sometimes shortened to XOR swap) is an algorithm that uses the exclusive or bitwise operation to swap the values of two variables without using the temporary variable which is normally required.

The algorithm is primarily a novelty and a way of demonstrating properties of the exclusive or operation. It is sometimes discussed as a program optimization, but there are almost no cases where swapping via exclusive or provides benefit over the standard, obvious technique.

The algorithm

Conventional swapping requires the use of a temporary storage variable. Using the XOR swap algorithm, however, no temporary storage is needed. The algorithm is as follows:[1][2]

X := Y XOR X; // XOR the values and store the result in X
Y := X XOR Y; // XOR the values and store the result in Y
X := Y XOR X; // XOR the values and store the result in X

Since XOR is a commutative operation, either X XOR Y or Y XOR X can be used interchangeably in any of the foregoing three lines. Note that on some architectures the first operand of the XOR instruction specifies the target location at which the result of the operation is stored, preventing this interchangeability. The algorithm typically corresponds to three machine-code instructions, represented by corresponding pseudocode and assembly instructions in the three rows of the following table:

Pseudocode IBM System/370 assembly x86 assembly
X := X XOR Y XR R1,R2 xor eax, ebx
Y := Y XOR X XR R2,R1 xor ebx, eax
X := X XOR Y XR R1,R2 xor eax, ebx

In the above System/370 assembly code sample, R1 and R2 are distinct registers, and each XR operation leaves its result in the register named in the first argument. Using x86 assembly, values X and Y are in registers eax and ebx (respectively), and xor places the result of the operation in the first register.

However, in the pseudocode or high-level language version or implementation, the algorithm fails if x and y use the same storage location, since the value stored in that location will be zeroed out by the first XOR instruction, and then remain zero; it will not be "swapped with itself". This is not the same as if x and y have the same values. The trouble only comes when x and y use the same storage location, in which case their values must already be equal. That is, if x and y use the same storage location, then the line:

X := X XOR Y

sets x to zero (because x = y so X XOR Y is zero) and sets y to zero (since it uses the same storage location), causing x and y to lose their original values.

Proof of correctness

The binary operation XOR over bit strings of length [math]\displaystyle{ N }[/math] exhibits the following properties (where [math]\displaystyle{ \oplus }[/math] denotes XOR):[lower-alpha 1]

  • L1. Commutativity: [math]\displaystyle{ A \oplus B = B \oplus A }[/math]
  • L2. Associativity: [math]\displaystyle{ (A \oplus B) \oplus C = A \oplus (B \oplus C) }[/math]
  • L3. Identity exists: there is a bit string, 0, (of length N) such that [math]\displaystyle{ A \oplus 0 = A }[/math] for any [math]\displaystyle{ A }[/math]
  • L4. Each element is its own inverse: for each [math]\displaystyle{ A }[/math], [math]\displaystyle{ A \oplus A = 0 }[/math].

Suppose that we have two distinct registers R1 and R2 as in the table below, with initial values A and B respectively. We perform the operations below in sequence, and reduce our results using the properties listed above.

Step Operation Register 1 Register 2 Reduction
0 Initial value [math]\displaystyle{ A }[/math] [math]\displaystyle{ B }[/math]
1 R1 := R1 XOR R2 [math]\displaystyle{ A \oplus B }[/math] [math]\displaystyle{ B }[/math]
2 R2 := R1 XOR R2 [math]\displaystyle{ A \oplus B }[/math] [math]\displaystyle{ (A \oplus B) \oplus B = A \oplus (B \oplus B) }[/math]
[math]\displaystyle{ = A \oplus 0 }[/math]
[math]\displaystyle{ =A }[/math]
L2
L4
L3
3 R1 := R1 XOR R2 [math]\displaystyle{ (A \oplus B) \oplus A = (B \oplus A) \oplus A }[/math]
[math]\displaystyle{ = B \oplus (A \oplus A) }[/math]
[math]\displaystyle{ = B \oplus 0 }[/math]
[math]\displaystyle{ = B }[/math]
[math]\displaystyle{ \ A }[/math] L1
L2
L4
L3

Linear algebra interpretation

As XOR can be interpreted as binary addition and a pair of bits can be interpreted as a vector in a two-dimensional vector space over the field with two elements, the steps in the algorithm can be interpreted as multiplication by 2×2 matrices over the field with two elements. For simplicity, assume initially that x and y are each single bits, not bit vectors.

For example, the step:

X := X XOR Y

which also has the implicit:

Y := Y

corresponds to the matrix [math]\displaystyle{ \left(\begin{smallmatrix}1 & 1\\0 & 1\end{smallmatrix}\right) }[/math] as

[math]\displaystyle{ \begin{pmatrix}1 & 1\\0 & 1\end{pmatrix} \begin{pmatrix}x\\y\end{pmatrix} = \begin{pmatrix}x+y\\y\end{pmatrix}. }[/math]

The sequence of operations is then expressed as:

[math]\displaystyle{ \begin{pmatrix}1 & 1\\0 & 1\end{pmatrix} \begin{pmatrix}1 & 0\\1 & 1\end{pmatrix} \begin{pmatrix}1 & 1\\0 & 1\end{pmatrix} = \begin{pmatrix}0 & 1\\1 & 0\end{pmatrix} }[/math]

(working with binary values, so [math]\displaystyle{ 1 + 1 = 0 }[/math]), which expresses the elementary matrix of switching two rows (or columns) in terms of the transvections (shears) of adding one element to the other.

To generalize to where X and Y are not single bits, but instead bit vectors of length n, these 2×2 matrices are replaced by 2n×2n block matrices such as [math]\displaystyle{ \left(\begin{smallmatrix}I_n & I_n\\0 & I_n\end{smallmatrix}\right). }[/math]

These matrices are operating on values, not on variables (with storage locations), hence this interpretation abstracts away from issues of storage location and the problem of both variables sharing the same storage location.

Code example

A C function that implements the XOR swap algorithm:

void XorSwap(int *x, int *y) 
{
  if (x == y) return;
  *x ^= *y;
  *y ^= *x;
  *x ^= *y;
}

The code first checks if the addresses are distinct and uses a guard clause to exit the function early if they are equal. Without that check, if they were equal, the algorithm would fold to a triple *x ^= *x resulting in zero.

The XOR swap algorithm can also be defined with a macro:

#define XORSWAP_UNSAFE(a, b)                                                   \
  ((a) ^= (b), (b) ^= (a),                                                     \
   (a) ^= (b)) /* Doesn't work when a and b are the same object - assigns zero \
                  (0) to the object in that case */
#define XORSWAP(a, b)                                                         \
  ((&(a) == &(b)) ? (a) /* Check for distinct addresses */                    \
                  : XORSWAP_UNSAFE(a, b))

Reasons for avoidance in practice

On modern CPU architectures, the XOR technique can be slower than using a temporary variable to do swapping. At least on recent x86 CPUs, both by AMD and Intel, moving between registers regularly incurs zero latency. (This is called MOV-elimination.) Even if there is not any architectural register available to use, the XCHG instruction will be at least as fast as the three XORs taken together. Another reason is that modern CPUs strive to execute instructions in parallel via instruction pipelines. In the XOR technique, the inputs to each operation depend on the results of the previous operation, so they must be executed in strictly sequential order, negating any benefits of instruction-level parallelism.[3]

Aliasing

The XOR swap is also complicated in practice by aliasing. If an attempt is made to XOR-swap the contents of some location with itself, the result is that the location is zeroed out and its value lost. Therefore, XOR swapping must not be used blindly in a high-level language if aliasing is possible. This issue does not apply if the technique is used in assembly to swap the contents of two registers.

Similar problems occur with call by name, as in Jensen's Device, where swapping i and A[i] via a temporary variable yields incorrect results due to the arguments being related: swapping via temp = i; i = A[i]; A[i] = temp changes the value for i in the second statement, which then results in the incorrect i value for A[i] in the third statement.

Variations

The underlying principle of the XOR swap algorithm can be applied to any operation meeting criteria L1 through L4 above. Replacing XOR by addition and subtraction gives various slightly different, but largely equivalent, formulations. For example:[4]

void AddSwap( unsigned int* x, unsigned int* y )
{
  if (x != y)
  {
    *x = *x + *y;
    *y = *x - *y;
    *x = *x - *y;
  }
}

Unlike the XOR swap, this variation requires that the underlying processor or programming language uses a method such as modular arithmetic or bignums to guarantee that the computation of X + Y cannot cause an error due to integer overflow. Therefore, it is seen even more rarely in practice than the XOR swap.

However, the implementation of AddSwap above in the C programming language always works even in case of integer overflow, since, according to the C standard, addition and subtraction of unsigned integers follow the rules of modular arithmetic, i. e. are done in the cyclic group [math]\displaystyle{ \mathbb Z/2^s\mathbb Z }[/math] where [math]\displaystyle{ s }[/math] is the number of bits of unsigned int. Indeed, the correctness of the algorithm follows from the fact that the formulas [math]\displaystyle{ (x + y) - y = x }[/math] and [math]\displaystyle{ (x + y) - ((x + y) - y) = y }[/math] hold in any abelian group. This generalizes the proof for the XOR swap algorithm: XOR is both the addition and subtraction in the abelian group [math]\displaystyle{ (\mathbb Z/2\mathbb Z)^{s} }[/math] (which is the direct sum of s copies of [math]\displaystyle{ \mathbb Z/2\mathbb Z }[/math]).

This doesn't hold when dealing with the signed int type (the default for int). Signed integer overflow is an undefined behavior in C and thus modular arithmetic is not guaranteed by the standard, which may lead to incorrect results.

The sequence of operations in AddSwap can be expressed via matrix multiplication as:

[math]\displaystyle{ \begin{pmatrix}1 & -1\\0 & 1\end{pmatrix} \begin{pmatrix}1 & 0\\1 & -1\end{pmatrix} \begin{pmatrix}1 & 1\\0 & 1\end{pmatrix} = \begin{pmatrix}0 & 1\\1 & 0\end{pmatrix} }[/math]

Application to register allocation

On architectures lacking a dedicated swap instruction, because it avoids the extra temporary register, the XOR swap algorithm is required for optimal register allocation. This is particularly important for compilers using static single assignment form for register allocation; these compilers occasionally produce programs that need to swap two registers when no registers are free. The XOR swap algorithm avoids the need to reserve an extra register or to spill any registers to main memory.[5] The addition/subtraction variant can also be used for the same purpose.[6]

This method of register allocation is particularly relevant to GPU shader compilers. On modern GPU architectures, spilling variables is expensive due to limited memory bandwidth and high memory latency, while limiting register usage can improve performance due to dynamic partitioning of the register file. The XOR swap algorithm is therefore required by some GPU compilers.[7]

See also

Notes

  1. The first three properties, along with the existence of an inverse for each element, are the definition of an abelian group. The last property is the statement that every element is an involution, that is, having order 2, which is not true of all abelian groups.

References

  1. "The Magic of XOR". Cs.umd.edu. http://www.cs.umd.edu/class/sum2003/cmsc311/Notes/BitOp/xor.html. 
  2. "Swapping Values with XOR". graphics.stanford.edu. http://graphics.stanford.edu/~seander/bithacks.html#SwappingValuesXOR. 
  3. Amarasinghe, Saman; Leiserson, Charles (2010). "6.172 Performance Engineering of Software Systems, Lecture 2". Massachusetts Institute of Technology. http://ocw.mit.edu/courses/electrical-engineering-and-computer-science/6-172-performance-engineering-of-software-systems-fall-2010/video-lectures/lecture-2-bit-hacks/. 
  4. Warren, Henry S. (2003). Hacker's delight. Boston: Addison-Wesley. p. 39. ISBN 0201914654. 
  5. Pereira, Fernando Magno Quintão; Palsberg, Jens (2009). "SSA Elimination after Register Allocation". Compiler Construction. Lecture Notes in Computer Science 5501: 158–173. doi:10.1007/978-3-642-00722-4_12. ISBN 978-3-642-00721-7. http://compilers.cs.ucla.edu/fernando/publications/papers/CC09.pdf. Retrieved 17 April 2022. 
  6. Hack, Sebastian; Grund, Daniel; Goos, Gerhard (2006). "Register Allocation for Programs in SSA-Form". Compiler Construction. Lecture Notes in Computer Science 3923: 247–262. doi:10.1007/11688839_20. ISBN 978-3-540-33050-9. 
  7. Abbott, Connor; Schürmann, Daniel. "SSA-based Register Allocation for GPU Architectures". https://indico.freedesktop.org/event/1/contributions/7/attachments/8/11/SSA-based%20Allocation%20for%20GPU%20Architectures.pdf. 

fr:Échange (informatique)#En utilisant l.27op.C3.A9ration XOR pl:Zamiana wartości zmiennych