Residue number system
A residue numeral system (RNS) is a numeral system representing integers by their values modulo several pairwise coprime integers called the moduli. This representation is allowed by the Chinese remainder theorem, which asserts that, if M is the product of the moduli, there is, in an interval of length M, exactly one integer having any given set of modular values. The arithmetic of a residue numeral system is also called multi-modular arithmetic.
Multi-modular arithmetic is widely used for computation with large integers, typically in linear algebra, because it provides faster computation than with the usual numeral systems, even when the time for converting between numeral systems is taken into account. Other applications of multi-modular arithmetic include polynomial greatest common divisor, Gröbner basis computation and cryptography.
Definition
A residue numeral system is defined by a set of k integers
- [math]\displaystyle{ \{ m_1, m_2, m_3,\ldots, m_k\}, }[/math]
called the moduli, which are generally supposed to be pairwise coprime (that is, any two of them have a greatest common divisor equal to one). Residue number systems have been defined for non-coprime moduli, but are not commonly used because of worse properties. Therefore, they will not be considered in the remainder of this article.[1]
An integer x is represented in the residue numeral system by the set of its remainders
- [math]\displaystyle{ \{ x_1,x_2,x_3,\ldots,x_k \} }[/math]
under Euclidean division by the moduli. That is
- [math]\displaystyle{ x_i = x \operatorname{mod}m_i, }[/math]
and
- [math]\displaystyle{ 0\le x_i\lt m_i }[/math]
for every i
Let M be the product of all the [math]\displaystyle{ m_i }[/math]. Two integers whose difference is a multiple of M have the same representation in the residue numeral system defined by the mis. More precisely, the Chinese remainder theorem asserts that each of the M different sets of possible residues represents exactly one residue class modulo M. That is, each set of residues represents exactly one integer [math]\displaystyle{ X }[/math] in the interval [math]\displaystyle{ 0,\dots,M-1 }[/math]. For signed numbers, the dynamic range is [math]\displaystyle{ {-\lfloor M/2 \rfloor} \le X \le \lfloor (M-1)/2 \rfloor }[/math] (when [math]\displaystyle{ M }[/math] is even, generally an extra negative value is represented).[2]
Arithmetic operations
For adding, subtracting and multiplying numbers represented in a residue number system, it suffices to perform the same modular operation on each pair of residues. More precisely, if
- [math]\displaystyle{ [m_1, \ldots, m_k] }[/math]
is the list of moduli, the sum of the integers x and y, respectively represented by the residues [math]\displaystyle{ [x_1,\ldots, x_k] }[/math] and [math]\displaystyle{ [y_1,\ldots, y_k], }[/math] is the integer z represented by [math]\displaystyle{ [z_1,\ldots, z_k], }[/math] such that
- [math]\displaystyle{ z_i= (x_i+y_i)\operatorname{mod} m_i, }[/math]
for i = 1, ..., k (as usual, mod denotes the modulo operation consisting of taking the remainder of the Euclidean division by the right operand). Subtraction and multiplication are defined similarly.
For a succession of operations, it is not necessary to apply the modulo operation at each step. It may be applied at the end of the computation, or, during the computation, for avoiding overflow of hardware operations.
However, operations such as magnitude comparison, sign computation, overflow detection, scaling, and division are difficult to perform in a residue number system.[3]
Comparison
If two integers are equal, then all their residues are equal. Conversely, if all residues are equal, then the two integers are equal, or their differences is a multiple of M. It follows that testing equality is easy.
At the opposite, testing inequalities (x < y) is difficult and, usually, requires to convert integers to the standard representation. As a consequence, this representation of numbers is not suitable for algorithms using inequality tests, such Euclidean division and Euclidean algorithm.
Division
Division in residue numeral systems is problematic. On the other hand, if [math]\displaystyle{ B }[/math] is coprime with [math]\displaystyle{ M }[/math] (that is [math]\displaystyle{ b_i\not =0 }[/math]) then
- [math]\displaystyle{ C=A\cdot B^{-1} \mod M }[/math]
can be easily calculated by
- [math]\displaystyle{ c_i=a_i \cdot b_i^{-1} \mod m_i, }[/math]
where [math]\displaystyle{ B^{-1} }[/math] is multiplicative inverse of [math]\displaystyle{ B }[/math] modulo [math]\displaystyle{ M }[/math], and [math]\displaystyle{ b_i^{-1} }[/math] is multiplicative inverse of [math]\displaystyle{ b_i }[/math] modulo [math]\displaystyle{ m_i }[/math].
Applications
RNS have applications in the field of digital computer arithmetic. By decomposing in this a large integer into a set of smaller integers, a large calculation can be performed as a series of smaller calculations that can be performed independently and in parallel.
See also
References
- ↑ Computer Arithmetic: Algorithms and Hardware Designs (2 ed.). New York, USA: Oxford University Press. 2010. ISBN 978-0-19-532848-6. http://www.ece.ucsb.edu/~parhami/text_comp_arit.htm. Retrieved 2021-01-23. (xxv+641 pages)
- ↑ Hung, C.Y.; Parhami, B. (1994-02-01). "An approximate sign detection method for residue numbers and its application to RNS division" (in en). Computers & Mathematics with Applications 27 (4): 23–35. doi:10.1016/0898-1221(94)90052-3. https://core.ac.uk/download/pdf/81980039.pdf.
- ↑ "Using Floating-Point Intervals for Non-Modular Computations in Residue Number System". IEEE Access 8: 58603–58619. 2020-04-07. doi:10.1109/ACCESS.2020.2982365. ISSN 2169-3536. Bibcode: 2020IEEEA...858603I.
Further reading
- Residue Arithmetic and its Applications to Computer Technology (1 ed.). New York, USA: McGraw-Hill. 1967.
- Residue Number System Arithmetic: Modern Applications in Digital Signal Processing. IEEE Press Reprint Series (1 ed.). New York, USA: IEEE Circuits and Systems Society, IEEE Press. 1986. IEEE order code PC01982. ISBN 0-87942-205-X. (viii+418+6 pages)
- Chervyakov, N. I.; Molahosseini, A. S.; Lyakhov, P. A. (2017). Residue-to-binary conversion for general moduli sets based on approximate Chinese remainder theorem. International Journal of Computer Mathematics, 94:9, 1833-1849, doi: 10.1080/00207160.2016.1247439.
- "Large Systems of Boolean Functions: Realization by Modular Arithmetic Methods". Automation and Remote Control 65 (6): 871–892. June 2004. doi:10.1023/B:AURC.0000030901.74901.44. CODEN AURCAT. Mi at1588. ISSN 0005-1179. https://link.springer.com/article/10.1023%2FB%3AAURC.0000030901.74901.44.
- Chervyakov, N. I.; Lyakhov, P. A.; Deryabin, M. A. (2020). Residue Number System-Based Solution for Reducing the Hardware Cost of a Convolutional Neural Network. Neurocomputing, 407, 439-453, doi: 10.1016/j.neucom.2020.04.018.
- "Efficient RNS bases for Cryptography". IMACS'05: World Congress: Scientific Computation Applied Mathematics and Simulation. (Paris, France). 2006-10-06. HAL Id: lirmm-00106470. http://hal-lirmm.ccsd.cnrs.fr/docs/00/10/64/70/PDF/D547.PDF. Retrieved 2021-01-23. (1+7 pages)
- Residue Number Systems: Theory and Implementation. London, UK: Imperial College Press. 2007. ISBN 978-1-86094-866-4. (296 pages)
- Residue Number Systems: Theory and Applications (1 ed.). Birkhäuser / Springer International Publishing Switzerland. 2016. doi:10.1007/978-3-319-41385-3. ISBN 978-3-319-41383-9. https://link.springer.com/book/10.1007%2F978-3-319-41385-3. (351 pages)
- Embedded Systems Design with Special Arithmetic and Number Systems (1 ed.). Springer International Publishing AG. 2017-03-21. doi:10.1007/978-3-319-49742-6. ISBN 978-3-319-49741-9. https://link.springer.com/book/10.1007/978-3-319-49742-6. (389 pages)
- "Division algorithms". http://www.cs.rpi.edu/research/ps/93-9.ps.
- The Art of Computer Programming. Addison Wesley.
- "A multimodular algorithm for computing Bernoulli numbers.". Mathematics of Computation 79 (272): 2361–2370. 2010. doi:10.1090/S0025-5718-2010-02367-1.
- "Fast multivariate power series multiplication in characteristic zero". SADIO Electronic Journal on Informatics and Operations Research 5 (1): 1–10. 2003.
- "Efficient arithmetic in successive algebraic extension fields using symmetries". Mathematics in Computer Science 6 (3): 217–233. 2012. doi:10.1007/s11786-012-0112-y.
- "Usage of modular techniques for efficient computation of ideal operations". International Workshop on Computer Algebra in Scientific Computing. Berlin / Heidelberg, Germany: Springer. September 2012. pp. 361–362.
- "Modular Arithmetic for Solving Linear Equations on the GPU". Seminar on Numerical Analysis. January 2012. pp. 68–70.
- "Exact linear algebra algorithmic: Theory and practice". Proceedings of the 2015 ACM on International Symposium on Symbolic and Algebraic Computation. Association for Computing Machinery. June 2015. pp. 17–18.
- "On the complexity of the Lickteig–Roy subresultant algorithm". Journal of Symbolic Computation. 2018.
- "Multi-Modular Approach to Polynomial-Time Factorization of Bivariate Integral Polynomials". Journal of Symbolic Computation 17 (6): 545–563. 1994. doi:10.1006/jsco.1994.1034.
- Isupov, Konstantin (2021). "High-Performance Computation in Residue Number System Using Floating-Point Arithmetic". Computation. 9 (2): 9. doi:10.3390/computation9020009. ISSN 2079-3197.
Original source: https://en.wikipedia.org/wiki/Residue number system.
Read more |