Scientific programming language
In computer programming, a scientific programming language can refer to two degrees of the same concept. In a wide sense, a scientific programming language is a programming language that is used widely for computational science and computational mathematics. In this sense, C/C++ and Python[1] can be considered scientific programming languages.
In a stronger sense, a scientific programming language is one that is designed and optimized for the use of mathematical formula and matrices.[2] Such languages are characterized not only by the availability of libraries performing mathematical or scientific functions, but by the syntax of the language itself.[3] For example, neither C++ nor Python have built-in matrix types or functions for matrix arithmetic (addition, multiplication etc.); instead, this functionality is made available through standard libraries. Scientific programming languages in the stronger sense include ALGOL, APL, Fortran, J, Julia, Maple, MATLAB, Octave, and R.[4][5]
Scientific programming languages should not be confused with scientific language in general, which refers loosely to the higher standards in precision, correctness and concision expected from practitioners of the scientific method.
Examples
Linear algebra
Scientific programming languages provide facilities to work with linear algebra. For example, the following Julia program solves a system of linear equations:
A = rand(20, 20) # A is a 20x20 matrix b = rand(20) # b is a 20-element vector x = A\b # x is the solution to A*x = b
Working with large vectors and matrices is a key feature of these languages, as linear algebra lays the foundation to mathematical optimization, which in turn enables major applications such as deep learning.
Mathematical optimization
In a scientific programming language, we can compute function optima with a syntax close to mathematical language. For instance, the following Julia code finds the minimum of the polynomial [math]\displaystyle{ P(x, y) = x^2 - 3 x y + 5 y^2 - 7 y + 3 }[/math].
using Optim
P(x,y) = x^2 - 3x*y + 5y^2 - 7y + 3
z₀ = [ 0.0
0.0 ] # starting point for optimization algorithm
optimize(z -> P(z...), z₀, Newton();
autodiff = :forward)
In this example, Newton's method for minimizing is used. Modern scientific programming languages will use automatic differentiation to compute the gradients and Hessians of the function given as input; cf. differentiable programming. Here, automatic forward differentiation has been chosen for that task. Older scientific programming languages such as the venerable Fortran would require the programmer to pass, next to the function to be optimized, a function that computes the gradient, and a function that computes the Hessian.
With more knowledge of the function to be minimized, more efficient algorithms can be used. For instance, convex optimization provides faster computations when the function is convex, quadratic programming provides faster computations when the function is at most quadratic in its variables, and linear programming when the function is at most linear.
See also
- Linear algebra
- Mathematical optimization
- Scientific terminology
References
- ↑ Karakan, Burak (1 May 2020). "Python vs R for Data Science". Towards Data Science. https://towardsdatascience.com/python-vs-r-for-data-science-6a83e4541000.
- ↑ "Definition of scientific language". Ziff Davis. https://www.pcmag.com/encyclopedia/term/scientific-language.
- ↑ "scientific language - Definition of scientific language". The Computer Language Company Inc. http://www.yourdictionary.com/scientific-language.
- ↑ Ning, Andrew. "Scientific Programming Languages". Brigham Young University. https://flow.byu.edu/posts/sci-prog-lang.
- ↑ Zachary, Joseph. "Introduction to Scientific Programming: Computational Problem Solving Using Maple and C". University of Utah. https://www.cs.utah.edu/~zachary/IntroSciProg.html.
 |  |
