DNSS point

From HandWiki

DNSS points, also known as Sethi-Skiba points,[1] arise in optimal control problems that exhibit multiple optimal solutions. A DNSS point[math]\displaystyle{ - }[/math]named alphabetically after Deckert and Nishimura,[2] Sethi,[3][4][5] and Skiba[6][math]\displaystyle{ - }[/math]is an indifference point in an optimal control problem such that starting from such a point, the problem has more than one different optimal solutions. A good discussion of such points can be found in Grass et al.[7] [8][9]

Definition

Of particular interest here are discounted infinite horizon optimal control problems that are autonomous.[10] These problems can be formulated as

[math]\displaystyle{ \max_{u(t)\in \Omega}\int_0^{\infty} e^{-\rho t} \varphi\left(x(t), u(t)\right)dt }[/math]

s.t.

[math]\displaystyle{ \dot{x}(t) = f\left(x(t), u(t)\right), x(0) = x_{0}, }[/math]

where [math]\displaystyle{ \rho \gt 0 }[/math] is the discount rate, [math]\displaystyle{ x(t) }[/math] and [math]\displaystyle{ u(t) }[/math] are the state and control variables, respectively, at time [math]\displaystyle{ t }[/math], functions [math]\displaystyle{ \varphi }[/math] and [math]\displaystyle{ f }[/math] are assumed to be continuously differentiable with respect to their arguments and they do not depend explicitly on time [math]\displaystyle{ t }[/math], and [math]\displaystyle{ \Omega }[/math] is the set of feasible controls and it also is explicitly independent of time [math]\displaystyle{ t }[/math]. Furthermore, it is assumed that the integral converges for any admissible solution [math]\displaystyle{ \left(x(.), u(.)\right) }[/math]. In such a problem with one-dimensional state variable [math]\displaystyle{ x }[/math], the initial state [math]\displaystyle{ x_{0} }[/math] is called a DNSS point if the system starting from it exhibits multiple optimal solutions or equilibria. Thus, at least in the neighborhood of [math]\displaystyle{ x_0 }[/math], the system moves to one equilibrium for [math]\displaystyle{ x \gt x_0 }[/math] and to another for [math]\displaystyle{ x \lt x_0 }[/math]. In this sense, [math]\displaystyle{ x_0 }[/math] is an indifference point from which the system could move to either of the two equilibria.

For two-dimensional optimal control problems, Grass et al.[7] and Zeiler et al.[11] present examples that exhibit DNSS curves.

Some references on the application of DNSS points are Caulkins et al.[12] and Zeiler et al.[13]

History

Suresh P. Sethi identified such indifference points for the first time in 1977.[3] Further, Skiba,[6] Sethi,[4][5] and Deckert and Nishimura[2] explored these indifference points in economic models. The term DNSS (Deckert, Nishimura, Sethi, Skiba) points, introduced by Grass et al.,[7] recognizes (alphabetically) the contributions of these authors.

These indifference points have been referred to earlier as Skiba points or DNS points in the literature.[7]

Example

A simple problem exhibiting this behavior is given by [math]\displaystyle{ \varphi\left(x,u\right) =xu, }[/math] [math]\displaystyle{ f\left(x,u\right) = -x + u, }[/math] and [math]\displaystyle{ \Omega = \left[-1, 1\right] }[/math]. It is shown in Grass et al.[7] that [math]\displaystyle{ x_{0} = 0 }[/math] is a DNSS point for this problem because the optimal path [math]\displaystyle{ x(t) }[/math] can be either [math]\displaystyle{ \left(1-e^{-t}\right) }[/math] or [math]\displaystyle{ \left(-1+e^{-t}\right) }[/math]. Note that for [math]\displaystyle{ x_{0} \lt 0 }[/math], the optimal path is [math]\displaystyle{ x(t) = -1 + e^{-t\left(x_{0}+1 \right)} }[/math] and for [math]\displaystyle{ x_{0} \gt 0 }[/math], the optimal path is [math]\displaystyle{ x(t) = 1 + e^{-t\left(x_{0}-1 \right)} }[/math].

Extensions

For further details and extensions, the reader is referred to Grass et al.[7]

References

  1. Sethi, Suresh P. (2021). "Optimal Control Theory" (in en-gb). Sethi, S.P. (2021). " Optimal Control Theory: Applications to Management Science and Economics". Fourth Edition, Springer Nature Switzerland AG,ISBN 978-3-319-98236-6. doi:10.1007/978-3-319-98237-3. ISBN 978-3-319-98236-6. https://doi.org/10.1007/978-3-319-98237-3. 
  2. 2.0 2.1 Deckert, D.W.; Nishimura, K. (1983). "A Complete Characterization of Optimal Growth Paths in an Aggregated Model with Nonconcave Production Function". Journal of Economic Theory 31 (2): 332–354. doi:10.1016/0022-0531(83)90081-9. 
  3. 3.0 3.1 Sethi, S.P. (1977). "Nearest Feasible Paths in Optimal Control Problems: Theory, Examples, and Counterexamples". Journal of Optimization Theory and Applications 23 (4): 563–579. doi:10.1007/BF00933297. 
  4. 4.0 4.1 Sethi, S.P. (1979). "Optimal Advertising Policy with the Contagion Model". Journal of Optimization Theory and Applications 29 (4): 615–627. doi:10.1007/BF00934454. 
  5. 5.0 5.1 Sethi, S.P., "Optimal Quarantine Programmes for Controlling an Epidemic Spread," Journal of Operational Research Society, 29(3), 1978, 265-268. JSTOR 3009454 SSRN 3587573
  6. 6.0 6.1 Skiba, A.K. (1978). "Optimal Growth with a Convex-Concave Production Function". Econometrica 46 (3): 527–539. doi:10.2307/1914229. 
  7. 7.0 7.1 7.2 7.3 7.4 7.5 Grass, D.; Caulkins, J. P.; Feichtinger, G.; Tragler, G.; Behrens, D. A. (2008). Optimal Control of Nonlinear Processes: With Applications in Drugs, Corruption, and Terror. Springer. ISBN 978-3-540-77646-8. 
  8. Sethi, S.P., Optimal Control Theory: Applications to Management Science and Economics, Third Edition, Springer Nature Switzerland AG, 2019. (565 pages – ISBN:978-3-319-98236-6) Springer Link.
  9. Caulkins, J. P., Grass, D., Feichtinger, G., Hartl, R. F., Kort, P. M., Prskawetz, A., Seidl, A., Wrzaczek, A. (2020). “When should the Covid-19 lockdown end?”. OR News, Ausgabe 69: 10-13
  10. Sethi, S. P.; Thompson, G. L. (2000). Optimal Control Theory: Applications to Management Science and Economics (Second ed.). Springer. ISBN 0-387-28092-8.  Slides are available at http://www.utdallas.edu/~sethi/OPRE7320presentation.html
  11. Zeiler, I., Caulkins, J., Grass, D., Tragler, G. (2009). Keeping Options Open: An Optimal Control Model with Trajectories that Reach a DNSS Point in Positive Time. SIAM Journal on Control and Optimization, Vol. 48, No. 6, pp. 3698-3707.| doi =10.1137/080719741 |
  12. Caulkins, J. P.; Feichtinger, G.; Grass, D.; Tragler, G. (2009). "Optimal control of terrorism and global reputation: A case study with novel threshold behavior". Operations Research Letters 37 (6): 387–391. doi:10.1016/j.orl.2009.07.003. 
  13. I. Zeiler, J. P. Caulkins, and G. Tragler. When Two Become One: Optimal Control of Interacting Drug. Working paper, Vienna University of Technology, Vienna, Austria