Regenerative process

From HandWiki
Regenerative processes have been used to model problems in inventory control. The inventory in a warehouse such as this one decreases via a stochastic process due to sales until it gets replenished by a new order.[1]

In applied probability, a regenerative process is a class of stochastic process with the property that certain portions of the process can be treated as being statistically independent of each other.[2] This property can be used in the derivation of theoretical properties of such processes.

History

Regenerative processes were first defined by Walter L. Smith in Proceedings of the Royal Society A in 1955.Cite error: Closing </ref> missing for <ref> tag These time point may themselves be determined by the evolution of the process. That is to say, the process {X(t), t ≥ 0} is a regenerative process if there exist time points 0 ≤ T0 < T1 < T2 < ... such that the post-Tk process {X(Tk + t) : t ≥ 0}

  • has the same distribution as the post-T0 process {X(T0 + t) : t ≥ 0}
  • is independent of the pre-Tk process {X(t) : 0 ≤ t < Tk}

for k ≥ 1.[3] Intuitively this means a regenerative process can be split into i.i.d. cycles.[4]

When T0 = 0, X(t) is called a nondelayed regenerative process. Else, the process is called a delayed regenerative process.[3]

Examples

  • Renewal processes are regenerative processes, with T1 being the first renewal.[5]
  • Alternating renewal processes, where a system alternates between an 'on' state and an 'off' state.[5]
  • A recurrent Markov chain is a regenerative process, with T1 being the time of first recurrence.[5] This includes Harris chains.
  • Reflected Brownian motion is a regenerative process (where one measures the time it takes particles to leave and come back).[4]

Properties

  • By the renewal reward theorem, with probability 1,[6]
[math]\displaystyle{ \lim_{t \to \infty} \frac{1}{t}\int_0^t X(s) ds= \frac{\mathbb{E}[R]}{\mathbb{E}[\tau]}. }[/math]
where [math]\displaystyle{ \tau }[/math] is the length of the first cycle and [math]\displaystyle{ R=\int_0^\tau X(s) ds }[/math] is the value over the first cycle.

References

  1. Hurter, A. P.; Kaminsky, F. C. (1967). "An Application of Regenerative Stochastic Processes to a Problem in Inventory Control". Operations Research 15 (3): 467–472. doi:10.1287/opre.15.3.467. 
  2. Ross, S. M. (2010). "Renewal Theory and Its Applications". Introduction to Probability Models. pp. 421–641. doi:10.1016/B978-0-12-375686-2.00003-0. ISBN 9780123756862. 
  3. 3.0 3.1 Haas, Peter J. (2002). "Regenerative Simulation". Stochastic Petri Nets. Springer Series in Operations Research and Financial Engineering. pp. 189–273. doi:10.1007/0-387-21552-2_6. ISBN 0-387-95445-7. 
  4. 4.0 4.1 Asmussen, Søren (2003). "Regenerative Processes". Applied Probability and Queues. Stochastic Modelling and Applied Probability. 51. pp. 168–185. doi:10.1007/0-387-21525-5_6. ISBN 978-0-387-00211-8. 
  5. 5.0 5.1 5.2 Cite error: Invalid <ref> tag; no text was provided for refs named Ross
  6. 6.0 6.1 Sigman, Karl (2009) Regenerative Processes, lecture notes