J.
Indones.
Math.
Soc.
(MIHMI)
Vol.
No.
, pp.
149Ae159.
INTEGRATED RENEWAL PROCESS
Suyono and J.
van der Weide Abstract.
The marginal distribution of integrated renewal process is derived in this Our approach is based on the theory of point processes, especially Poisson point The results are presented in the form of Laplace transforms.
INTRODUCTION
Consider arrival of passengers at a train station and model this situation as a renewal process.
It means that the inter-arrival times between consecutive passengers are assumed to be independent and identically distributed .
non-negative random variables.
Suppose that at a certain time .
a train is just departed from the station and there are no passengers left.
Passengers who come after the time 0 have to wait until the departure of the next train at some time point t Ou 0.
are interested in the waiting time of these passengers.
The total waiting time of all passengers in the time interval .
is an example of a stochastic process which we call an integrated renewal process.
The nomenclature becomes clear from the mathematical definition of the process in Section 2.
An integrated renewal process can be considered as a generalization of a stochastic process which we call an integrated Poisson process in this paper.
The expected value of the integrated Poisson process has been discussed in Ross .
The integrated renewal process has also a close connection with shot noise processes discussed by Gubner .
For asymptotic properties of this process, see Suyono and Van der Weide .
In this paper we discuss the marginal distribution of this process which is important for analyzing probabilistic characterizations of the process at any time point.
This paper is organized as follows.
In Section 2 we give a mathematical definition of an integrated renewal process.
In Section 3 we consider an integrated Received 8 November 2006, revised 4 January 2007, accepted 15 November 2007.
2000 Mathematics Subject Classification: 60K05 Key words and Phrases: renewal process, point process.
Laplace transform Suyono and van der Weide Poisson process including the variance and the marginal probability density function of the process.
In Section 4 we consider the marginal distribution of integrated renewal process and in the last section we give an example.
DEFINITIONS
Let (Xn , n Ou .
be an iid sequence of non-negative random variables having a common distribution function F .
Let Sn = i=1 Xi , n Ou 1, and set S0 = 0.
The process (N .
, t Ou .
where N .
= sup.
Ou 0 : Sn O .
is known as a renewal process.
In the sequel we will interpret the variables Xn as inter-arrival times of the renewal process.
Define for t Ou 0 N .
Y .
= We call the stochastic process (Y .
, t Ou .
integrated renewal process.
As a special case, if (N .
, t Ou .
is a Poisson process then we call the process (Y .
, t Ou .
integrated Poisson process.
Note that we can express Y .
as N .
Y .
= .
Oe Si ) = tN .
Oe Z.
, .
N .
= Si .
So if we interpret Sn , n = 1, 2, 3, .
as arrival times of passengers in a train station then Y .
represents the total waiting time of all passengers until the departure of a train at time t.
In the next sections we will discuss the marginal distributions of Y .
and Z.
INTEGRATED POISSON PROCESS
Firstly, suppose that the process (N .
, t Ou .
is an homogeneous Poisson process with rate > 0.
It is well known that given N .
= n, the n arrival times S1 , .
Sn have the same distribution as the order statistics corresponding to n independent random variables uniformly distributed on the time interval .
, .
, see e.
Ross .
Conditioning on the number of arrivals in the time interval .
, .
we obtain E.
OeY .
) O
E eOe i=1 .
OeSi ) |N .
= n P(N .
= .
Integrated Renewal Process n eOent E eOe i=1 Ui eOet where Ui , i = 1, 2, .
, n are independent and identically uniform random variables on .
, .
Since 1 A t E eOeU1 = e Oe1 , t it follows that E.
OeY .
) = .
Oe t Oe eOet ) .
From .
we deduce that E[Y .
] = 12 t2 and Var[Y .
] = 31 t3 .
Using a similar argument we can prove that Z.
has the same Laplace transform as Y .
So by uniqueness theorem for Laplace transforms we conclude that for each t.
Y .
and Z.
have the same distribution.
The distribution of Y .
has a mass at zero with P(Y .
= .
= eOet .
The probability density function fY .
of the continuous part of Y .
can be obtained by inverting the Laplace transform in .
Note that we can express .
as E.
OeY .
= e Oet Oet Oe eOet )n O n!n AnA n X (Oe.
k k eOekt n Inverting this transform we obtain, for x > 0, fY .
Oet n AA A nOe1 xnOe1 k n .
Oe k.
,O) .
(Oe.
t,O) .
Oe .
! .
Oe .
! Oo Oo = Oo eOet I1 2 x 1.
,O) .
O A p (Oe.
k eOet [.
Oe k.
] 2 .
Oe.
IkOe1 2 .
Oe k.
t,O) .
where Ik .
is the Modified Bessel function of the first kind, i.
Ik .
= .
/2.
k see Gradshteyn and Ryzhik .
/4x2 )m m!e.
Suyono and van der Weide For large t, the distribution of Y .
can be approximated by the normal distribution having mean 12 t2 and variance 13 t3 .
To prove this we will consider the characteristic function of the normalized Y .
Firstly, note that Y .
Oe 1 t2 Oei Oo 2 1 t3 Oo 3 Y .
Oe i i 3t t E e E e Oo Oo Oo 3 where i = Using .
with is replaced by i Oe1 and an expansion we obtain t t Oo Oo 1 2 t t Oe3/2 1 Oo Oo 3 Y .
Oe i Oo o.
E e t t = exp Oe i 3t Oe i 3 as t Ie O.
It follows that E e Oei Y .
Oe 1 t2 1 t3 OeIe eOe 12 tIeO which is the characteristic function of the standard normal distribution.
Now consider the case where (N .
) is a non-homogeneous Poisson process with intensity measure .
Given N .
= n, the arrival times Si , i = 1, 2, .
, n have the same distribution as the order statistics of n iid random variables having a common cumulative distribution function (.
) (.
) , x O t G.
= x > t.
By conditioning on the number of arrivals in the time interval .
, .
we get AZ t h E eOeZ.
= exp eOex Oe 1 d(.
, .
) .
From this Laplace transform we deduce that Z t Z t E[Z.
] = xd(.
, .
) and Var[Z.
] = x2 d(.
, .
Similarly, we can prove that E.
OeY .
AZ t ) = exp Oe.
Oe.
Oe .
, .
) .
Z t E[Y .
] = Z t .
Oe .
, .
Var[Y .
] = .
Oe .
2 d(.
, .
Note that in general the process Y .
has different distribution from Z.
when (N .
) is a non-homogeneous Poisson process.
Integrated Renewal Process
INTEGRATED RENEWAL PROCESS
In this section we will consider the marginal distributions of the processes (Y .
) and (Z.
) defined in .
for the case that (N .
) is a renewal process.
We will assume that the inter-arrival times Xn of the renewal process (N .
) are strictly positive.
First we consider the process (Z.
Obviously we can express Z.
as N .
= [N .
1 Oe .
Xi .
We will use point processes to derive the marginal distribution of Z.
Let (E.
P) be the probability space on which the iid sequence (Xn ) is defined and also an iid sequence (Vn , n Ou .
of exponentially distributed random variables with parameter 1 such that the sequences (Xn ) and (Vn ) are independent.
Let (Tn , n Ou .
be the sequence of partial sums of the variables Vn .
Then the map : O 7Ie n=1 (Tn (O),Xn (O)) , where .
is the Dirac measure in .
, .
, defines a Poisson point process on E = .
O) y .
O) with intensity measure .
= dtdF .
, see Resnick .
Let Mp (E) be the set of all point measures on E.
We will denote the distribution of by P , i.
P = P Oe1 .
Define for t Ou 0 the functional A.
on Mp (E) by A.
(AA) = 1.
xAA.
In the sequel we write A.
AA) = A.
(AA).
Suppose that the point measure AA has O the support supp(AA) = (.
n , xn ))n=1 with t1 < t2 < .
It follows that AA= O .
n ,xn ) and A.
AA) can be expressed as A.
AA) = O 1.
n )xn .
Note that for every t Ou 0.
AA) is almost surely finite.
Define also for t Ou 0 the functional Z.
on Mp (E) by Z Z Z.
(AA) = 1.
Oe A.
AA))AA(.
, .
O))u1.
AA.
AA.
The next lemma motivates the definition of Z.
Suyono and van der Weide Lemma 4.
With probability 1.
= Z.
().
Proof.
Let O OO E.
Then Z.
((O)) O
,Xn (O)) .
Oe A(Tn (O), (O))) O (O)([Ti (O).
Tn (O)) y .
O))Xi (O)1.
,Tn (O)) (Ti (O)) (O)([Ti (O).
TN .
,O) 1 (O)) y .
O))Xi (O)1.
,TN .
,O) 1 (O)) (Ti (O)) N .
,O) [N .
O) 1 Oe .
Xi (O).
Theorem 4.
Let (Xn , n Ou .
be an iid sequence of strictly positive random variables with common distribution function F .
Let (Sn , n Ou .
be the sequence of partial sums of the variables Xn and (N .
, t Ou .
be the corresponding renewal process: N .
= sup.
Ou 0 : Sn O .
Let N .
= [N .
1 Oe .
Xi .
Then for , > 0
Z O
O Y
OeZ.
)eOet dt = .
Oe F O ()] F O (.
1 Oe .
) n=0 i=1 .
ith the usual convention that the empty product equals .
, where F O denotes the Laplace-Stieltjes transforms of F .
Proof.
By Lemma 4.
OeZ.
) eOeZ.
(AA) P .
AA) Mp (E) Mp (E) Z Z Oe 1.
Oe A.
AA)) AA(.
, .
O))u1.
AA.
AA.
P .
AA) Integrated Renewal Process Mp (E) 1.
Oe A.
AA)) AA(.
, .
O))u1.
AA.
AA.
P .
AA) exp Oe Applying the Palm formula for Poisson point processes, see Grandell .
, we obtain E.
OeZ.
) Z OZ OZ Mp (E) Oe 1.
Oe A.
AA .
)) (AA .
)(.
, .
O))u1.
(AA .
P .
AA)dF .
ds Z OZ OZ Mp (E) Oe 1.
Oe A.
AA)) AA(.
, .
O))u1.
AA.
P .
AA)dF .
Using FubiniAos theorem and a substitution we obtain Z O OeZ.
)eOet dt
Z OZ OZ
Z O
Oe A.
AA)) Mp (E) AA(.
, .
O))u1.
AA.
eOet dtP .
AA)dF .
ds Z OZ Oe F ()] Mp (E) A Z h exp Oe AA(.
, .
O)) u1.
AA.
P .
AA)ds.
Oe The integral with respect to P can be written as a sum of integrals over the sets Bn := {AA OO Mp (E) : AA(.
, .
O)) = .
, n = 0, 1, 2, .
Fix a value of n and let AA OO Mp (E) be such that AA(.
, .
O)) = n and supp(AA) = (.
i , xi ))O i=1 .
tn < s O tn 1 .
For such a measure AA the integrand with respect to P can be written as Z h AA(.
, .
O)) u1.
AA.
O h AA(.
i , .
O)) xi 1.
i ) (.
1 Oe .
)xi .
Suyono and van der Weide Now the measure P is the image measure of P under the map , see .
Expressing the integral with respect to P over Bn as an integral with respect to P over the subset An := {O OO E : Tn (O) < s O Tn 1 (O)} of E, and using independence of (Tn ) and (Xn ), we obtain R A eOe E AA(.
,O)) u1.
AA.
P .
AA) Oe = E exp 1 Oe .
)Xi (O) P.
O) Oe 1 Oe .
)Xi P(An ) AA n s Oes E exp Oe (.
1 Oe .
)Xi F O (.
1 Oe .
) sn Oes Hence eOe E [AA(.
,O)) ]u1.
AA.
P .
AA) Mp (E) O Y F O (.
1 Oe .
) n=0 i=1 sn Oes RO n Since for each n, 0 sn! eOes ds = 1, the theorem follows.
We can take derivatives with respect to in .
to find Laplace transforms of the moments of Z.
For example the Laplace transforms of the first and second moments of Z.
are given in the following proposition.
Proposition 4.
Under the same assumptions as in Theorem 4.
If E X1 eOeX1 < O for some > 0, then Z O E X1 eOeX1 E[Z.
]eOet dt = .
Oe F O ()]2 .
If E X12 eOeX1 < O for some > 0, then Z O E[Z.
2 ]eOet dt
A A
AA2
F O ()]E X12 eOeX1 2.
F O ()] E X1 eOeX1 .
Oe F O ()]3 .
Oe F O ()]4 Integrated Renewal Process Now we will consider the distribution of Y .
when (N .
) is a renewal process.
It is easy to see that N .
Y .
= .
Oe .
Xi N .
Oe SN .
Define for t Ou 0 the functional Y.
on Mp (E) by Z Z Y.
(AA) = 1.
Oe A.
AA)) AA(.
, .
O))u1.
AA(.
, .
O)).
Oe A.
AA))} AA.
AA.
, where A.
AA) is defined as in .
Then as in Lemma 4.
, with probability 1.
Y .
= Y.
().
The following theorem can be proved using arguments as for Z.
, and therefore we omit the proof.
Theorem 4.
Let (Xn , n Ou .
be an iid sequence of strictly positive random variables with common distribution function F .
Let (Sn , n Ou .
be the sequence of partial sums of the variables Xn and (N .
, t Ou .
be the corresponding renewal process: N .
= sup.
Ou 0 : Sn O .
Let N .
Y .
= .
Oe .
Xi N .
Oe SN .
Then .
OeY .
)eOet dt = PO 1OeF O .
) Qn i=1 F (.
Oe .
) n O
F ()
E[Y .
]eOet dt = 2 .
OeF O ()] .
If E X1 eOeX1 < O for some > 0, then Z O E[Y .
]e Oet 2F O () 1 Oe F O ()2 E X1 eOeX1 3 .
Oe F O ()]3 AN EXAMPLE Suppose that the inter-arrival times Xn of the renewal process have a common Gamma.
distribution having the probability density function f .
m, .
= m2 xeOemx , m > 0, x Ou 0.
Suyono and van der Weide Note that if m = 2 then X1 has the same mean as the exponential random variable with parameter .
xp()).
For m = 1, using Theorem 4.
we obtain Z O E[Y .
]eOet dt = 3
Z O
E[Y .
2 ]eOet dt = 2( 3 4 2 8 .
5 ( .
3 Inverting these transforms we obtain E[Y .
] = 1 2 1 t Oe t Oe eOe2t E[Y .
2 ] = t Oe t3 t2 Oe t ( t2 Oe t Oe )eOe2t .
Hence the variance of Y .
is given by Var[Y .
] = 1 3 1 t Oe tOe teOe2t Oe eOe4t .
The double Laplace transform of Y .
is given by Z O 2 Oe m2 Y E.
OeY .
)eOet dt = m2 2 .
) .
Oe .
2 The pdf of Y .
can be approximated by first truncating the infinite sum in this transform and then by inverting the truncated transform.
The graph of the pdf of Y .
for m = 1 can be seen in Figure 1 .
ashed lin.
Gamma.
Figure 1: Graphs of the pdf of Y .
when the (Xn ) are iid exp.
and Gamma.
In this Figure we also display the graph for the pdf of Y .
when (Xn ) are iid exponential random variables with parameter 0.
olid lin.
Both Gamma.
and exp.
distributions have the same mean equal to 2.
Integrated Renewal Process
REFERENCES