Abstract
We consider a single-stage hybrid manufacturing system where jobs arrive according to a Poisson process. These jobs undergo a deterministic process which is controllable. We define a stochastic hybrid optimal control problem and decompose it hierarchically to a lower-level and a higher-level problem. The lower-level problem is a deterministic optimal control problem solved by means of calculus of variations. We concentrate on the stochastic discrete-event control problem at the higher level, where the objective is to determine the service times of jobs. Employing a cost structure composed of process costs that are decreasing and strictly convex in service times, and system-time costs that are linear in system times, we show that receding horizon controllers are state-dependent controllers, where state is defined as the system size. In order to improve upon receding horizon controllers, we search for better state-dependent control policies and present two methods to obtain them. These stochastic-approximation-type methods utilize gradient estimators based on Infinitesimal Perturbation Analysis or Imbedded Markov Chain techniques. A numerical example demonstrates the performance improvements due to the proposed methods.
Similar content being viewed by others
References
Cassandras CG, Lafortune S (2007) Introduction to discrete event systems. Springer
Cassandras CG, Lygeros J (2006) Stochastic hybrid systems (automation and control engineering). CRC Press
Gokbayrak K, Cassandras CG (2000a) A hierarchical decomposition method for optimal control of hybrid systems. In: Proceedings of 39th IEEE conference on decision and control, pp 1816–1821
Gokbayrak K, Cassandras CG (2000b) Hybrid controllers for hierarchically decomposed systems. In: Proc. of 2000 hybrid system control conference, pp 117–129
Bryson AE, Ho YC (1975) Applied optimal control. Hemisphere Publishing Co
Cassandras CG, Mookherjee R (2003a) Receding horizon control for a class of hybrid systems with event uncertainties. In: Proc. of 2003 American control conf, pp 5197–5202
Cassandras CG, Mookherjee R (2003b) Properties of receding horizon controllers for some hybrid systems with event uncertainties. In: Proc. 2003 IFAC conference on analysis and design of hybrid systems, pp 413–418
Cassandras CG, Mookherjee R (2003c) Receding horizon optimal control for some stochastic hybrid systems. In: Proc. of 42nd IEEE conference decision and control, pp 2162–2167
Kushner HJ, Yin GG (2003) Stochastic approximation and recursive algorithms and applications. Springer-Verlag, New York
Glasserman P (1991) Gradient estimation via perturbation analysis. Kluwer Academic Publishers
Ho Y, Cao X (1991) Perturbation analysis of discrete event dynamic systems. Kluwer Academic Publishers
Suri R, Zazanis MA (1988) Perturbation analysis gives strongly consistent sensitivity estimates for the M/G/1 queue. Manag Sci 34(1):39–64
L’Ecuyer P, Glynn PW (1994) Stochastic optimization by simulation: Convergence proofs for the GI/G/1 queue in steady-state. Manag Sci 40(11):1562–1578
Chong EKP, Ramadge PJ (1992) Convergence of recursive optimization algorithms using ipa derivative estimates. Discrete Event Dyn Syst, Theory and Applications 1:339–372
Fu MC (1990) Convergence of the stochastic approximation algorithm for the gi/g/1 queue using infinitesimal perturbation analysis. J Optim Theory Appl 65:149–160
Zazanis MA, Suri R (1994) Perturbation analysis of the GI/GI/1 queue. Queueing Syst 18(3):199–248
Kendall DG (1951) Some problems in the theory of queues. J R Stat Soc B (Methodological) 13(2):151–185
Wolff RW (1982) Poisson arrivals see time averages. Oper Res 30(2):223–231
Foster FG (1953) On the stochastic matrices associated with certain queuing processes. Ann Math Stat 24(3):355–360
Harris CM (1967) Queues with state-dependent stochastic service rates. Oper Res 15(1):117–130
Heyman DP, Sobel MJ (2003) Stochastic models in operations research, vol 1. Dover Publications
Pepyne DL, Cassandras CG (1998) Modeling, analysis, and optimal control of a class of hybrid systems. Discrete Event Dyn Syst, Theory and Applications 8(2):175–201
Pepyne DL, Cassandras CG (2000) Optimal control of hybrid systems in manufacturing. Proc. IEEE 88(7):1108–1123
Cassandras CG, Pepyne DL, Wardi Y (2001) Optimal control of a class of hybrid systems. IEEE Trans Automat Contr 46(3):398–415
Wardi Y, Cassandras CG, Pepyne DL (2001) A backward algorithm for computing optimal controls for single-stage hybrid manufacturing systems. Int J Prod Res 39(2):369–393
Cho YC, Cassandras CG, Pepyne DL (2001) Forward decomposition algorithms for optimal control of a class of hybrid systems. Int J Robust Nonlinear Control 11:497–513
Zhang P, Cassandras CG (2002) An improved forward algorithm for optimal control of a class of hybrid systems. IEEE Trans Automat Contr 47(10):1735–1739
Robbins H, Monro S (1951) A stochastic approximation method. Ann. Math. Stat 22:400–407
Gross D, Shortle JF, Thompson JM, Harris CM (2008) Fundamentals of queueing theory, 4th edn. Wiley
Little JDC (1961) A proof for the queueing formula l=λw. Oper Res 9(3):383–387
Trigg DW, Leach AG (1967) Exponential smoothing with an adaptive response rate. Oper Res Q 18(1):53–59
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Gokbayrak, K. State-dependent Control of a Single Stage Hybrid System with Poisson Arrivals. Discrete Event Dyn Syst 21, 577–592 (2011). https://doi.org/10.1007/s10626-011-0104-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10626-011-0104-0