Artigo Revisado por pares

Optimal Continuous-Parameter Stochastic Control

1969; Society for Industrial and Applied Mathematics; Volume: 11; Issue: 4 Linguagem: Inglês

10.1137/1011086

ISSN

1095-7200

Autores

Wendell H. Fleming,

Tópico(s)

Target Tracking and Data Fusion in Sensor Networks

Resumo

Previous article Next article Optimal Continuous-Parameter Stochastic ControlWendell H. FlemingWendell H. Fleminghttps://doi.org/10.1137/1011086PDFBibTexSections ToolsAdd to favoritesExport CitationTrack CitationsEmail SectionsAbout[1] Masanao Aoki, Optimization of stochastic systems. Topics in discrete-time systems, Mathematics in Science and Engineering, Vol. 32, Academic Press, New York, 1967xy+354 MR0234749 0168.15802 Google Scholar[2] N. I. Andreyev, Correlation theory of statistically optimal systems, Translated from the Russian by Scripta Technica, Inc. Edited by Wendell H. Fleming, W. B. Saunders Co., Philadelphia, Pa., 1969x+370 MR0243886 0194.46102 Google Scholar[3] A. A. Fel'dbaum, Optimal control systems, Translated from the Russian by A. Kraiman. Mathematics in Science and E ngineering, Vol. 22, Academic Press, New York, 1965x+452 MR0191673 0138.33901 Google Scholar[4] Ronald A. Howard, Dynamic programming and Markov processes, The Technology Press of M.I.T., Cambridge, Mass., 1960viii+136 MR0118514 0091.16001 Google Scholar[5] Herman F. Karreman, Stochastic optimization and control, Proceedings of an Advanced Seminar conducted by the Mathematics Research Center and the United States Army at the University of Wisconsin, Madison, Wis., October 2-4, Vol. 1967, John Wiley & Sons Inc., New York, 1968xii+217 MR0231645 0238.00024 Google Scholar[6] Harold J. Kushner, Stochastic stability and control, Mathematics in Science and Engineering, Vol. 33, Academic Press, New York, 1967xiv+161 MR0216894 0244.93065 Google Scholar[7] J. Halcombe Laning, Jr. and , Richard H. Battin, Random processes in automatic control, McGraw-Hill Book Company, Inc., New York-Toronto-London, 1956ix+434 MR0079362 Google Scholar[8] V. S. Pugachev, Theory of random functions and its application to control problems, Revised translation by O. M. Blunn. Translation edited by N. L. Johnson. International Series of Monographs on Automation and Automatic Control. Vol. 5, Pergamon Press, Oxford, 1965xvii+833 MR0177829 Google Scholar[9] Y. Sawaragi, , Y. Sunahara and , T. Nakamizo, Statistical Decision Theory in Adaptive Control Systems, Academic Press, New York, 1967 0189.47003 Google Scholar[10] R. L. Stratonovich, Conditional Markov processes and their application to the theory of optimal control, Translated from the Russian by R. N. and N. B. McDonough for Scripta Technica, Inc. Modern Analytic and Computational Methods in Science and Mathematics, No. 7, American Elsevier Publishing Co., Inc., New York, 1968xvii+350 MR0221860 Google Scholar[11] R. L. Stratonovich, Topics in the theory of random noise. Vol. I: General theory of random processes. Nonlinear transformations of signals and noise, Revised English edition. Translated from the Russian by Richard A. Silverman, Gordon and Breach Science Publishers, New York, 1963xiii+292, vol. 2 MR0158437 Google Scholar[12] L. A. Wainstein and , V. D. Zubakov, Extraction of signals from noise, Translated from the Russian by Richard A. Silverman. International Seri es in Applied Mathematics, Prentice-Hall Inc., Englewood Cliffs, N.J., 1962xii+382 MR0142420 Google Scholar[13] N. Wiener, Extrapolation Interpolation, and Smoothing of Stationary Time Series, John Wiley, New York, 1949 0036.09705 Google Scholar[14] W. M. Wonham, A. T. Bharucha-Reid, Random differential equations in control theoryProbabilistic Methods in Applied Mathematics, Vol. 2, Academic Press, New York, 1970, 131–212 MR0261732 0235.93025 Google Scholar[15] A. V. Balakrishnan and , Lucien W. Neustadt, Mathematical theory of control, Proceedings of a Conference held at the University of Southern California, Los Angeles, January 30-February 1, Vol. 1967, Academic Press, New York, 1967xv+459 MR0252054 0209.16001 Google Scholar[16] Richard Bellman, Dynamic programming, Princeton Univeristy Press, Princeton, N. J., 1957xxv+342 MR0090477 Google Scholar[17] Richard E. Bellman and , R. E. Kalaba, Quasilinearization and nonlinear boundary-value problems, Modern Analytic and Computional Methods in Science and Mathematics, Vol. 3, American Elsevier Publishing Co., Inc., New York, 1965ix+206 MR0178571 0139.10702 Google Scholar[18] Austin Blaquière, Nonlinear system analysis, Academic Press, New York, 1966x+392 MR0356911 Google Scholar[19] J. L. Lions, Contrôle optimal de systèmes gouvernés par des équations aux dérivées partielles, Avant propos de P. Lelong, Dunod, Paris, 1968xiii+426 MR0244606 0179.41801 Google Scholar[20] L. S. Pontryagin, , V. G. Boltyanskii, , R. V. Gamkrelidze and , E. F. Mishchenko, The mathematical theory of optimal processes, Translated from the Russian by K. N. Trirogoff; edited by L. W. Neustadt, Interscience Publishers John Wiley & Sons, Inc. New York-London, 1962viii+360 MR0166037 0102.32001 Google Scholar[21] Avner Friedman, Partial differential equations of parabolic type, Prentice-Hall Inc., Englewood Cliffs, N.J., 1964xiv+347 MR0181836 0144.34903 Google Scholar[22] Olga A. Ladyzhenskaya and , Nina N. Ural'tseva, Linear and quasilinear elliptic equations, Translated from the Russian by Scripta Technica, Inc. Translation editor: Leon Ehrenpreis, Academic Press, New York, 1968xviii+495 MR0244627 0164.13002 Google Scholar[23] O. A. Ladyženskaja, , V. A. Solonnikov and , N. N. Ural'ceva, Linear and quasilinear equations of parabolic type, Translated from the Russian by S. Smith. Translations of Mathematical Monographs, Vol. 23, American Mathematical Society, Providence, R.I., 1967xi+648, (In Russian.) MR0241822 Google Scholar[24] R. M. Blumenthal and , R. K. Getoor, Markov processes and potential theory, Pure and Applied Mathematics, Vol. 29, Academic Press, New York, 1968x+313 MR0264757 0169.49204 Google Scholar[25] J. L. Doob, Stochastic processes, John Wiley & Sons Inc., New York, 1953viii+654 MR0058896 0053.26802 Google Scholar[26] E. B. Dynkin, Markov Processes, Springer-Verlag, Berlin, 1965 0132.37901 CrossrefGoogle Scholar[27] I. I. Gikhman and , A. V. Skorokhod, Introduction to the Theory of Random Processes, Nauka, Moscow, 1965, (In Russian.) Google Scholar[28] A. V. Skorokhod, Studies in the theory of random processes, Translated from the Russian by Scripta Technica, Inc, Addison-Wesley Publishing Co., Inc., Reading, Mass., 1965viii+199 MR0185620 0146.37701 Google Scholar[29] A. V. Balakrishnan, A general theory of nonlinear estimation problems in control systems, J. Math. Anal. Appl., 8 (1964), 4–30 10.1016/0022-247X(64)90079-4 MR0166013 0124.33904 CrossrefGoogle Scholar[30] A. V. Balakrishnan, Stochastic system identification techniques, Stochastic optimization and control (Proc. Advanced Sem., Madison, Wis., 1967), John Wiley, New York, 1968, 65–89 MR0307775 0251.93030 Google Scholar[31] A. V. Balakrishnan, A new computing technique in optimal control, SIAM J. Control, 6 (1968), 149–173 10.1137/0306012 0174.40803 LinkISIGoogle Scholar[32] A. V. Balakrishnan, A new computing technique in system identification, J. Comput. System Sci., 2 (1968), 102–116 MR0258487 0186.22401 CrossrefGoogle Scholar[33] J. F. Barrett, Application of Kolmogorov's equations to randomly disturbed automatic control systems, Automatic and Remote Control (Proc. First Internat. Congr. Internat. Fed. Automat. Control, Moscow, 1960), Vol. II, Butterworths, London, 1961, 724–730 MR0194244 Google Scholar[34] Leonard D. Berkovitz and , Harry Pollard, A non-classical variational problem arising from an optimal filter problem, Arch. Rational Mech. Anal., 26 (1967), 281–304 MR0215151 0149.32804 CrossrefISIGoogle Scholar[35] M. N. Blachman, On the effect of noise on non-linear control system, Proc. First Intern. Congr. Intern. Federation Autom. Control, Moscow, 1960, Vol. 2, Butterworth, London, 1961, 770–773 Google Scholar[36] David Blackwell, Discrete dynamic programming, Ann. Math. Statist., 33 (1962), 719–726 MR0149965 0133.12906 CrossrefISIGoogle Scholar[37] John V. Breakwell, Stochastic optimization problems in space guidance, in [5], pp. 91–100 Google Scholar[38] J. V. Breakwell, , J. L. Speyer and , A. E. Bryson, Optimization and control of nonlinear systems using the second variation, SIAM J.Control, 1 (1963), 193–223 10.1137/0301011 0135.32901 LinkGoogle Scholar[39] J. V. Breakwell and , F. Tung, Minimum effort control of several terminal components, J. Soc. Indust. Appl. Math. Ser. A Control, 2 (1964), 295–316 (1965) MR0181517 Google Scholar[40] Haïm R. Brezis and , Guido Stampacchia, Sur la régularité de la solution d'inéquations elliptiques, Bull. Soc. Math. France, 96 (1968), 153–180 MR0239302 0165.45601 CrossrefGoogle Scholar[41] R. E. Kalman and , R. S. Bucy, New results in linear filtering and prediction theory, Trans. ASME Ser. D. J. Basic Engrg., 83 (1961), 95–108 MR0234760 CrossrefGoogle Scholar[42] W. M. Wonham and , W. F. Cashman, A computational approach to optimal control of stochastic saturating systems, Internat. J. Control (1), 10 (1969), 77–98 MR0246685 0174.14203 CrossrefISIGoogle Scholar[43] Herman Chernoff, Optimal stochastic control, Sankhyā Ser. A, 30 (1968), 221–252 MR0241149 0206.15901 Google Scholar[44] Cyrus Derman, Markovian sequential control processes—denumerable state space, J. Math. Anal. Appl., 10 (1965), 295–302 10.1016/0022-247X(65)90124-1 MR0173588 0132.12706 CrossrefISIGoogle Scholar[45] peter Dorato, , Chang-Ming Hsieh and , Prentiss N. Robinson, Optimal bang-bang control of linear stochastic systems with a small noise parameter, IEEE Trans. Automatic Control, AC-12 (1967), 682–689 10.1109/TAC.1967.1098731 CrossrefISIGoogle Scholar[46] Stuart E. Dreyfus, Introduction to stochastic optimization and controlStochastic Optimization and Control (Proc. Advanced Seminar, Madison, Wis., 1967), Wiley, New York, 1968, 3–23 MR0232621 0243.93031 Google Scholar[47] T. E. Duncan, Probability densities for diffusion processes with applications to nonlinear filtering theory and detection theory, Tech. Rep., TR 7001-4, stanford univ. system laboratory lab., stanford, california, 1967 Google Scholar[48] E. A. Dynkin, Controlled random sequences, Theor. Probability Appl., 10 (1965), 1–14 LinkISIGoogle Scholar[49] E. A. Dynkin, Sufficient statistics for me optimal stopping problem, Teor. verojatnos i Primenen, 13 (1968), 150–152 0197.15801 Google Scholar[50] J. R. Fisher, Optimal nonlinear filteringAdvances in Control Systems, Vol. 5, Academic Press, New York, 1967, 197–300 MR0224385 0157.26006 CrossrefGoogle Scholar[51] W. H. Fleming, Some Markovian optimization problems, J. Math. Mech., 12 (1963), 131–140 MR0144088 0128.37902 ISIGoogle Scholar[52] Wendell H. Fleming, The Cauchy problem for degenerate parabolic equations, J. Math. Mech., 13 (1964), 987–1008 MR0179473 0192.19602 ISIGoogle Scholar[53] Wendell H. Fleming, Duality and a priori estimates in Markovian optimization problems, J. Math. Anal. Appl., 16 (1966), 254–279, Erratum, ibid., 19(1966), p. 204 10.1016/0022-247X(66)90170-3 MR0200082 0203.22101 CrossrefISIGoogle Scholar[54] Wendell H. Fleming, Optimal control of partially observable diffusions, SIAM J. Control, 6 (1968), 194–214 10.1137/0306015 MR0242545 0167.09104 LinkISIGoogle Scholar[55] Wendell H. Fleming, Stochastic Lagrange multipliersMathematical Theory of Control (Proc. Conf., Los Angeles, Calif., 1967), Academic Press, New York, 1967, 433–440 MR0255279 0224.93054 Google Scholar[56] W. H. Fleming, Some problems of optimal stochastic control, in [5], pp. 59–64 Google Scholar[57] Wendell H. Fleming, The Cauchy problem for a nonlinear first order partial differential equation, J. Differential Equations, 5 (1969), 515–530 10.1016/0022-0396(69)90091-6 MR0235269 0172.13901 CrossrefISIGoogle Scholar[58] W. H. Fleming, Controlled diffusions under polynomial growth conditions, in [127] Google Scholar[59] Wendell H. Fleming, Stochastic control for small noise intensities, SIAM J. Control, 9 (1971), 473–517 10.1137/0309035 MR0304045 0218.93024 LinkISIGoogle Scholar[60] Wendell H. Fleming and , Makiko Nisio, On the existence of optimal stochastic controls, J. Math. Mech., 15 (1966), 777–794 MR0199020 ISIGoogle Scholar[61] J. J. Florentin, Optimal control of continuous time, Markov, stochastic systems, J. Electronics Control (1), 10 (1961), 473–488 MR0152392 CrossrefGoogle Scholar[62] J. J. Florentin, Partial observability and optimal control, J. Electronics Control (1), 13 (1962), 263–279 CrossrefGoogle Scholar[63] A. Friedman, Optimal control for parabolic equations, J. Math. Anal. Appl., 18 (1967), 479–491 10.1016/0022-247X(67)90040-6 0156.31806 CrossrefISIGoogle Scholar[64] P. A. Frost, Nonlinear estimation in continuous time systems, Tech. Rep., TR 6304-4, Stanford Univ. Systems Theory Lab., Stanford, California, 1968 Google Scholar[65] I. V. Girsanov, On transforming a class of stochastic processes by absolutely continuous substitution of measures, Theor. Probability Appl., 5 (1960), 285–301 0100.34004 LinkGoogle Scholar[66] I. V. Girsanov, Some minimax problems in the theory of controlled Markov processes, Theor. Probability Appl., 7 (1962), 223– LinkGoogle Scholar[67] B. I. Grigelionis and , A. N. Shirjaev, On Stefan's problem and optimal stopping rules for Markov processes, Theor. Probability Appl., 11 (1966), 541–558 0178.53303 LinkISIGoogle Scholar[68] B. I. Grigelionis and , A. N. Shiryaev, On controlled Markov processes and the Stefan problem, Problemy Peredachi Informacii, 4 (1968), 60–72 Google Scholar[69] Hubert Halkin, Nonlinear nonconvex programming in an infinite dimensional spaceMathematical Theory of Control (Proc. Conf., Los Angeles, Calif., 1967), Academic Press, New York, 1967, 10–25 MR0263427 0223.90032 Google Scholar[70] Y. C. Ho and , R. C. K. Lee, A Bayesian approach to problems in stochastic estimation and control, Proc. Joint Autom. Controls Conf., Stanford University, 1964, 382–387 Google Scholar[71] Lars Hörmander, Hypoelliptic second order differential equations, Acta Math., 119 (1967), 147–171 MR0222474 0156.10701 CrossrefISIGoogle Scholar[72] Donald E. Johansen, C. T. Leondes, Optimal control of linear stochastic systems with complexity constraintsAdvances in Control Systems, Vol. 4, Academic Press, New York, 1966, 181–278 MR0210499 0158.16803 Google Scholar[73] Thomas Kailath, A general likelihood-ratio formula for random signals in Gaussian noise, IEEE Trans. Information Theory, IT-15 (1969), 350–361 10.1109/TIT.1969.1054307 MR0253802 0172.42805 CrossrefISIGoogle Scholar[74] R. E. Kalman, A new approach to linear filtering and prediction problems, ASME Transactions, 82 (1960), 35–45, Part D (J. of Basic Engr.) CrossrefGoogle Scholar[75] R. E. Kalman, The theory of optimal control and the calculus of variationsMathematical optimization techniques, Univ. California Press, Berkeley, Calif., 1963, 309–331 MR0162680 0123.08202 Google Scholar[76] Harold J. Kushner and , Allan Jay Kleinman, Numerical methods for the solution of the degenerate nonlinear elliptic equations arising in optimal stochastic control theory, IEEE Trans. Automatic Control, AC-13 (1968), 344–353 10.1109/TAC.1968.1098939 MR0242534 CrossrefISIGoogle Scholar[77] A. N Kolmogorov, Interpolation and extrapolation of stationary random sequences, Bull. Acad. Sci. USSR Math., 5 (1941), 3–14 0024.15901 Google Scholar[78] N. N. Krasovskii, On optimum control with discrete feedback signals, J. Differential Equations, 1 (1965), 1111–1121 Google Scholar[79] N. V. Krylov, On quasidiffusion processes, Theor. Probability Appl., 11 (1966), 373–389 LinkISIGoogle Scholar[80] Harold J. Kushner, Near optimal control in the presence of small stochastic perturbations, ASME Transactions, Part D (J. of Basic Engr.), 87 (1965), 103–108 CrossrefISIGoogle Scholar[81] Harold J. Kushner, On the stochastic maximum principle: Fixed time of control, J. Math. Anal. Appl., 11 (1965), 78–92 10.1016/0022-247X(65)90070-3 MR0186448 0142.06802 CrossrefISIGoogle Scholar[82] Harold J. Kushner, On the existence of optimal stochastic controls, J. Soc. Indust. Appl. Math. Ser. A Control, 3 (1965), 463–474 MR0192946 0147.16103 LinkGoogle Scholar[83] Harold J. Kushner, Optimal discounted stochastic control for diffusion processes, SIAM J. Control, 5 (1967), 520–531 10.1137/0305032 MR0224388 0178.20003 LinkGoogle Scholar[84] Harold J. Kushner, Dynamical equations for optimal nonlinear filtering, J. Differential Equations, 3 (1967), 179–190 10.1016/0022-0396(67)90023-X MR0213182 0158.16801 CrossrefISIGoogle Scholar[85] Harold J. Kushner, Approximations to optimal nonlinear filters, IEEE Trans. Automatic Control, AC-12 (1967), 546–556 10.1109/TAC.1967.1098671 CrossrefISIGoogle Scholar[86] Harold J. Kushner, The concept of invariant set for stochastic dynamical systems and applications to stochastic stability, Stochastic Optimization and Control (Proc. Advanced Seminar, Madison, Wis., 1967), John Wiley, New York, 1968, 47–57 MR0274157 0251.93034 Google Scholar[87] Harold J. Kushner, The Cauchy problem for a class of degenerate parabolic equations and asymptotic properties of the related diffusion processes, J. Differential Equations, 6 (1969), 209–231 10.1016/0022-0396(69)90013-8 MR0240883 0181.44305 CrossrefISIGoogle Scholar[88] Harold J. Kushner, On the optimal control of linear distributed parameter systems with white noise input, SIAM J. Control, 6 (1968), 596–614 10.1137/0306038 0186.23404 LinkISIGoogle Scholar[89] J. P. La Salle, The time optimal control problemContributions to the theory of nonlinear oscillations, Vol. V, Princeton Univ. Press, Princeton, N.J., 1960, 1–24 MR0145169 CrossrefGoogle Scholar[90] Hans Lewy and , Guido Stampacchia, On the regularity of the solution of a variational inequality, Comm. Pure Appl. Math., 22 (1969), 153–188 MR0247551 0167.11501 CrossrefISIGoogle Scholar[91] Wm. C. Lindsey and , Chas. L. Weber, On the theory of automatic phase controlStochastic optimization and control, Proc. of Adv. Seminar, University of Wisconsin, 1967, John Wiley, New York, 1968, 101–132 0246.93044 Google Scholar[92] R. Sh. Liptser, A comparison of linear and nonlinear filtration of some Markov processes, Theor. Probability Appl., 11 (1966), 467–472 LinkISIGoogle Scholar[93] R. Š. Lipcer and , A. N. Širjaev, Extrapolation of multi-dimensional Markov processes from incomplete data, Teor. Verojatnost. i Primenen, 13 (1968), 17–38 MR0235614 0245.60038 Google Scholar[94] E. J. McShane, Integrals devised for special purposes, Bull. Amer. Math. Soc., 69 (1963), 597–627 MR0162905 0116.04202 CrossrefISIGoogle Scholar[95] E. J. McShane, Stochastic functional equations: continuity properties and relation to ordinary equations, in [127] Google Scholar[96] P. Mandl, On the control of non-terminating diffusion processes, Theor. Probability Appl., 9 (1964), 591–603 0134.34403 LinkGoogle Scholar[97] Petr Mandl, Analytical methods in the theory of controlled Markov processesTrans. Fourth Prague Conf. on Information Theory, Statistical Decision Functions, Random Processes (Prague, 1965), Academia, Prague, 1967, 45–53 MR0225591 Google Scholar[98] P. Mandl, On the control of the Wiener process with restricted number of switchings, Theor. Probability Appl., 12 (1967), 68–76 0178.19401 LinkISIGoogle Scholar[99] A. Z. Mieri, Masters Thesis, A new approach to the general problem of optimal, filtering and control of stochastic systems, Doctoral thesis, University of California, Berkeley, California, 1967 Google Scholar[100] R. E. Mortensen, Stochastic optimal control with noisy observations, Internat. J. Control (1), 4 (1966), 455–464 MR0213184 0201.48305 CrossrefISIGoogle Scholar[101] R. E. Mortensen, Optimal control of continuous-time stochastic systems, Rep., ERL66-1, Electronic Research Laboratory, Berkeley, California, 1966 Google Scholar[102] Lucien W. Neustadt, An abstract variational theory with applications to a broad class of optimization problems. I. General theory, SIAM J. Control, 4 (1966), 505–527 10.1137/0304040 MR0216349 0166.09401 LinkGoogle Scholar[103] L. S. Ornstein and , G. E. Uhlenbeck, On the theory of Brownian motion, Phys. Rev., 36 (1930), 823–841, reprinted in: Selected Papers on Noise and Stochastic Processes, N. Wax, ed., Dover, New York, 1954 CrossrefGoogle Scholar[104] A. A. Samarskii, On an economical method for the solution of a multidimensional parabolic equation in an arbitrary region, USSR Comput. Math. and Math. Anal., 2 (1963), 894–926 10.1016/0041-5553(63)90504-4 0273.65078 CrossrefGoogle Scholar[105] A. N. Shiryaev, Stochastic equations for nonlinear filtering of Markov step processes, Problemy Peredachi Informatsii, 2 (1966), 3–22 0688.00011 Google Scholar[106] A. N. Širjaev, Some new results in the theory of controlled random processesTrans. Fourth Prague Conf. on Information Theory, Statistical Decision Functions, Random Processes (Prague, 1965), Academia, Prague, 1967, 131–203, (In Russian.) MR0225593 Google Scholar[107] A. N. Shiryaev, On two problems of sequential analysis, Kibernetika, (1967), 79–86 1067.62084 Google Scholar[108] R. L. Stratonovich, On the theory of optimal control. An asymptotic method for solving the diffusive alternative equation, Automat. Remote Control, 23 (1963), 1352–1360 MR0157823 0133.11201 Google Scholar[109] R. L. Stratonovich, A new representation for stochastic integrals and equations, SIAM J. Control, 4 (1966), 362–371 10.1137/0304028 MR0196814 LinkGoogle Scholar[110] Charlotte Striebel, Sufficient statistics in the optimum control of stochastic systems, J. Math. Anal. Appl., 12 (1965), 576–592 10.1016/0022-247X(65)90027-2 MR0199022 0137.35802 CrossrefISIGoogle Scholar[111] D. W. Stroock and , S. R. S. Varadhan, Diffusion processes with continuous coeffcients, Comm. Pure Appl. Math., to appear Google Scholar[112] D. D. Sworder, On the control of stochastic systems. I, II, Internat. J. Control (1) 6 (1967), 179–188; ibid., 10 (1967), 271–277 MR0261996 0176.39503 CrossrefISIGoogle Scholar[113] Neil S. Trudinger, On the Dirichlet problem for quasilinear uniformly elliptic equations in n variables, Arch. Rational Mech. Anal., 27 (1967), 108–119 10.1007/BF00281337 MR0219891 0165.12502 CrossrefISIGoogle Scholar[114] Neil S. Trudinger, Pointwise estimates and quasilinear parabolic equations, Comm. Pure Appl. Math., 21 (1968), 205–226 MR0226168 0159.39303 CrossrefISIGoogle Scholar[115] L. Van Mellaert, Inclusion Probability Optimal Control, Res. Rep., PIBMRI 1364-67, Poly-technic Institute of Brooklyn, New York, 1967 Google Scholar[116] Richard van Slyke and , Roger Wets, Programming under uncertainty and stochastic optimal control, SIAM J. Control, 4 (1966), 179–193 10.1137/0304018 MR0194246 0143.21302 LinkGoogle Scholar[117] H. S. Witsenhausen, A counterexample in stochastic optimum control, SIAM J. Control, 6 (1968), 131–147 10.1137/0306011 MR0231649 0159.13404 LinkISIGoogle Scholar[118] Eugene Wong and , Moshe Zakai, On the convergence of ordinary integrals to stochastic integrals, Ann. Math. Statist., 36 (1965), 1560–1564 MR0195142 0138.11201 CrossrefISIGoogle Scholar[119] Eugene Wong and , Moshe Zakai, On the relation between ordinary and stochastic differential equations, Internat. J. Engrg. Sci., 3 (1965), 213–229 10.1016/0020-7225(65)90045-5 MR0183023 0131.16401 CrossrefGoogle Scholar[120] W. M. Wonham, Some applications of stochastic differential equations to optimal nonlinear filtering, J. Soc. Indust. Appl. Math. Ser. A Control, 2 (1965), 347–369 (1965) MR0186472 0143.19004 Google Scholar[121] W. M. Wonham, Optimal stationary control of a linear system with state-dependent noise, SIAM J. Control, 5 (1967), 486–500 10.1137/0305028 MR0219338 0218.49003 LinkGoogle Scholar[122] W. M. Wonham, Stochastic control, Lecture notes, Center for Dynamical Systems, Brown University, Providence, Rhode Island, 1967 Google Scholar[123] W. M. Wonham, On the separation theorem of stochastic control, SIAM J. Control, 6 (1968), 312–326 10.1137/0306023 MR0237219 0164.19101 LinkISIGoogle Scholar[124] W. M. Wonham, Optimal stochastic control, Automatica–J. IFAC, 5 (1969), 113–118 MR0245346 0164.40203 CrossrefISIGoogle Scholar[125] W. M. Wonham, Stochastic Problems in Control, Proc. IBM Scr. Comput. Symp. Control Theor. App., Yorktown Heights, New York, 1964 Google Scholar[126] L. C. Young, Stochastic integrals for nigh-martingales, MRC Tech. Summ. Rep., 937, University of Wisconsin, Madison, 1968 Google Scholar[127] A. V. Balakrishnan, Control theory and the calculus of variations, Academic Press, New York, 1969xiii+422 MR0394357 0203.46901 Google Scholar[128] A. Bensoussan, Sur l'identification et le filtrage de systémes gouvernés par des équations aux derivees partielles, cahiers de l'iria, 1969, no. 1, [also Paris thesis] 0264.93027 Google Scholar[129] A. Bensoussan, Contrôle optimal stochastique de système gouvernés par des équations aux dérivées partielles de type parabolique, Rend. Mat. (6), 2 (1969), 135–173 MR0260465 0249.93058 Google Scholar[130] H. O. Fattorini, Time-optimal control of solutions of operational differenital equations, J. Soc. Indust. Appl. Math. Ser. A Control, 2 (1964), 54–59 MR0169738 0143.16803 LinkGoogle Scholar[131] J. P. Yvon, Application de la penalisation à la rèsolution d'un problème de contrôle optimal, Cahier de l'IRIA, 1968, [also Paris thesis] 0331.49029 Google Scholar Previous article Next article FiguresRelatedReferencesCited byDetails A Constrained Markovian Diffusion Model for Controlling the Pollution Accumulation22 June 2021 | Mathematics, Vol. 9, No. 13 Cross Ref A global maximum principle for stochastic optimal control problems with delay and applicationsSystems & Control Letters, Vol. 150 Cross Ref Uncertain pursuit-evasion game12 December 2018 | Soft Computing, Vol. 24, No. 4 Cross Ref Linear–Quadratic Uncertain Differential Game With Application to Resource Extraction ProblemIEEE Transactions on Fuzzy Systems, Vol. 24, No. 4 Cross Ref Collaborative Environmental Management24 September 2016 Cross Ref Subgame Consistent Cooperative Solution in NTU Differential Games24 September 2016 Cross Ref Lipschitz Stochastic Differential Equations Cross Ref Optimal Control of Drifts and Jump Rates Cross Ref A partial history of the early development of continuous-time nonlinear stochastic systems theoryAutomatica, Vol. 50, No. 2 Cross Ref Uncertain differential games with application to capitalism23 December 2013 | Journal of Uncertainty Analysis and Applications, Vol. 1, No. 1 Cross Ref Impact of Economic and Technical Uncertainties on Dynamic New Product DevelopmentIEEE Transactions on Engineering Management, Vol. 60, No. 1 Cross Ref Transmission Power Control and Routing Strategy Based on Differential Games in Deep Space Exploration19 October 2011 | Wireless Personal Communications, Vol. 67, No. 4 Cross Ref SUBGAME CONSISTENT SOLUTION FOR COOPERATIVE STOCHASTIC DYNAMIC GAMES WITH RANDOM HORIZON30 December 2012 | International Game Theory Review, Vol. 14, No. 02 Cross Ref Trigger Strategy Equilibriums in Stochastic Differential Games with Information Time Lags: An Analysis of Cooperative Production StrategiesTao Yao, Susan H. Xu, and Bin Jiang24 May 2011 | SIAM Journal on Control and Optimization, Vol. 49, No. 3AbstractPDF (345 KB)References Cross Ref A cooperative stochastic differential game of transboundary industrial pollutionAutomatica, Vol. 44, No. 6 Cross Ref Robust Dynamics and Control of a Partially Observed Markov Chain28 August 2007 | Applied Mathematics and Optimization, Vol. 56, No. 3 Cross Ref Dynamically Consistent Cooperative Solution in a Differential Game of Transboundary Industrial Pollution14 June 2007 | Journal of Optimization Theory and Applications, Vol. 134, No. 1 Cross Ref Subgame-consistent cooperative solutions in randomly furcating stochastic differential gamesMathematical and Computer Modelling, Vol. 45, No. 11-12 Cross Ref Dynamic games in management science with interest rate uncertainty31 January 2007 | Computational Management Science, Vol. 4, No. 2 Cross Ref SOLUTION MECHANISMS FOR COOPERATIVE STOCHASTIC DIFFERENTIAL GAMES20 November 2011 | International Game Theory Review, Vol. 08, No. 02 Cross Ref Subgame Consistent Solutions of a Cooperative Stochastic Differential Game with Nontransferable PayoffsJournal of Optimization Theory and Applications, Vol. 124, No. 3 Cross Ref TECHNICAL NOTE: NONTRANSFERABLE INDIVIDUAL PAYOFFS IN COOPERATIVE STOCHASTIC DIFFERENTIAL GAMES20 November 2011 | International Game Theory Review, Vol. 06, No. 02 Cross Ref Randomly-Furcating Stochastic Differential Games Cross Ref Pricing of Natural Resource under a Randomly Furcating Environment Cross Ref Necessary Conditions for Optimal Control of Stochastic Systems with Random JumpsShanjian Tang and Xunjing Li14 July 2006 | SIAM Journal on Control and Optimization, Vol. 32, No. 5AbstractPDF (2152 KB)On continuous-time discounted stochastic dynamic programmingApplied Mathematics & Optimization, Vol. 23, No. 1 Cross Ref On a Continuously Discounted Vector Valued Markov Decision ProcessJournal of Information and Optimization Sciences, Vol. 11, No. 1 Cross Ref Optimal control for one-phase Stefan problem with random emissionApplied Mathematics & Optimization, Vol. 20, No. 1 Cross Ref Asymptotic Evolution of a Stochastic Control ProblemR. Tarres14 July 2006 | SIAM Journal on Control and Optimization, Vol. 23, No. 4AbstractPDF (1547 KB)Stochastic formulation of Feynman path integrals from the least action point of viewJournal of Mathematical Physics, Vol. 25, No. 3 Cross Ref References Cross Ref References Cross Ref On the optimal control of stochastic systems with an exponential-of-integral performance indexJournal of Mathematical Analysis and Applications, Vol. 80, No. 2 Cross Ref On the saddle-point solution of a class of stochastic differential gamesJournal of Optimization Theory and Applications, Vol. 33, No. 4 Cross Ref Les Aspects Probabilistes Du Controle Stochastique5 October 2006 Cross Ref Computational and approximate methods of optimal controlJournal of Soviet Mathematics, Vol. 12, No. 3 Cross Ref Decomposable jump decision processesStochastic Processes and their Applications, Vol. 9, No. 1 Cross Ref Optimal Control of Stochastic Systems Cross Ref Stability and Control of Stochastic Systems with Wide-band Noise Disturbances. IG. Blankenship and G. C. Papanicolaou12 July 2006 | SIAM Journal on Applied Mathematics, Vol. 34, No. 3AbstractPDF (2926 KB)An Introductory Approach to Duality in Optimal Stochastic ControlJean-Michel Bismut10 July 2006 | SIAM Review, Vol. 20, No. 1AbstractPDF (1413 KB)Stochastic Linear-Quadratic Nonzero-Sum Differential Games with Delayed Information PatternsIFAC Proceedings Volumes, Vol. 11, No. 1 Cross Ref Informationally Nonunique Equilibrium Solutions in Differential GamesTamer Başar1 August 2006 | SIAM Journal on Control and Optimization, Vol. 15, No. 4AbstractPDF (2382 KB)Stochastic pursuit-evasion gamesJournal of Mathematical Analysis and Applications, Vol. 59, No. 2 Cross Ref Optimal control of diffusion processes with reflectionJournal of Optimization Theory and Applications, Vol. 22, No. 1 Cross Ref Computation of optimal controls for a nonlinear stochastic third-order systemJournal of Optimization Theory and Applications, Vol. 21, No. 2 Cross Ref Stochastic control of system with unobserved jump parameter processInformation Sciences, Vol. 13, No. 3 Cross Ref References Cross Ref Decomposition for stochastic dynamic systems27 June 2007 | Mathematische Operationsforschung und Statistik, Vol. 7, No. 6 Cross Ref Russian text ignored6 February 2009 | Mathematische Nachrichten, Vol. 74, No. 1 Cross Ref A stochastic minimum principle1 January 1976 | Bulletin of the American Mathematical Society, Vol. 82, No. 6 Cross Ref A Semigroup Representation of the Maximum Expected Reward Vector in Continuous Parameter Markov Decision TheoryStanley R. Pliska18 July 2006 | SIAM Journal on Control, Vol. 13, No. 6AbstractPDF (1781 KB)Necessary Conditions for Optimality of Cauchy Problems for Parabolic Partial Differential SystemsN. U. Ahmed and K. L. Teo1 August 2006 | SIAM Journal on Control, Vol. 13, No. 5AbstractPDF (1144 KB)Optimal Control of Stochastic Linear Distributed Parameter SystemsA. Bensoussan and M. Viot18 July 2006 | SIAM Journal on Control, Vol. 13, No. 4AbstractPDF (1503 KB)Remarks on stochastic optimal controlsJapanese journal of mathematics. New series, Vol. 1, No. 1 Cross Ref Stochastic Optimal Control of Linear Dynamic SystemsAIAA Journal, Vol. 12, No. 8 Cross Ref Various Topics in the Theory of Optimal Control of Distributed Systems Cross Ref On the Existence of Optimal Policies in Stochastic ControlM. H. Davis18 July 2006 | SIAM Journal on Control, Vol. 11, No. 4AbstractPDF (633 KB)On the stochastic maximum principle in Banach spaceJournal of Functional Analysis, Vol. 14, No. 2 Cross Ref Time-optimal control in the presence of poisson impulse noiseAutomatica, Vol. 9, No. 4 Cross Ref Necessary and Sufficient Conditions for Optimal Control of Semi-Markov Jump ProcessesLawrence D. Stone18 July 2006 | SIAM Journal on Control, Vol. 11, No. 2AbstractPDF (1135 KB)Dynamic Programming Conditions for Partially Observable Stochastic SystemsM. H. A. Davis and P. Varaiya18 July 2006 | SIAM Journal on Control, Vol. 11, No. 2AbstractPDF (2347 KB)On Feedback Control of Linear Stochastic SystemsAnders Lindquist18 July 2006 | SIAM Journal on Control, Vol. 11, No. 2AbstractPDF (1796 KB)Über die Steuerung von ZüchtungsprozessenBiometrische Zeitschrift, Vol. 15, No. 3 Cross Ref Problemes de temps d’arret optimal et inequations variationnelles paraboliques2 May 2007 | Applicable Analysis, Vol. 3, No. 3 Cross Ref Stochastic control: A brief survey Cross Ref Numerical solution of an optimal control problem with a probability criterionIEEE Transactions on Automatic Control, Vol. 17, No. 4 Cross Ref Stochastic Control: A Function Space ApproachA. V. Balakrishnan18 July 2006 | SIAM Journal on Control, Vol. 10, No. 2AbstractPDF (821 KB)Stochastic differential gamesJournal of Differential Equations, Vol. 11, No. 1 Cross Ref Chapter 7 Itô Random Integral Equations Cross Ref Optimal stochastic control of linear systems with state- and control-dependent disturbancesIEEE Transactions on Automatic Control, Vol. 16, No. 6 Cross Ref Separation of estimation and control for discrete time systemsProceedings of the IEEE, Vol. 59, No. 11 Cross Ref On the Solutions of a Stochastic Control SystemTyrone Duncan and Pravin Varaiya18 July 2006 | SIAM Journal on Control, Vol. 9, No. 3AbstractPDF (1274 KB)Existence of Optimal Stochastic Control LawsV. E. Beneš18 July 2006 | SIAM Journal on Control, Vol. 9, No. 3AbstractPDF (2150 KB)Necessary and Sufficient Dynamic Programming Conditions for Continuous Time Stochastic Optimal ControlRaymond Rishel18 July 2006 | SIAM Journal on Control, Vol. 8, No. 4AbstractPDF (1087 KB)Subgame Consistent Dormant-Firm Cartels Cross Ref Subgame Consistent Solutions for a Class of Cooperative Stochastic Differential Games with Nontransferable Payoffs Cross Ref A class of problems in the optimal control of diffusions with finitely many controls Cross Ref Martingale methods in stochastic control Cross Ref Current results and issues in stochastic control Cross Ref Probabilistic multimodeling in zero-sum differential games Cross Ref Optimal non-explosive control of a non constrained diffusion and behaviour when the discount vanishes Cross Ref Introduction to the theory of optimal stopping Cross Ref Volume 11, Issue 4| 1969SIAM Review History Submitted:11 April 1969Published online:18 July 2006 InformationCopyright © 1969 Society for Industrial and Applied MathematicsPDF Download Article & Publication DataArticle DOI:10.1137/1011086Article page range:pp. 470-509ISSN (print):0036-1445ISSN (online):1095-7200Publisher:Society for Industrial and Applied Mathematics

Referência(s)
Altmetric
PlumX