{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,10,23]],"date-time":"2024-10-23T04:27:35Z","timestamp":1729657655075,"version":"3.28.0"},"reference-count":28,"publisher":"Springer Science and Business Media LLC","issue":"3-4","license":[{"start":{"date-parts":[[2024,5,17]],"date-time":"2024-05-17T00:00:00Z","timestamp":1715904000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,5,17]],"date-time":"2024-05-17T00:00:00Z","timestamp":1715904000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100005950","name":"Hong Kong University of Science and Technology","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100005950","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Queueing Syst"],"published-print":{"date-parts":[[2024,12]]},"abstract":"Abstract<\/jats:title>Motivated by applications in queueing theory, we consider a class of singular stochastic control problems whose state space is the d<\/jats:italic>-dimensional positive orthant. The original problem is approximated by a drift control problem, to which we apply a recently developed computational method that is feasible for dimensions up to $$d=30$$<\/jats:tex-math>\n \n d<\/mml:mi>\n =<\/mml:mo>\n 30<\/mml:mn>\n <\/mml:mrow>\n <\/mml:math><\/jats:alternatives><\/jats:inline-formula> or more. To show that nearly optimal solutions are obtainable using this method, we present computational results for a variety of examples, including queueing network examples that have appeared previously in the literature.\n<\/jats:p>","DOI":"10.1007\/s11134-024-09910-5","type":"journal-article","created":{"date-parts":[[2024,5,17]],"date-time":"2024-05-17T14:03:01Z","timestamp":1715954581000},"page":"215-251","update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Singular control of (reflected) Brownian motion: a computational method suitable for queueing applications"],"prefix":"10.1007","volume":"108","author":[{"given":"Baris","family":"Ata","sequence":"first","affiliation":[]},{"given":"J. Michael","family":"Harrison","sequence":"additional","affiliation":[]},{"ORCID":"http:\/\/orcid.org\/0000-0002-4730-543X","authenticated-orcid":false,"given":"Nian","family":"Si","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,5,17]]},"reference":[{"issue":"1A","key":"9910_CR1","doi-asserted-by":"publisher","first-page":"331","DOI":"10.1214\/105051604000000495","volume":"15","author":"B Ata","year":"2005","unstructured":"Ata, B., Kumar, S.: Heavy traffic analysis of open processing networks with complete resource pooling: asymptotic optimality of discrete review policies. Ann. Appl. Probab. 15(1A), 331\u2013391 (2005)","journal-title":"Ann. Appl. Probab."},{"key":"9910_CR2","doi-asserted-by":"crossref","unstructured":"Ata, B., Harrison, J.M., Si, N.: Drift control of high-dimensional rbm: a computational method based on neural networks. arXiv preprintarXiv:2309.11651, (2023)","DOI":"10.1287\/stsy.2023.0044"},{"issue":"1","key":"9910_CR3","first-page":"39","volume":"4","author":"VE Bene\u0161","year":"1980","unstructured":"Bene\u0161, V.E., Shepp, L.A., Witsenhausen, H.S.: Some solvable stochastic control problemst. Stochast. Int. J. Probab. Stochastic Process. 4(1), 39\u201383 (1980)","journal-title":"Stochast. Int. J. Probab. Stochastic Process."},{"key":"9910_CR4","doi-asserted-by":"crossref","unstructured":"Budhiraja, A., Ghosh A.P.: A large deviations approach to asymptotically optimal control of crisscross network in heavy traffic. (2005)","DOI":"10.1214\/105051605000000250"},{"key":"9910_CR5","doi-asserted-by":"crossref","unstructured":"Budhiraja, A., Ross, K.: Optimal stopping and free boundary characterizations for some brownian control problems. (2008)","DOI":"10.1214\/08-AAP525"},{"issue":"2","key":"9910_CR6","doi-asserted-by":"publisher","first-page":"459","DOI":"10.1287\/15-SSY211","volume":"6","author":"A Budhiraja","year":"2017","unstructured":"Budhiraja, A., Liu, X., Saha, S.: Construction of asymptotically optimal control for crisscross network from a free boundary problem. Stochastic Syst. 6(2), 459\u2013518 (2017)","journal-title":"Stochastic Syst."},{"key":"9910_CR7","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1007\/BF01158766","volume":"18","author":"C Hong","year":"1994","unstructured":"Hong, C., Ping, Y., David, D.Y.: Optimal policies and heuristics: control and scheduling in a two-station queueing network. Queue. Syst. 18, 301\u2013332 (1994)","journal-title":"Queue. Syst."},{"key":"9910_CR8","doi-asserted-by":"publisher","DOI":"10.1017\/9781108772662","volume-title":"Processing Networks: Fluid Models and Stability","author":"JG Dai","year":"2020","unstructured":"Dai, J.G., Harrison, J.M.: Processing Networks: Fluid Models and Stability. Cambridge University Press, Cambridge (2020)"},{"issue":"34","key":"9910_CR9","doi-asserted-by":"publisher","first-page":"8505","DOI":"10.1073\/pnas.1718942115","volume":"115","author":"J Han","year":"2018","unstructured":"Han, J., Jentzen, A., Weinan, E.: Solving high-dimensional partial differential equations using deep learning. Proc. Natl. Acad. Sci. 115(34), 8505\u20138510 (2018)","journal-title":"Proc. Natl. Acad. Sci."},{"key":"9910_CR10","doi-asserted-by":"crossref","unstructured":"Harrison J.M.: Brownian models of queueing networks with heterogeneous customer populations. In: Stochastic differential systems, stochastic control theory and applications, pp. 147\u2013186. Springer (1988)","DOI":"10.1007\/978-1-4613-8762-6_11"},{"key":"9910_CR11","first-page":"147","volume":"4","author":"JM Harrison","year":"1996","unstructured":"Harrison, J.M.: The bigstep approach to flow management in stochastic processing networks. Stochastic Netw. Theory Appl. 4, 147\u2013186 (1996)","journal-title":"Stochastic Netw. Theory Appl."},{"issue":"3","key":"9910_CR12","doi-asserted-by":"publisher","first-page":"822","DOI":"10.1214\/aoap\/1028903452","volume":"8","author":"JM Harrison","year":"1998","unstructured":"Harrison, J.M.: Heavy traffic analysis of a system with parallel servers: asymptotic optimality of discrete-review policies. Annals Appl. Probab. 8(3), 822\u2013848 (1998)","journal-title":"Annals Appl. Probab."},{"issue":"2","key":"9910_CR13","doi-asserted-by":"publisher","first-page":"302","DOI":"10.1214\/aop\/1176994471","volume":"9","author":"JM Harrison","year":"1981","unstructured":"Harrison, J.M., Reiman, M.I.: Reflected brownian motion on an orthant. Ann. Probabil. 9(2), 302\u2013308 (1981)","journal-title":"Ann. Probabil."},{"issue":"3","key":"9910_CR14","doi-asserted-by":"publisher","first-page":"439","DOI":"10.1287\/moor.8.3.439","volume":"8","author":"JM Harrison","year":"1983","unstructured":"Harrison, J.M., Taksar, M.I.: Instantaneous control of Brownian motion. Math. Oper. Res. 8(3), 439\u2013453 (1983)","journal-title":"Math. Oper. Res."},{"key":"9910_CR15","first-page":"747","volume":"5","author":"JM Harrison","year":"1997","unstructured":"Harrison, J.M., Van Mieghem, J.A.: Dynamic control of brownian networks: state space collapse and equivalent workload formulations. Ann. Appl. Probabil. 5, 747\u2013771 (1997)","journal-title":"Ann. Appl. Probabil."},{"key":"9910_CR16","doi-asserted-by":"publisher","first-page":"265","DOI":"10.1007\/BF01225319","volume":"5","author":"JM Harrison","year":"1989","unstructured":"Harrison, J.M., Wein, L.M.: Scheduling networks of queues: heavy traffic analysis of a simple open network. Queueing Syst. 5, 265\u2013279 (1989)","journal-title":"Queueing Syst."},{"key":"9910_CR17","doi-asserted-by":"publisher","first-page":"339","DOI":"10.1023\/A:1019188531950","volume":"33","author":"JM Harrison","year":"1999","unstructured":"Harrison, J.M., Lopez, M.J.: Heavy traffic resource pooling in parallel-server systems. Queueing Syst. 33, 339\u2013368 (1999)","journal-title":"Queueing Syst."},{"issue":"2","key":"9910_CR18","doi-asserted-by":"publisher","first-page":"225","DOI":"10.2307\/1426435","volume":"15","author":"I Karatzas","year":"1983","unstructured":"Karatzas, I.: A class of singular stochastic control problems. Adv. Appl. Probab. 15(2), 225\u2013254 (1983)","journal-title":"Adv. Appl. Probab."},{"key":"9910_CR19","unstructured":"Kingma, D.P., Ba, J.: A method for stochastic optimization. arXiv preprintarXiv:1412.6980, (2014)"},{"issue":"4","key":"9910_CR20","doi-asserted-by":"publisher","first-page":"563","DOI":"10.1287\/opre.1030.0107","volume":"52","author":"S Kumar","year":"2004","unstructured":"Kumar, S., Muthuraman, K.: A numerical method for solving singular stochastic control problems. Oper. Res. 52(4), 563\u2013582 (2004)","journal-title":"Oper. Res."},{"issue":"5","key":"9910_CR21","doi-asserted-by":"publisher","first-page":"999","DOI":"10.1137\/0328056","volume":"28","author":"HJ Kushner","year":"1990","unstructured":"Kushner, H.J.: Numerical methods for stochastic control problems in continuous time. SIAM J. Control Optim. 28(5), 999\u20131048 (1990)","journal-title":"SIAM J. Control Optim."},{"issue":"6","key":"9910_CR22","doi-asserted-by":"publisher","first-page":"1443","DOI":"10.1137\/0329073","volume":"29","author":"HJ Kushner","year":"1991","unstructured":"Kushner, H.J., Martins, L.F.: Numerical methods for stochastic singular control problems. SIAM J. Control Optim. 29(6), 1443\u20131475 (1991)","journal-title":"SIAM J. Control Optim."},{"issue":"6","key":"9910_CR23","doi-asserted-by":"publisher","first-page":"2133","DOI":"10.1137\/S0363012994265882","volume":"34","author":"LF Martins","year":"1996","unstructured":"Martins, L.F., Shreve, S.E., Soner, H.M.: Heavy traffic convergence of a controlled, multiclass queueing system. SIAM J. Control Optim. 34(6), 2133\u20132171 (1996)","journal-title":"SIAM J. Control Optim."},{"key":"9910_CR24","doi-asserted-by":"crossref","unstructured":"Menaldi, J.L., Taksar, M.I.: Optimal correction problem of a multidimensional stochastic system. Automatica 25(2), 223\u2013232 (1989)","DOI":"10.1016\/0005-1098(89)90075-7"},{"key":"9910_CR25","doi-asserted-by":"crossref","unstructured":"Rasamoelina, A.D., Adjailia, F., Sin\u010d\u00e1k, P.: A review of activation function for artificial neural network. In: 2020 IEEE 18th World Symposium on Applied Machine Intelligence and Informatics (SAMI), pp. 281\u2013286. IEEE, (2020)","DOI":"10.1109\/SAMI48414.2020.9108717"},{"key":"9910_CR26","doi-asserted-by":"crossref","unstructured":"Taylor, L.M., Williams, R.J.: Existence and uniqueness of semimartingale reflecting brownian motions in an orthant. Probabil. Theory Related Fields 96(3), 283\u2013317 (1993)","DOI":"10.1007\/BF01292674"},{"key":"9910_CR27","doi-asserted-by":"publisher","first-page":"175","DOI":"10.1006\/jdeq.1994.1080","volume":"111","author":"SA Williams","year":"1994","unstructured":"Williams, S.A., Chow, P.-L., Menaldi, J.-L.: Regularity of the free boundary in singular stochastic control. J. Differ. Equ. 111, 175\u2013201 (1994)","journal-title":"J. Differ. Equ."},{"key":"9910_CR28","unstructured":"Zhong, Y.: Heavy-traffic near-optimality of discrete-review policies for parallel-server systems using drift control. In: Manuscript in preparation, University of Chicago (2024)"}],"container-title":["Queueing Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11134-024-09910-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11134-024-09910-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11134-024-09910-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,22]],"date-time":"2024-10-22T22:03:17Z","timestamp":1729634597000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11134-024-09910-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,17]]},"references-count":28,"journal-issue":{"issue":"3-4","published-print":{"date-parts":[[2024,12]]}},"alternative-id":["9910"],"URL":"https:\/\/doi.org\/10.1007\/s11134-024-09910-5","relation":{},"ISSN":["0257-0130","1572-9443"],"issn-type":[{"type":"print","value":"0257-0130"},{"type":"electronic","value":"1572-9443"}],"subject":[],"published":{"date-parts":[[2024,5,17]]},"assertion":[{"value":"18 December 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 April 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 May 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}