乐胖代购免代理版

{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,11]],"date-time":"2024-09-11T13:23:34Z","timestamp":1726061014858},"reference-count":39,"publisher":"Optica Publishing Group","issue":"1","license":[{"start":{"date-parts":[[2019,10,3]],"date-time":"2019-10-03T00:00:00Z","timestamp":1570060800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/doi.org\/10.1364\/OA_License_v1#VOR"},{"start":{"date-parts":[[2019,10,3]],"date-time":"2019-10-03T00:00:00Z","timestamp":1570060800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/opg.optica.org\/policies\/opg-tdm-policy.json"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61701472","61871357"],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002367","name":"Chinese Academy of Sciences","doi-asserted-by":"publisher","award":["QYZDYSSW-JSC003"],"id":[{"id":"10.13039\/501100002367","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["opg.optica.org"],"crossmark-restriction":false},"short-container-title":["J. Opt. Commun. Netw."],"published-print":{"date-parts":[[2020,1,1]]},"abstract":"Due to the rise of cloud computing, how to realize adaptive and cost-effective virtual network function service chaining (vNF-SC) in a datacenter interconnection based on an elastic optical network (DCI-EON) has become an interesting but challenging problem. In this work, we tackle this problem by optimizing the design of a deep reinforcement learning (DRL)-based adaptive service framework, namely, Deep-NFVOrch. Specifically, Deep-NFVOrch works in service cycles and tries to reduce the setup latency of vNF-SC by invoking request prediction and pre-deployment at the beginning of each service cycle. We introduce a DRL-based observer (DRL-Observer) to select the duration of each service cycle adaptively according to the network status. The DRL-Observer is designed based on the advantage actor critic, which can interact with the network environment constantly through its deep neural network and learn how to make wise decisions based on the environment\u2019s feedback. Our simulation results demonstrate that the DRL-Observer converges fast in online training with the help of a few asynchronous training threads, and the Deep-NFVOrch with it achieves better performance than several benchmarks, in terms of balancing the tradeoffs among overall resource utilization, vNF-SC request-blocking probability, and the number of network reconfigurations in a DCI-EON.<\/jats:p>","DOI":"10.1364\/jocn.12.000a18","type":"journal-article","created":{"date-parts":[[2019,10,1]],"date-time":"2019-10-01T15:40:16Z","timestamp":1569944416000},"page":"A18","update-policy":"http:\/\/dx.doi.org\/10.1364\/crossmark_policy","source":"Crossref","is-referenced-by-count":34,"title":["Deep-NFVOrch: leveraging deep reinforcement learning to achieve adaptive vNF service chaining in DCI-EONs"],"prefix":"10.1364","volume":"12","author":[{"given":"Baojia","family":"Li","sequence":"first","affiliation":[]},{"given":"Wei","family":"Lu","sequence":"additional","affiliation":[]},{"ORCID":"http:\/\/orcid.org\/0000-0002-4251-788X","authenticated-orcid":true,"given":"Zuqing","family":"Zhu","sequence":"additional","affiliation":[]}],"member":"285","published-online":{"date-parts":[[2019,10,3]]},"reference":[{"key":"jocn-12-1-A18-R2","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1109\/MNET.2015.7293303","volume":"29","author":"Lu","year":"2015","journal-title":"IEEE Netw."},{"key":"jocn-12-1-A18-R4","doi-asserted-by":"publisher","first-page":"543","DOI":"10.1109\/TNSM.2017.2711610","volume":"14","author":"Liu","year":"2017","journal-title":"IEEE Trans. Netw. Serv. Manage."},{"key":"jocn-12-1-A18-R5","first-page":"7","article-title":"Specifying and placing chains of virtual network functions","volume-title":"CloudNet","author":"Mehraghdam","year":"2014"},{"key":"jocn-12-1-A18-R6","doi-asserted-by":"publisher","first-page":"1539","DOI":"10.1109\/LCOMM.2016.2580151","volume":"20","author":"Fang","year":"2016","journal-title":"IEEE Commun. Lett."},{"key":"jocn-12-1-A18-R7","doi-asserted-by":"publisher","first-page":"s12","DOI":"10.1109\/MCOM.2012.6146481","volume":"50","author":"Gerstel","year":"2012","journal-title":"IEEE Commun. Mag."},{"key":"jocn-12-1-A18-R8","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1109\/JLT.2012.2227683","volume":"31","author":"Zhu","year":"2013","journal-title":"J. Lightwave Technol."},{"key":"jocn-12-1-A18-R9","doi-asserted-by":"publisher","first-page":"836","DOI":"10.1364\/JOCN.5.000836","volume":"5","author":"Gong","year":"2013","journal-title":"J. Opt. Commun. Netw."},{"key":"jocn-12-1-A18-R10","doi-asserted-by":"publisher","first-page":"A100","DOI":"10.1364\/JOCN.5.00A100","volume":"5","author":"Yin","year":"2013","journal-title":"J. Opt. Commun. Netw."},{"key":"jocn-12-1-A18-R11","doi-asserted-by":"publisher","first-page":"450","DOI":"10.1109\/JLT.2013.2294389","volume":"32","author":"Gong","year":"2014","journal-title":"J. Lightwave Technol."},{"key":"jocn-12-1-A18-R12","doi-asserted-by":"publisher","first-page":"1149","DOI":"10.1109\/JPROC.2011.2179629","volume":"100","author":"Develder","year":"2012","journal-title":"Proc. IEEE"},{"key":"jocn-12-1-A18-R13","doi-asserted-by":"publisher","first-page":"314","DOI":"10.1364\/JOCN.7.000314","volume":"7","author":"Fang","year":"2015","journal-title":"J. Opt. Commun. Netw."},{"key":"jocn-12-1-A18-R14","doi-asserted-by":"publisher","first-page":"3330","DOI":"10.1109\/JLT.2016.2565002","volume":"34","author":"Zeng","year":"2016","journal-title":"J. Lightwave Technol."},{"key":"jocn-12-1-A18-R15","doi-asserted-by":"publisher","first-page":"2712","DOI":"10.1109\/JLT.2017.2700229","volume":"35","author":"Wang","year":"2017","journal-title":"J. Lightwave Technol."},{"key":"jocn-12-1-A18-R16","doi-asserted-by":"publisher","first-page":"A232","DOI":"10.1364\/JOCN.10.00A232","volume":"10","author":"Chen","year":"2018","journal-title":"J. Opt. Commun. Netw."},{"key":"jocn-12-1-A18-R17","first-page":"1","article-title":"Orchestrating data-intensive vNF service chains in inter-DC elastic optical networks","volume-title":"Optical Network Design and Modeling (ONDM)","author":"Lu","year":"2017"},{"key":"jocn-12-1-A18-R18","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/TNSM.2018.2866400","volume":"16","author":"Chen","year":"2019","journal-title":"IEEE Trans. Netw. Serv. Manage."},{"key":"jocn-12-1-A18-R19","doi-asserted-by":"publisher","first-page":"15468","DOI":"10.1364\/OE.25.015468","volume":"25","author":"Yin","year":"2017","journal-title":"Opt. Express"},{"key":"jocn-12-1-A18-R20","first-page":"1","article-title":"The dynamic placement of virtual network functions","volume-title":"Network Operations and Management Symposium (NOMS)","author":"Clayman","year":"2014"},{"key":"jocn-12-1-A18-R21","doi-asserted-by":"publisher","first-page":"2001","DOI":"10.1109\/TNET.2013.2281542","volume":"21","author":"Krishnan","year":"2013","journal-title":"IEEE\/ACM Trans. Netw."},{"key":"jocn-12-1-A18-R22","doi-asserted-by":"publisher","first-page":"D29","DOI":"10.1364\/JOCN.10.000D29","volume":"10","author":"Li","year":"2018","journal-title":"J. Opt. Commun. Netw."},{"key":"jocn-12-1-A18-R23","first-page":"1","article-title":"Deep-NFVOrch: deep reinforcement learning based service framework for adaptive vNF service chaining in IDC-EONs","volume-title":"Optical Fiber Communications Conference and Exhibition (OFC)","author":"Li","year":"2019"},{"key":"jocn-12-1-A18-R24","doi-asserted-by":"publisher","first-page":"1508","DOI":"10.1109\/JLT.2015.2389526","volume":"33","author":"Zhu","year":"2015","journal-title":"J. Lightwave Technol."},{"key":"jocn-12-1-A18-R25","doi-asserted-by":"publisher","first-page":"A122","DOI":"10.1364\/JOCN.10.00A122","volume":"10","author":"Liu","year":"2018","journal-title":"J. Opt. Commun. Netw."},{"key":"jocn-12-1-A18-R26","doi-asserted-by":"publisher","first-page":"5335","DOI":"10.1109\/JLT.2017.2777605","volume":"35","author":"Lu","year":"2017","journal-title":"J. Lightwave Technol."},{"key":"jocn-12-1-A18-R27","doi-asserted-by":"publisher","first-page":"1742","DOI":"10.1109\/JLT.2019.2902487","volume":"37","author":"Chen","year":"2019","journal-title":"J. Lightwave Technol."},{"key":"jocn-12-1-A18-R28","doi-asserted-by":"publisher","first-page":"226","DOI":"10.1364\/JOCN.11.000226","volume":"11","author":"Velasco","year":"2019","journal-title":"J. Opt. Commun. Netw."},{"key":"jocn-12-1-A18-R29","doi-asserted-by":"publisher","first-page":"152","DOI":"10.1109\/MCOM.2018.1701191","volume":"56","author":"Chen","year":"2018","journal-title":"IEEE Commun. Mag."},{"key":"jocn-12-1-A18-R30","doi-asserted-by":"publisher","first-page":"1853","DOI":"10.1109\/JLT.2019.2894179","volume":"37","author":"Panayiotou","year":"2019","journal-title":"J. Lightwave Technol."},{"key":"jocn-12-1-A18-R31","doi-asserted-by":"publisher","first-page":"4155","DOI":"10.1109\/JLT.2019.2923615","volume":"37","author":"Chen","year":"2019","journal-title":"J. Lightwave Technol."},{"key":"jocn-12-1-A18-R33","first-page":"1928","article-title":"Asynchronous methods for deep reinforcement learning","volume-title":"International Conference on Machine Learning (ICML)","author":"Mnih","year":"2016"},{"volume-title":"Reinforcement Learning: An Introduction","year":"2018","author":"Sutton","key":"jocn-12-1-A18-R34"},{"key":"jocn-12-1-A18-R35","doi-asserted-by":"publisher","first-page":"1520","DOI":"10.1109\/LCOMM.2012.070512.120740","volume":"16","author":"Gong","year":"2012","journal-title":"IEEE Commun. Lett."},{"key":"jocn-12-1-A18-R36","doi-asserted-by":"publisher","first-page":"4921","DOI":"10.1109\/JLT.2019.2925827","volume":"37","author":"Fang","year":"2019","journal-title":"J. Lightwave Technol."},{"key":"jocn-12-1-A18-R37","doi-asserted-by":"publisher","first-page":"4426","DOI":"10.1109\/JLT.2019.2925312","volume":"37","author":"Liu","year":"2019","journal-title":"J. Lightwave Technol."},{"key":"jocn-12-1-A18-R38","first-page":"921","article-title":"The importance of encoding versus training with sparse coding and vector quantization","volume-title":"International Conference on Machine Learning (ICML)","author":"Coates","year":"2011"},{"key":"jocn-12-1-A18-R40","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1038\/nature14236","volume":"518","author":"Mnih","year":"2015","journal-title":"Nature"},{"key":"jocn-12-1-A18-R41","doi-asserted-by":"publisher","first-page":"1621","DOI":"10.1109\/JLT.2013.2254468","volume":"31","author":"Lu","year":"2013","journal-title":"J. Lightwave Technol."},{"key":"jocn-12-1-A18-R42","doi-asserted-by":"publisher","first-page":"316","DOI":"10.1109\/90.330413","volume":"2","author":"Paxson","year":"1994","journal-title":"IEEE\/ACM Trans. Netw."},{"key":"jocn-12-1-A18-R44","first-page":"58","article-title":"Evolve or die: high-availability design principles drawn from Google\u2019s network infrastructure","volume-title":"ACM SIGCOMM","author":"Govindan","year":"2016"}],"container-title":["Journal of Optical Communications and Networking"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/opg.optica.org\/viewmedia.cfm?URI=jocn-12-1-A18&seq=0","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,6]],"date-time":"2024-08-06T19:25:13Z","timestamp":1722972313000},"score":1,"resource":{"primary":{"URL":"https:\/\/opg.optica.org\/abstract.cfm?URI=jocn-12-1-A18"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,3]]},"references-count":39,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020]]},"published-print":{"date-parts":[[2020]]}},"URL":"https:\/\/doi.org\/10.1364\/jocn.12.000a18","relation":{},"ISSN":["1943-0620","1943-0639"],"issn-type":[{"type":"print","value":"1943-0620"},{"type":"electronic","value":"1943-0639"}],"subject":[],"published":{"date-parts":[[2019,10,3]]},"assertion":[{"value":"Optica Publishing Group","name":"publisher","label":"This article is maintained by"},{"value":"https:\/\/doi.org\/10.1364\/JOCN.12.000A18","name":"articlelink","label":"Crossref DOI link to publisher maintained version"},{"value":"research-article","name":"content_type","label":"Article type"},{"value":"Screened by Similarity Check","name":"cross_check","label":"Similarity check"},{"value":"Yes","order":0,"name":"peer_reviewed","label":"Peer reviewed","group":{"name":"peer_review","label":"Peer review"}},{"value":"Single blind","order":1,"name":"review_process","label":"Review process","group":{"name":"peer_review","label":"Peer review"}},{"value":"2 July 2019","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"30 August 2019","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"3 October 2019","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}},{"value":"\u00a9 2019 Optical Society of America","name":"copyright","label":"Copyright"}]}}