Abstract

Due to the rise of cloud computing, how to realize adaptive and cost-effective virtual network function service chaining (vNF-SC) in a datacenter interconnection based on an elastic optical network (DCI-EON) has become an interesting but challenging problem. In this work, we tackle this problem by optimizing the design of a deep reinforcement learning (DRL)-based adaptive service framework, namely, Deep-NFVOrch. Specifically, Deep-NFVOrch works in service cycles and tries to reduce the setup latency of vNF-SC by invoking request prediction and pre-deployment at the beginning of each service cycle. We introduce a DRL-based observer (DRL-Observer) to select the duration of each service cycle adaptively according to the network status. The DRL-Observer is designed based on the advantage actor critic, which can interact with the network environment constantly through its deep neural network and learn how to make wise decisions based on the environment’s feedback. Our simulation results demonstrate that the DRL-Observer converges fast in online training with the help of a few asynchronous training threads, and the Deep-NFVOrch with it achieves better performance than several benchmarks, in terms of balancing the tradeoffs among overall resource utilization, vNF-SC request-blocking probability, and the number of network reconfigurations in a DCI-EON.

© 2019 Optical Society of America

Deep-Learning-Assisted Network Orchestration for On-Demand and Cost-Effective vNF Service Chaining in Inter-DC Elastic Optical Networks

Baojia Li, Wei Lu, Siqi Liu, and Zuqing Zhu
J. Opt. Commun. Netw. 10(10) D29-D41 (2018)

On establishing and task scheduling of data-oriented vNF-SCs in an optical DCI

Zichen Xu and Zuqing Zhu
J. Opt. Commun. Netw. 14(3) 89-99 (2022)

Dynamic slicing of multidimensional resources in DCI-EON with penalty-aware deep reinforcement learning

Meng Lian, Yongli Zhao, Yajie Li, Avishek Nag, and Jie Zhang
J. Opt. Commun. Netw. 16(2) 112-126 (2024)

Reconfiguring multicast sessions in elastic optical networks adaptively with graph-aware deep reinforcement learning

Xiaojian Tian, Baojia Li, Rentao Gu, and Zuqing Zhu
J. Opt. Commun. Netw. 13(11) 253-265 (2021)

Leveraging double-agent-based deep reinforcement learning to global optimization of elastic optical networks with enhanced survivability

Xiao Luo, Chen Shi, Liqian Wang, Xue Chen, Yang Li, and Tao Yang
Opt. Express 27(6) 7896-7911 (2019)