1. Introduction
With the rapid growth of car ownership, traffic congestion has become a severe problem in metropolises [
1]. To reduce the congestion, information on the traffic conditions plays a vital role [
2]. At present, traffic information is obtained through traditional police patrols by ground vehicles [
3] or through static sensors such as digital cameras [
4]. These approaches lack flexibility and are restricted to the road network. For example, the static sensors can only detect fixed areas, and when the roads are heavily congested, the patrol vehicle can hardly enter the road to gain traffic information. In recent years, Unmanned Aerial Vehicles, knowns as drones, have drawn considerable attention due to their environmental adaptability, flexibility, and potential uses in logistics and monitoring [
5]. Drones can carry different types of loads to perform different kinds of tasks, such as line inspection and traffic patrolling. However, the widespread application of drones is limited by their battery capacities [
6]. One solution to overcoming the drones’ disadvantage is to coordinate ground vehicles and drones.
Coordination between ground vehicles and drones could combine their advantages to enhance efficiency [
7]. In detail, the vehicle acts as a charging platform for drones to make up for their limited flight endurance [
8]. The combination of vehicle and drones has been applied to parcel deliveries [
9]. For example, Murray et al. [
7] considered a vehicle and a drone for the last mail delivery, and proposed the flying sidekick traveling salesman problem (FSTSP). Karak et al. [
10] presented a mathematical formulation for the hybrid vehicle-drone routing problem (HVDRP) for pick-up and delivery services. The researchers developed an extended Clark and Wright algorithm to solve the HVDRP. Furthermore, other methods such as the large neighborhood search (ALNS) [
11,
12], tabu search with simulated annealing algorithm (TS-SA) [
13], and variable neighborhood search (VNS) [
14] were used to solve the coordinated vehicle-drone planning problem. It can be concluded that previous works are mainly oriented to parcel deliveries which point targets abstractly. This paper focuses on the patrol routing problem on an urban road network, which is actually a line task. This problem can be defined as a coordinated vehicle-drone arc routing problem [
15].
At present, the coordinated vehicle-drone arc routing problem has motivated a few optimization approaches with the objective of reducing time or cost. Among the available studies, Liu et al. [
16] investigated a high-voltage power line inspection system with a ground vehicle and a drone. To optimize the route of vehicle and drone, the researchers constructed a two-layer heuristic to solve such problem. Luo et al. [
17] first proposed a traffic patrol mode consisting of a ground vehicle and a drone in an urban road system; both arc tasks and point tasks are considered in their traffic patrol mode, and they presented a two-stage heuristic approach to scheduling the ground vehicle and the drone. In the scenarios of the above two studies, only one vehicle and one drone are considered, which is unrealistic considering that a ground vehicle can carry more than one drone. Therefore, Wu et al. [
18] focused on the scheduling problem with one vehicle and multiple drones, which is closer to reality and more difficult to solve. An adaptive large neighborhood search algorithm was developed to solve the problem. In their work, the asymmetry of the road network was not considered, while one-way roads in the road network are more likely to be congested. Hence, this study focuses on the asymmetric coordinated vehicle-drones arc routing problem (A-VD-ARP) which means some arcs of the road network in this problem are unidirectional.
This paper studies an extension of the arc routing problem (ARP) where a truck is collaborating with multiple drones. Since the problem is a generalization of the classic ARP, it is NP-hard to solve. It is a great challenge to solve A-VD-ARP due to the fact that arc tasks have a dimension of direction compared with point tasks. In this article, a metaheuristic method of large neighborhood search with simulated annealing (LNS-SA) algorithm is proposed to solve the coordinated planning problem discussed above. Under the LNS-SA framework, an initial solution is generated through a heuristic method, and then we design several neighborhood operators based on the characteristics of the A-VD-ARP to optimize the solution and expand the search space. Experiments demonstrate that the proposed method can significantly improve the efficiency of coordinated vehicle-drones planning.
The main contributions of this paper are summarized as follows.
- (1)
For the first time, we investigate the coordinated vehicle-drone arc routing problem under an asymmetric road network, which is closer to reality. In this scenario, a truck, which carries multiple drones, departs from the depot, travels on the road network and returns to the depot after patrolling all the tasks. Drones take off from the truck, patrol one or several arc tasks, and return to the truck.
- (2)
In order to solve the above problem, we propose a metaheuristic method with an innovative coding scheme, a heuristic method for obtaining the initial solution and six neighborhood operators for improving solutions. Through the LNS-SA framework, the solution is iteratively optimized.
- (3)
We conduct extensive experiments on simulated and realistic scenarios to verify the effectiveness of the proposed method. We design a total of 9 experimental scenarios on 3 datasets and a realistic scenario on Changsha City. The proposed algorithm is compared with simulated annealing (SA), variable neighborhood search (VNS), and tabu search (TL). The computational results clearly prove that the proposed algorithm can obtain a satisfactory solution in acceptable time.
The structure of this paper is as follows. In
Section 2, we summarize the research of related works. In
Section 3, we describe the A-VD-ARP and construct a mathematical model. In
Section 4, a large-scale neighborhood search framework combined with a simulated annealing mechanism is proposed, and the corresponding neighborhood structure is given according to the characteristics of the problem.
Section 5 summarizes and discusses the experimental results. Finally,
Section 6 concludes the full text and presents the future research direction.
2. Related Work
The coordinated vehicle-drone arc routing problem has a wide range of application scenarios in real life. In the arc routing problem, most researchers do not consider the cooperation between vehicles and drones. There are few studies on the coordinated vehicle-drone arc routing problem. We analyze the coordinated vehicle-drone arc routing problem from three aspects: (1) the arc routing problem, (2) point-target-oriented vehicle-drone coordination, and (3) the coordinated vehicle-drone arc routing problem.
In the arc routing problem, there are three important branches: the Chinese Postman Problem (CPP) [
19,
20], the Rural Postman Problem (RPP) [
21,
22,
23], and the arc routing with capacity constraints problem (Capacitated Arc Routing Problem, CARP) [
24,
25,
26,
27]. For the Chinese Postman Problem (CPP), Nilofer et al. [
20] considered passing as many important nodes as possible while making the vehicle traverse at least the edges in the graph. The Rural Postal Route Problem (RPP) only visits some of the edges in the graph, which is the general form of the CPP problem. Calogiuri et al. [
21] proposed a branch and bound algorithm to solve the RPP exactly. Monroy-Licht et al. [
22] used a large-scale neighborhood search algorithm to solve the problem of rural postal route with time windows. This algorithm can quickly and efficiently shorten the calculation time in large-scale instances and obtain satisfactory results. The capacity-constrained arc routing problem (CARP) takes into account the vehicle’s maximum range limit. Huang et al. [
24] used the ant colony algorithm to solve the CARP problem with time windows. Xing et al. [
25] proposed an extended multi-park capacity-constrained arc routing problem (MCARP), which was optimized by an evolutionary algorithm. Besides tabu search [
28], hybrid heuristic algorithm [
29] and divide and conquer algorithm [
30] are also used to solve the CARP problem.
In the research on vehicle-drone collaboration, Murray et al. [
7] proposed the Flight Assisted Traveling Salesman Problem (FSTSP) and designed a heuristic algorithm to solve it. Agatz et al. [
31] proposed the Drones Traveling Salesman Problem (TSP-D) and designed a “path first, cluster second” heuristic algorithm to solve it. For the TSP-D model, Ha et al. [
32] first generated the TSP path, then decomposed the TSP-D path from the TSP path, and then optimized the TSP-D path using the LS operator. Tu et al. [
33] proposed an adaptive large neighborhood search algorithm to solve the TSP-mD model containing multiple drones. Hu et al. [
34] proposed an algorithm that first used a K-means clustering approach to find a reasonable launch position for the drone, and then determined the route of the ground vehicle based on the genetic algorithm. Pan et al. [
35] presents an innovative schedule approach by coordinating the logistic drone and crowdsourced buses. In order to reduce solution time, Wu [
36] proposed a reinforcement learning approach to solve the truck-and-drone coordinated delivery problem efficiently. Except for package delivery, Huang et al. focused on the deployment of a charging station for aerial surveillance by drones. Trotta et al. [
37] proposed a bus-drone coordinated surveillance mode. Tian [
38] presented a target surveillance mode by coordinating a truck and multiple drones. The researchers proposed a new heuristic method to optimize the truck and drone routes. In addition, Dorling et al. [
6] and Wang et al. [
39] extended the vehicle-drone coordination problem from single-vehicle and multi-drone to multi-vehicle and multi-drone.
For the coordinated vehicle-drone arc routing problem, Liu et al. [
16] proposed a two-layer point-arc routing problem model to cooperate with ground vehicles and drones for high-voltage power lines inspection; they designed two heuristic algorithms of “cluster first, then sort” and “sort first, then decompose” to solve the problem. Luo et al. [
17] proposed a traffic patrol model for heterogeneous tasks in urban road systems, in which ground vehicles only serve as the charging platform for the drones, and drones perform point and arc tasks along the road network. Wu et al. [
18] consider the scheduling problem with one vehicle and multiple drones, and propose a metaheuristic method to solve the problem efficiently.
According to the above review, it can be concluded that the traditional arc routing problem has been extensively studied, and, secondly, in the field of vehicle-drone coordination, the research on point targets has also been widely investigated. But the research on the vehicle-drone cooperation problem oriented to line targets is still missing, while the coordinated vehicle-drone arc routing problem has a wide range of application scenarios in real life. Asymmetric arc routing by coordinating a truck and multiple drones is considered in this article, and a metaheuristic algorithm is proposed to solve this problem.
3. Problem Description
The proposed A-VD-ARP in this article is the following: a truck with multiple drones departs from the patrol center, travels on the asymmetric road network—which means some arcs of the road network are unidirectional—and returns to the patrol center after patrolling all the arcs in the road network. The drones can be launched and recovered from the truck at the node (intersection) of the road network, and the drones can access one or several target arcs at one time as long as the maximum flight time is not exceeded. Both the truck and the drones can perform the patrol task. Considering the heavily congested road which cannot be patrolled by the truck, some of the target arcs are required to be accessed only by drones. In addition, the truck must travel along the road network, while the drones are not restricted to the road network. To simplify the problem, the time of launching/recovering a drone is incorporated into the travel time as in references [
16,
31].
The asymmetric road network in this paper is simplified as a directed connected graph, represented by
. The set of road intersections is the point set
, where
represents the number of intersections in the road network. The set of edges is represented as
, where arc
connects node
and node
. Each arc has a non-negative weight
, which represents the length of the edge. If
, then
. Moreover, since the road network is asymmetric in this article, so
. We define the set of general target arcs as
. The set of target arcs that can only be performed by drones is presented as
.
Figure 1 shows an example scenario in this article. In addition, other symbols and descriptions are shown in
Table 1.
3.1. Objective Function
The objective function of the A-VD-ARP is to minimize the total time for the truck and drones to coordinately perform all patrol tasks and return to the depot. Let
and
denote the time when the truck and the
-th drone return to the patrol center, respectively. Then the objective function can be expressed as:
3.2. Vehicle Route Constraints
Let the binary variable
denote whether the truck patrols the task arc
. If the truck accesses the arc
,
; otherwise,
. The following constraints should be satisfied for the truck.
Constraint (2) guarantees the continuity of the truck route. Constraints (3) and (4) ensure that the truck departs from the patrol center and eventually returns to the patrol center.
3.3. Drone Route Constraints
Let the binary variable
denote that the
-th drone is released from node
and recovered at node
. For the access path of the drone, there are the following constraints:
Constraints (5) and (6) ensure that each flight route of the drone has only one release node and one recovery node.
Constraints (7) and (8) respectively ensure that the release and recover nodes for the drones must be the nodes on the truck route, that is, they ensure the cooperative relationship between truck and drones.
The launch and recover order of the drones must also be constrained. A drone can be released only if it has never been released or has been recovered since the last release, otherwise, it cannot be released at node .
For the truck, when reaching a launching node, at least one drone needs to be on the truck.
Constraints (9) and (10) stipulate that only the drones on the truck can be launched and only the drones that have been released can be recovered. Constraint (11) ensures that at most drones are in flight at any time.
Due to the limitation of the battery capacity of the drone, each drone has a maximum flight time during one flight. Assuming that the maximum flight time of the drone is
, then for each drone path
, the following constraints should be satisfied:
3.4. Time Constraints and Task Constraints
The time constraints for the truck and drones are as follows:
Constraints (14) and (15) represent the earliest arrival times of the truck and drones at each node, respectively, where is an infinite positive number.
Each task needs to be performed by the drone or the truck at least once, subject to the following constraints:
4. Solution Method
According to the characteristic of the A-VD-ARP, we designed a metaheuristic based on large-scale neighborhood search and simulated annealing mechanism (LNS-SA). First, the initial solution is constructed by a heuristic method, then, neighborhood search strategies are applied under the LNS-SA framework to iteratively optimize the solution.
The large-scale neighborhood search was introduced by Shaw in 1998 [
40]. The solution is searched by the destruction operator and the repair operator, which greatly enhances the search ability of the algorithm. Simulated annealing was proposed by Kirkpatrick in 1983 [
41], which can effectively avoid falling into a local minimum.
In this paper, the large-scale neighborhood search and simulated annealing are combined to improve the efficiency of the algorithm. The LNS-SA algorithm framework is shown in Algorithm 1. Among them, the initial solution is obtained by the heuristic algorithm described in
Section 4.1, and the neighborhood list contains a certain number of neighborhood search strategies. The algorithm first initializes the solution, the current solution, the current temperature, and the current number of iterations (Line 2). Then, in the main loop of the LNS-SA algorithm (lines 3–19), the neighborhood structure is selected to adjust the current solution until the termination condition is satisfied. Whether the obtained solution is accepted depends on the simulated annealing criterion (lines 7–11). Each time the main loop is executed, the iteration count and termination temperature are updated (Lines 4, 19).
Algorithm 1: Framework of LNS-SA |
| Input: Initial temperature
; termination temperature
; maximum iteration number
; annealing rate
; initial solution
; destruction operator collection
; repair operator collection
|
| Output: Optimal solution
|
1 | Get through the heuristic method |
2 | Initialize
|
3 | While do |
4 |
|
5 |
|
6 |
|
7 | If
then |
8 |
|
9 | If then |
10 |
|
11 | End if |
12 | Else |
13 |
|
14 |
|
15 | If then |
16 |
|
17 |
Break |
18 |
End if |
19 |
|
20 | End while |
4.1. Initial Solution Generation
For neighborhood search algorithms, the quality of the initial solution often plays an important role in the final optimization result and the performance of the algorithms. In the construction of the initial solution, we firstly assign arc tasks to drones or the truck under the condition that the constraints are satisfied. The access direction of each task arc is determined under the road network constraint considering the road network is asymmetric. Notice that the drone is not restricted to the road network, so the access direction for drones can be randomly determined. For the task arcs that are visited by drones, allocate the launch and recovery nodes that satisfies the drones’ flight constraints; after doing this, each route of the drone can be uniquely determined. Finally, the route of the truck is generated by inserting the drone launch and recovery node sequence without violation of the maximum flight time of the drone, and afterwards, all tasks performed by the truck are inserted into the truck route. At this point, an initial solution of the arc routing scheme for single-truck and multiple drones is formed. The process of preprocessing the road network and generating the initial solution is shown in Algorithm 2.
Algorithm 2: Heuristic method for initializing solution |
| Input: Road network
|
| Output: Initial solution
|
1 | Initialize The truck route
, the
-th drone’s route
|
2 | Calculate the shortest distance between any two nodes by Floyd algorithm |
3 | While do |
4 |
If |
5 | Randomly select a pair of take-off and landing nodes and the access direction |
6 | Insert the take-off and landing nodes in the truck route. |
7 | Delete from
|
8 | else |
9 | Insert the two endpoints of the task to the truck route |
10 | Delete
from
|
11 | End if |
12 | End while |
Specifically, we encode the route information of the truck and the drones into two matrices, and . The encoding information of the two matrices is described below.
is a matrix of size
used to store task arc information, where
is the number of task arcs. As shown in
Figure 2, each row of the matrix stores one task arc information. The first column stores the executor of the task arc. If it is 1, it means that the task arc is accessed by the drone, and −1 means that the task arc is accessed by the truck. The second column stores the information about whether the task arc belongs to a linked task. 0 indicates that the task arc is an independent task arc. Numbers such as 1, 2, … represent the linked task, and task arcs in the same linked task are represented by the same number. The numbers in the third column indicate the access order of the arcs in the linked task. If the task is an independent task, the number in the third column is 0. If the arc is in a linked task, the number in the third column is a natural number greater than 0 whose size indicates the order of access. The fourth column stores the access direction of the task arc, 0 means forward, 1 means reverse. The fifth and sixth columns store the start and end nodes of the task arc, respectively. If the task edge is assigned to the truck, the start node and the end node are the two endpoints of the task arc. If the task edge is assigned to a drone, one pair of take-off and landing point pairs that satisfies the drones’ flight time constraint is stored; all the arcs in a linked task use the same take-off and landing node pair.
The size of the matrix is . The first row stores the nodes that the truck needs to visit. These nodes are obtained from the last two columns of the matrix. The second row stores the identifiers of the tasks. The route of the truck and drones can be uniquely determined by the above two matrices.
4.2. Neighborhood Structure Design
The neighborhood structures designed in this paper are composed of a destroy operator (DO) and a repair operator (RO) in pairs. According to the characteristics of A-VD-ARP, we design a total of 6 destroy operators and 1 repair operator. The destroy operators mainly change the assignment, execution direction, and connection of task arcs, and delete the corresponding nodes in the truck route. And the repair operator is to re-insert the nodes deleted by the destroy operator into the truck route.
The specific operation process of each destroy operator and repair operator will be introduced below, and the schematic diagram will be used for visual representation. In the schematic diagram of all operation changes, the solid/dotted line between two nodes does not represent an edge in the road network but the shortest route between two nodes in the road network (we calculated the shortest path between any two nodes in the road network in advance using the Floyd algorithm). The solid line represents the truck route, the dotted line represents the drones’ routes, and the solid nodes represent the nodes involved in the operation of the selected destroy operator/repair operator.
4.2.1. Destroy Operator
The operations of the destroy operator mainly include randomly selecting a task arc, changing its access direction, the assignment of the task (drone or truck), the pair of take-off and landing nodes, the connection with other arcs, and removing it from the truck route.
- (1)
Change access direction of the task
Randomly select a task arc accessed by the drone. If it is a single task accessed by a drone, delete the take-off and landing node of the task arc from the truck route, and exchange the take-off and landing node pair to change the access direction of the task; if it is a linked task, all tasks in the linked task are reversed, the take-off and landing points of the linked task are exchanged, and then delete the node pair from the truck route, as shown in
Figure 3.
- (2)
Change the take-off and landing point
Randomly select a task performed by a drone (a single task arc or a linked task that contains subtasks), delete the take-off and landing node pair of the selected task in the truck route. Then, randomly re-select a pair of take-off and landing nodes in the set of take-off and landing node pairs of the task, as shown in
Figure 4.
- (3)
Update the truck route
Randomly select a task, if it is a task performed by a drone, delete the take-off and landing nodes of the drone task from the truck route; if it is a task performed by the truck, directly delete the two endpoints of the task from the truck route, as shown in
Figure 5.
- (4)
Change the assignment of a single task
Randomly select a single task arc. If the selected task is performed by a drone, determine whether the task can be assigned to the truck. If so, delete the take-off and landing nodes from the truck route and re-assign the task arc to the truck. If the task arc is accessed by the truck, determine whether the task can be assigned to a drone. If so, randomly select a take-off and landing node pair and delete the two endpoints of task from the truck route, as shown in
Figure 6.
- (5)
Connect drone tasks
Randomly select two drone task arcs that do not belong to the same linked task, then link all arcs in these two drone tasks to form a new linked task; the optimal direction and order of connecting all arcs is computed using the backtracking method. Then, delete the pair of take-off and landing nodes of the selected two tasks in the truck route, as shown in
Figure 7.
- (6)
Destroy and reconnect drone tasks
Randomly select two drone tasks that do not belong to the same linked mission; if there is a linked task in the selected two tasks, break the connection of the linked task, and combine the two selected missions into a new linked mission. The remaining task edges from the original two tasks form one or two new tasks. Select take-off and landing points pairs for all the new tasks. Then delete the pairs of take-off and landing nodes of the original two drone tasks in the truck path, as shown in
Figure 8.
4.2.2. Repair Operator
The operation of the repair operator mainly includes reinserting the task into the truck route after the operation of the destruction operator, as shown in
Figure 9. In this paper, one repair operator is designed: the take-off and landing point pairs (or endpoints of the task arc) generated by the destruction operator are randomly inserted into the truck route.
6. Conclusions
In this paper, we study asymmetric arc routing by coordinating a truck and multiple drones. In this arc routing problem, a truck with multiple drones travels on an asymmetric road network—meaning some arcs of the road network are unidirectional—to perform traffic patrol tasks. The truck must travel along the road network, while the drones are not restricted to the road network. Both the truck and the drones can perform the patrol tasks. To minimize the total patrol time, a large neighborhood search algorithm with simulated annealing (LNS-SA) is proposed. Firstly, we generate the initial solution by a heuristic method. Then, six destroy operators and one repair operator are designed to iteratively optimize the solution. The simulated annealing is integrated to avoid premature convergence.
Extensive experiments were conducted to verify the effectiveness of the proposed method. Compared with other algorithms (i.e., SA, TL, and VNS) on different datasets, the LNS-SA can reduce the total patrol time by at most 7.2%. A sensitivity analysis was performed to analyze the impact of the number of drones and drone speed. As the drone number increased, the total time continued to decrease, but the rate of the descent slowed down and finally stopped decreasing. In addition, the total patrol time decreased slightly with the drone speed increasing due to the scale of the datasets. Moreover, a real case in China Changsha was conducted to verify the effectiveness of the LNS-SA.
In the future, we will further explore the coordinated vehicle-drone arc routing problem in different scenarios. The objective function in this paper only considers the total time, which is not comprehensive enough. In the next stage, we will consider the multi-objective optimization problem under more realistic conditions. We will also attempt to design more efficient operators to solve the problem.