Abstract
This paper presents a novel bilateral shared framework for a cooperative aerial transportation and manipulation system composed by a team of micro aerial vehicles with a cable-suspended payload. The human operator is in charge of steering the payload and he/she can also change online the desired shape of the formation of robots. At the same time, an obstacle avoidance algorithm is in charge of avoiding collisions with the static environment. The signals from the user and from the obstacle avoidance are blended together in the trajectory generation module, by means of a tracking controller and a filter called dynamic input boundary (DIB). The DIB filters out the directions of motions that would bring the system too close to singularities, according to a suitable metric. The loop with the user is finally closed with a force feedback that is informative of the mismatch between the operator’s commands and the trajectory of the payload. This feedback intuitively increases the user’s awareness of obstacles or configurations of the system that are close to singularities. The proposed framework is validated by means of realistic hardware-in-the-loop simulations with a person operating the system via a force-feedback haptic interface.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Notes
If the required set of wrenches contains a neighborhood of the origin, the wrench matrix \(J_{\mathcal {R}}^{T} N\) has full rank [19]
References
Bedoustani, Y.B., Bigras, P., Taghirad, H.D., Bonev, I.A.: Lagrangian dynamics of cable-driven parallel manipulators: A variable mass formulation. Trans. Can. Soc. Mech. Eng. 35(4), 529–542 (2011)
Bernard, M., Kondak, K., Maza, I., Ollero, A.: Autonomous transportation and deployment with aerial robots for search and rescue missions. J. Field Robot. 28(6), 914–931 (2011)
Biagiotti, L., Melchiorri, C., Moriello, L.: Optimal trajectories for vibration reduction based on exponential filters. IEEE Trans. Contr. Syst. Technol 24(2), 609–622 (2016)
Bosscher, P., Ebert-Uphoff, I.: Wrench-based analysis of cable-driven robots. In: 2004 IEEE Int. Conf. on Robotics and Automation, vol. 5, pp. 4950–4955 (2004)
Dang, K.: Simulate quadrotor in simulink with simmechanics. https://www.mathworks.com/matlabcentral/fileexchange/48052-simulate-quadrotor-in-simulink-with-simmechanics (2021)
Dietrich, F., Marzat, J., Sanfourche, M., Bertrand, S., Bernard-Brunel, A., Eudes, A.: MAV tele-operation constrained on virtual surfaces for inspection of infrastructures. In: 2020 25th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), vol. 1, pp. 1519–1525. https://doi.org/10.1109/ETFA46521.2020.9212046 (2020)
Erskine, J., Chriette, A., Caro, S.: Wrench capability analysis of aerial cable towed systems. In: 42nd Mechanisms and Robotics Conference, International Design Engineering Technical Conferences and Computers and Information in Engineering Conference. https://doi.org/10.1115/DETC2018-85378 (2018)
Erskine, J., Chriette, A., Caro, S.: Control and configuration planning of an aerial cable towed system. In: 2019 International Conference on Robotics and Automation (ICRA), pp. 6440–6446 (2019)
Erskine, J., Chriette, A., Caro, S.: Wrench analysis of cable-suspended parallel robots actuated by quadrotor unmanned aerial vehicles. J. Mech. Robot. 11 (2), 020909–1–020909-12 (2019). https://doi.org/10.1115/1.4042513
Featherstone, R.: Rigid Body Dynamics Algorithms. Springer-Verlag New York, Inc, Secaucus (2007)
Fink, J., Michael, N., Kim, S., Kumar, V.: Planning and control for cooperative manipulation and transportation with aerial robots. Int. J. Robot. Res. 30(3), 324–334 (2011)
Franchi, A.: Human-Collaborative Schemes in the Motion Control of Single and Multiple Mobile Robots, pp 01–324. Springer, Berlin (2017)
Franchi, A., Masone, C., Grabe, V., Ryll, M., Bülthoff, H.H., Robuffo Giordano, P.: Modeling and control of uav bearing formations with bilateral high-level steering. Int. J. Robot. Res. 31(12), 1504–1525 (2012). https://doi.org/10.1177/0278364912462493
Franchi, A., Robuffo Giordano, P., Secchi, C., Son, H.I., Bülthoff, H.H.: A passivity-based decentralized approach for the bilateral teleoperation of a group of UAVs with switching topology. In: 2011 IEEE International Conference on Robotics and Automation, pp. 898–905, https://doi.org/10.1109/ICRA.2011.5980368 (2011)
Gabellieri, C., Tognon, M., Pallottino, L., Franchi, A.: A study on force-based collaboration in flying swarms. In: Birattari, M.D.M., Blum, C., Christensen, A.L., Reina, A., Trianni, V. (eds.) Swarm Intelligence, pp 3–15. Springer International Publishing, Cham (2018)
Gioioso, G., Franchi, A., Salvietti, G., Scheggi, S., Prattichizzo, D.: The flying hand: A formation of UAVs for cooperative aerial tele-manipulation. In: 2014 IEEE Int. Conf. on Robotics and Automation, pp. 4335–4341 (2014)
Gohl, P., Honegger, D., Omari, S., Achtelik, M., Pollefeys, M., Siegwart, R.: Omnidirectional visual obstacle detection using embedded fpga. In: 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp 3938–3943 (2015)
Gosselin, C., Grenier, M.: On the determination of the force distribution in overconstrained cable-driven parallel mechanisms. Meccanica 46(1), 3–15 (2011)
Gouttefarde, M., Daney, D., Merlet, J.: Interval-analysis-based determination of the wrench-feasible workspace of parallel cable-driven robots. IEEE Trans. Robot. 27(1), 1–13 (2011)
Hou, X., Mahony, R.: Dynamic kinesthetic boundary for haptic teleoperation of VTOL aerial robots in complex environments. IEEE Trans. Syst. Man Cybern. 46(5), 694–705 (2016)
Jiang, J., Astolfi, A.: Shared-control for a uav operating in the 3d space. In: 2015 European Control Conference (ECC), pp. 1633–1638 (2015)
Jimenez-Cano, A.E., Martin, J., Heredia, G., Ollero, A., Cano, R.: Control of an aerial robot with multi-link arm for assembly tasks. In: 2013 IEEE Int. Conf. on Robotics and Automation, pp. 4916–4921 (2013)
Kondak, K., Huber, F., Schwarzbach, M., Laiacker, M., Sommer, D., Bejar, M., Ollero, A.: Aerial manipulation robot composed of an autonomous helicopter and a 7 degrees of freedom industrial manipulator. In: 2014 IEEE Int. Conf. on Robotics and Automation, pp. 2107–2112 (2014)
Lamaury, J., Gouttefarde, M.: Control of a large redundantly actuated cable-suspended parallel robot. In: 2013 IEEE Int. Conf. on Robotics and Automation, pp. 4659–4664 (2013)
Lamaury, J., Gouttefarde, M., Chemori, A., Herve, P.E.: Dual-space adaptive control of redundantly actuated cable-driven parallel robots. In: 2013 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, pp. 4879–4886 (2013)
Lee, D., Franchi, A., Son, H.I., Bülthoff, H.H., Robuffo Giordano, P.: Semi-autonomous haptic teleoperation control architecture of multiple unmanned aerial vehicles. IEEE/ASME Trans. Mechatronics, Focused Section on Aerospace Mechatronics 18(4), 1334–1345 (2013)
Lee, D.J., Huang, K.: Passive-set-position-modulation framework for interactive robotic systems. IEEE Trans. Robot. 26(2), 354–369 (2010)
Lee, H., Kim, H., Kim, H.J.: Path planning and control of multiple aerial manipulators for a cooperative transportation. In: 2015 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, pp. 2386–2391 (2015)
Lee, T.: Geometric control of quadrotor uavs transporting a cable-suspended rigid body. IEEE Trans. Control Syst. Technol. 26(1), 255–264 (2018)
Li, Z., Erskine, J., Caro, S., Chriette, A.: Design and control of a variable aerial cable towed system. IEEE Robot. Autom. Lett. 5(2), 636–643 (2020). https://doi.org/10.1109/LRA.2020.2964165
Lo Bianco, C.G., Ghilardelli, F.: A discrete-time filter for the generation of signals with asymmetric and variable bounds on velocity, acceleration, and jerk. IEEE Trans. Ind. Electron. 61(8), 4115–4125 (2014)
Loianno, G., Kumar, V.: Cooperative transportation using small quadrotors using monocular vision and inertial sensing. IEEE Robot. Autom. Lett. 3(2), 680–687 (2018)
Manubens, M., Devaurs, D., Ros, L., Cortés, J.: Motion planning for 6-D manipulation with aerial towed-cable systems. In: Robotics: Science and Systems. Berlin, Germany (2013)
D. Marina, H.G., Smeur, E.: Flexible collaborative transportation by a team of rotorcraft. In: 2019 International Conference on Robotics and Automation (ICRA), pp. 1074–1080 (2019)
Masone, C., Bülthoff, H.H., Stegagno, P.: Cooperative transportation of a payload using quadrotors: a reconfigurable cable-driven parallel robot. In: 2016 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (2016)
Masone, C., Mohammadi, M., Robuffo Giordano, P., Franchi, A.: Shared planning and control for mobile robots with integral haptic feedback. Int. J. Robot. Res. 37(11), 1395–1420 (2018). https://doi.org/10.1177/0278364918802006
Maza, I., Kondak, K., Bernard, M., Ollero, A.: Multi-UAV cooperation and control for load transportation and deployment. J. Intell. Robot. Syst. 57(1-4), 417–449 (2010)
Mellinger, D., Shomin, M., Michael, N., Kumar, V.: Distributed autonomous robotic systems: The 10th international symposium, chap. In: Cooperative Grasping and Transport Using Multiple Quadrotors, pp. 545–558. Springer Berlin Heidelberg, Berlin, Heidelberg (2013)
Mendoza-Mendoza, J., Gonzalez-Villela, V.J., Aguilar-Ibañez, C., Suarez-Castañon, M.S., Fonseca-Ruiz, L.: Snake aerial manipulators: A review. IEEE Access 8, 28222–28241 (2020)
Mendoza-Mendoza, J., Sepulveda-Cervantes, G., Aguilar-Ibanez, C., Mendez, M., Reyes-Larios, M., Matabuena, P., Gonzalez-Avila, J.: Air-arm: A new kind of flying manipulator. In: 2015 Workshop on Research, Education and Development of Unmanned Aerial Systems (RED-UAS), pp 278–287 (2015)
Meng, X., He, Y., Han, J.: Survey on aerial manipulator: System, modeling, and control. Robotica 38(7), 1288–131 (2019). https://doi.org/10.1017/S0263574719001450
Mersha, A.Y., Stramigioli, S., Carloni, R.: On bilateral teleoperation of aerial robots. IEEE Trans. Robot. 30(1), 258–274 (2014). https://doi.org/10.1109/TRO.2013.2281563
Michael, N., Fink, J., Kumar, V.: Cooperative manipulation and transportation with aerial robots. Auton. Robot. 30(1), 73–86 (2011)
Michael, N., Kim, S., Fink, J., Kumar, V.: Kinematics and statics of cooperative multi-robot aerial manipulation with cables. In: ASME Int. Design Engineering Technical Conf (2009)
Miermeister, P., Pott, A.: Modelling and real-time dynamic simulation of the cable-driven parallel robot IPAnema. In: Pisla, D., Ceccarelli, M., Husty, M.M., Corves, B. (eds.) New Trends in Mechanism Science, Mechanisms and Machine Science, vol. 5, pp 353–360. Springer, Netherlands (2010)
Mikelsons, L., Bruckmann, T., Hiller, M., Schramm, D.: A real-time capable force calculation algorithm for redundant tendon-based parallel manipulators. In: 2008 IEEE Int. Conf. on Robotics and Automation, pp. 3869–3874 (2008)
Mohammadi, M., Franchi, A., Barcelli, D., Prattichizzo, D.: Cooperative aerial tele-manipulation with haptic feedback. In: 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 5092–5098 (2016)
Mostafa, S.A., Ahmad, M.S., Mustapha, A.: Adjustable autonomy: a systematic literature review. Artif. Intell. Rev. 51(2), 149–186 (2019)
Odelga, M., Stegagno, P., Bülthoff, H.H.: Obstacle detection, tracking and avoidance for a teleoperated uav. In: 2016 IEEE International Conference on Robotics and Automation (ICRA), pp. 2984–2990 (2016)
Orsag, M., Korpela, C., Oh, P., Bogdan, S.: Aerial Manipulation, Springer (2018)
Prajapati, P., Parekh, S., Vashista, V.: On the human control of a multiple quadcopters with a cable-suspended payload system. In: 2020 IEEE International Conference on Robotics and Automation (ICRA), pp. 2253–2258. https://doi.org/10.1109/ICRA40945.2020.9197279 (2020)
Rossi, E., Tognon, M., Carli, R., Schenato, L., Cortés, J., Franchi, A.: Cooperative aerial load transportation via sampled communication. IEEE Control Syst. Lett. 4(2), 277–282 (2020)
Rossomando, F., Rosales, C., Gimenes, J., Salinas, L., Soria, C., Sarcinelli-Filho, M., Carelli, R.: Aerial load transportation with multiple quadrotors based on a kinematic controller and a neural smc dynamic compensation. J. Intell. Robot. Syst. (2020)
Ruggiero, F., Lippiello, V., Ollero, A.: Aerial manipulation: A literature review. IEEE Robot. Autom. Lett. 3(3), 1957–1964 (2018)
Ruggiero, F., Trujillo, M.A., Cano, R., Ascorbe, H., Viguria, A., Perez, C., Lippiello, V., Ollero, A., Siciliano, B.: A multilayer control for multirotor uavs equipped with a servo robot arm. In: 2015 IEEE Int. Conf. on Robotics and Automation, pp. 4014–4020 (2015)
Sanalitro, D., Savino, H.J., Tognon, M., Cortés, J., Franchi, A.: Full-pose manipulation control of a cable-suspended load with multiple uavs under uncertainties. IEEE Robot. Autom. Lett. 5(2), 2185–2191 (2020)
Secchi, C., Franchi, A., Bülthoff, H. H., Giordano, P.R.: Bilateral teleoperation of a group of UAVs with communication delays and switching topology. In: 2012 IEEE International Conference on Robotics and Automation, pp. 4307–4314. https://doi.org/10.1109/ICRA.2012.6225304 (2012)
Siciliano, B., Sciavicco, L., Villani, L., Oriolo, G.: Robotics - Modelling, Planning and control. Springer-Verlag, London (2009)
Skorobogatov, G., Barrado, C., Salamí, E.: Multiple UAV systems: A survey. Unmanned Syst. 08(02), 149–169 (2020)
Sreenath, K., Kumar, V.: Dynamics, control and planning for cooperative manipulation of payloads suspended by cables from multiple quadrotor robots. In: Robotics: Science and Systems (2013)
Stegagno, P., Basile, M., Bülthoff, H. H., Franchi, A.: A semi-autonomous UAV platform for indoor remote operation with visual and haptic feedback. In: 2014 IEEE International Conference on Robotics and Automation (ICRA), pp. 3862–3869. https://doi.org/10.1109/ICRA.2014.6907419 (2014)
Tagliabue, A., Kamel, M., Verling, S., Siegwart, R., Nieto, J.: Collaborative transportation using mavs via passive force control. In: 2017 IEEE International Conference on Robotics and Automation (ICRA), pp. 5766–5773 (2017)
Tognon, M., Gabellieri, C., Pallottino, L., Franchi, A.: Aerial co-manipulation with cables: The role of internal force for equilibria, stability, and passivity. IEEE Robot. Autom. Lett. 3(3), 2577–2583 (2018)
Yang, H., Lee, D.: Hierarchical cooperative control framework of multiple quadrotor-manipulator systems. In: 2015 IEEE Int. Conf. on Robotics and Automation, pp. 4656–4662 (2015)
Acknowledgements
We thank Prof. H. H. Bülthoff, Max Planck Institute for Biological Cybernetics, Germany for contribution to the financial support of this work.
This work was supported in part by the H2020 European Research Council under Grant 637076 (project RoboExNovo).
Funding
Open access funding provided by Istituto Italiano di Tecnologia within the CRUI-CARE Agreement.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interests
The authors declare that they have no conflict of interest.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Below is the link to the electronic supplementary material.
(MP4 19.8 MB)
Appendices
Appendix A: Input Shaping
Many applications generally require a robot, be it a manipulator or an autonomous mobile vehicle, to track a certain trajectory. In most cases this reference trajectory is not known a priori but it is generated online from a discontinuous input such as a sequence of waypoints. The transformation from the input to a smooth enough trajectory is achieved using a variety of filters or input shaping methods [3, 31]. The aim of all these approaches is not only to approximate the input signals with smooth functions but also to guarantee that the output trajectory complies with the constraints imposed by the robot, e.g. velocity and acceleration limits.
The practical solution used in our framework to achieve this goal consists of a combination of low-pass filters together with a controller that ensures tracking of the input signals subordinate to the constraints (see general architecture in Fig. 21). The smoothing is realized by a double low-pass filter to produce a \(\mathcal {C}^{2}\) signal denoted by the subscript ∙LP. The tracking is achieved by two different designs, one for the DIB output and one for the input \({\!}^{P}\dot {\eta }_{hmn}\) (see Fig. 5). The difference in the two designs is that the first only imposes limits on the maximum velocity and acceleration of the reference trajectory whereas the second also imposes limits on the range.
Consider first the DIB filtering, restricting our discussion to the translational for the sake of simplicity. The tracking controller is defined as
where kr > 0 and sat(∙) is a function that imposes the limits
From a practical point of view, Eq. 48 is implemented on a computer with a fixed discrete sample time T. Using the Euler forward method \(\dot {\boldsymbol {p}}_{ref}(k+1) = \dot {\boldsymbol {p}}_{ref}(k) + T\ddot {\boldsymbol {p}}_{ref}(k)\) the velocity constraint is easily transformed into an acceleration constraint
where \({\boldsymbol {v}}(k) = \frac {\ddot {\boldsymbol {p}}_{LP} + k_{r} (\dot {\boldsymbol {p}}_{LP} - \dot {\boldsymbol {p}}_{ref})}{\|\ddot {\boldsymbol {p}}_{LP} + k_{r} (\dot {\boldsymbol {p}}_{LP} - \dot {\boldsymbol {p}}_{ref})\|}\) is the direction of the unsaturated command Eq. 48.
In regards to \({\!}^{P}\dot \eta _{LP}\), the controller must additionally satisfy a limit on the maximum angle, i.e. \({\!}^{P}\eta _{min}\leq {\!}^{P}\eta _{des} \leq {\!}^{P}\eta _{max}\). For this purpose, a standard bang-bang strategy is used, i.e.
where kη > 0 and sat(∙) is a function that imposes the limits
Appendix B: Tension Distribution
The problem of tension distribution, i.e., solving Eq. 36 when m > n, does not have a unique solution. Rather, if the wrench matrix has full rankFootnote 1, the solution to Eq. 36 lies in the m − n dimensional null space of the wrench matrix \(J_{\mathcal {R}}^{T} N\). In view of this property of the solution manifold, the general solution Eq. 36 can be expressed in the form
where tp is a particular solution of Eq. 36 and th is the homogeneous solution, i.e., a vector that belongs to the null space of the wrench matrix. This decomposition can be used to reformulate the optimization problem Eqs. 38 to 42. Consider the general solution of the problem expressed in the following form
where (⋅)‡ indicates the pseudo-inverse, \(Q \in {\mathbb {R}}^{m\times m-n}\) is a matrix whose column form a basis of the null space of the wrench matrix, and \({\boldsymbol {\lambda }}\in {\mathbb {R}}^{m-n}\) is a vector of coordinates that indicates how we move on the manifold of the solution starting from tp. It is important to observe that the particular solution obtained with the pseudo-inverse is the one with the minimum Euclidean norm, however it may not be feasible because it does not necessarily verifies the constraint on the cable tensions. Nevertheless, by imposing that t has the structure Eq. 50, we can rewrite the optimization problem Eq. 38 to 42 as
where
The main advantage of this reformulation of the optimization problem is that the dimension of the search space is decreased to m − n. Given the solution λ⋆ of Eq. 39, the optimal cable tension is simply \({\boldsymbol {t}}_{r}^{\star } = \left (J_{\mathcal {R}}^{T} N\right )^{\dagger } {\boldsymbol {w}}_{r} + N{\boldsymbol {\lambda }}^{\star }\). In the simulations presented in Section 5 we solve the tension distribution problem using the reduced formulation Eqs. 51 and 53. In particular we impose Lagrange optimality conditions which, being the problem convex, ensure that a candidate point is a global minima.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Masone, C., Stegagno, P. Shared Control of an Aerial Cooperative Transportation System with a Cable-suspended Payload. J Intell Robot Syst 103, 40 (2021). https://doi.org/10.1007/s10846-021-01457-4
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10846-021-01457-4