This paper presents a sensitivity analysis in the calibration of two sensors: a laser sensor Velodyne HDL-64E and a panoramic camera Point Grey Ladybug2; both sensors are used for three-dimensional urban reconstruction and were calibrated by two techniques; their results are compared in the sensitivity analysis. The effect of each parameter on the errors propagated in our platform reconstruction was analyzed using the simulated and experimental data sets. To compare the calibration parameters, we implement simulation techniques like Monte Carlo (MC) and Latin hypercube sampling (LHS). The sensitivity index for each parameter was calculated by two methods. The Sobol method, which is based on the analysis of the variance breakdown and the Fourier amplitude sensitivity test (FAST) method, based on Fourier analysis. Measures of variability on the simulated and experimental calibration parameters are shown for the calibration techniques implemented. Results on parameters and factors causing higher uncertainty in the calibration process are presented.
Issue Section:
Technical Brief
References
1.
Saltelli
, A.
, Chan
, K.
, and Scott
, E. M.
, 2000
, Sensitivity Analysis
, Wiley
, New York
.2.
Helton
, J.
, Davis
, F.
, and Johnson
, J.
, 2005
, “A Comparison of Uncertainty and Sensitivity Analysis Results Obtained With Random and Latin Hypercube Sampling
,” Reliab. Eng. Syst. Saf.
, 89
(3
), pp. 305
–330
.3.
Cacuci
, D. G.
, Ionescu-Bujor
, M.
, and Navon
, I. M.
, 2005
, Sensitivity and Uncertainty Analysis: Applications to Large-Scale systems
, Vol. 2
, CRC Press
, Boca Raton, FL.4.
Saltelli
, A.
, Tarantola
, S.
, Campolongo
, F.
, and Ratto
, M.
, 2004
, Sensitivity Analysis in Practice—A Guide to Assessing Scientific Models
, Wiley
, Hoboken, NJ.5.
Raymond
, H. M.
, 1999
, “Response Surface Methodology—Current Status and Future Directions
,” J. Qual. Technol.
, 31
(1
), pp. 30
–44
, http://asq.org/qic/display-item/index.html?item=115636.
Lilburne
, L.
, and Tarantola
, S.
, 2009
, “Sensitivity Analysis of Spatial Models
,” Int. J. Geogr. Inf. Sci.
, 23
(2
), pp. 151
–168
.7.
Martinelli
, A.
, 2012
, “Vision and IMU Data Fusion: Closed-Form Solutions for Attitude, Speed, Absolute Scale, and Bias Determination
,” IEEE Trans. Rob.
, 28
(1
), pp. 44
–60
.8.
Wijnholds
, S. J.
, and Van Der Veen
, A.-J.
, 2009
, “Multisource Self-Calibration for Sensor Arrays
,” IEEE Trans. Sig. Process.
, 57
(9
), pp. 3512
–3522
.9.
Doucet
, A.
, Godsill
, S.
, and Andrieu
, C.
, 2000
, “On Sequential Monte Carlo Sampling Methods for Bayesian Filtering
,” Stat. Comput.
, 10
(3
), pp. 197
–208
.10.
Pilger
, G. G.
, Costa
, J. F. C.
, and Koppe
, J. C.
, 2005
, “Improving the Efficiency of the Sequential Simulation Algorithm Using Latin Hypercube Sampling
,” Geostatistics Banff 2004
, Springer
, The Netherlands.11.
Cropp
, R. A.
, and Braddock
, R. D.
, 2002
, “The New Morris Method: An Efficient Second-Order Screening Method
,” Reliab. Eng. Syst. Saf.
, 78
(1
), pp. 77
–83
.12.
Wallach
, D.
, Makowski
, D.
, and Jones
, J. W.
, 2006
, Working With Dynamic Crop Models: Evaluation, Analysis, Parameterization, and Applications
, Elsevier, Amsterdam.13.
Saltelli
, A.
, Annoni
, P.
, Azzini
, I.
, Campolongo
, F.
, Ratto
, M.
, and Tarantola
, S.
, 2010
, “Variance Based Sensitivity Analysis of Model Output. Design and Estimator for the Total Sensitivity Index
,” Comput. Phys. Commun.
, 181
(2
), pp. 259
–270
.14.
Atanacio-Jiménez
, G.
, González-Barbosa
, J.-J.
, Hurtado-Ramos
, J. B.
, Ornelas-Rodríguez
, F. J.
, Jiménez-Hernández
, H.
, García-Ramirez
, T.
, and González-Barbosa
, R.
, 2011
, “Lidar Velodyne HDL-64e Calibration Using Pattern Planes
,” Int. J. Adv. Rob. Syst.
, 8
(5
), pp. 70
–82
.15.
Tsai
, R. Y.
, 1987
, “A Versatile Camera Calibration Technique for High-Accuracy 3D Machine Vision Metrology Using Off-The-Shelf Tv Cameras and Lenses
,” IEEE J. Rob. Autom.
, 3
(4
), pp. 323
–344
.16.
Zhang
, Z.
, 2000
, “A Flexible New Technique for Camera Calibration
,” IEEE Trans. Pattern Anal. Mach. Intell.
, 22
(11
), pp. 1330
–1334
.17.
García-Moreno
, A.-I.
, Gonzalez-Barbosa
, J.-J.
, Ornelas-Rodriguez
, F.-J.
, Hurtado-Ramos
, J. B.
, and Primo-Fuentes
, M.-N.
, 2013
, “Lidar and Panoramic Camera Extrinsic Calibration Approach Using a Pattern Plane
,” Pattern Recognition
, Springer, Berlin.18.
Guides in Metrology
, 2008
, Evaluation of Measurement Data—Guide to the Expression of Uncertainty in Measurement
, Bureau International des Poids et Mesures
, Geneève: International Organization for Standardization.19.
Archer
, G.
, Saltelli
, A.
, and Sobol
, I.
, 1997
, “Sensitivity Measures, Anova-Like Techniques and the Use of Bootstrap
,” J. Stat. Comput. Simul.
, 58
(2
), pp. 99
–120
.20.
Cannavó
, F.
, 2012
, “Sensitivity Analysis for Volcanic Source Modeling Quality Assessment and Model Selection
,” Comput. Geosci.
, 44
, pp. 52
–59
.21.
Sen
, S. K.
, Samanta
, T.
, and Reese
, A.
, 2006
, “Quasi-Versus Pseudo-Random Generators: Discrepancy, Complexity and Integration-Error Based Comparison
,” Int. J. Innovative Comput., Inf. Control
, 2
(3
), pp. 621
–651
, http://www.ijicic.org/vol-2(3).htm22.
Sobol’
, I.
, 1967
, “On the Distribution of Points in a Cube and the Approximate Evaluation of Integrals
,” {USSR} Comput. Math. Math. Phys.
, 7
(4
), pp. 86
–112
.23.
Halton
, J. H.
, 1964
, “Algorithm 247: Radical-Inverse Quasi-Random Point Sequence
,” Commun. ACM
, 7
(12
), pp. 701
–702
.24.
Helton
, J. C.
, and Davis
, F. J.
, 2003
, “Latin Hypercube Sampling and the Propagation of Uncertainty in Analyses of Complex Systems
,” Reliab. Eng. Syst. Saf.
, 81
(1
), pp. 23
–69
.25.
Conover
, W. J.
, and Iman
, R. L.
, 1981
, “Rank Transformations as a Bridge Between Parametric and Nonparametric Statistics
,” Am. Stat.
, 35
(3
), pp. 124
–129
.26.
García-Moreno
, A.-I.
, Hernandez-García
, D.-E.
, Gonzalez-Barbosa
, J.-J.
, Ramírez-Pedraza
, A.
, Hurtado-Ramos
, J. B.
, and Ornelas-Rodriguez
, F.-J.
, 2014
, “Error Propagation and Uncertainty Analysis Between 3D Laser Scanner and Camera
,” Rob. Auton. Syst.
, 62
(6
), pp. 782
–793
.27.
Sun
, W.
, and Cooperstock
, J. R.
, 2006
, “An Empirical Evaluation of Factors Influencing Camera Calibration Accuracy Using Three Publicly Available Techniques
,” Mach. Vision Appl.
, 17
(1
), pp. 51
–67
.Copyright © 2016 by ASME
You do not currently have access to this content.
