Abstract
The recent advances in the field of embedded hardware and computer vision have made autonomous vehicles a tangible reality. The primary requirement of such an autonomous vehicle is an intelligent system that can process sensor inputs such as camera or lidar to have a perception of the surroundings. The vision algorithms are the core of a camera-based Advanced Driver Assistance Systems (ADAS). However, most of the available vision algorithms are x86 architecture based and hence, they cannot be directly ported to embedded platforms. Texas Instrument’s (TI) embedded platforms provide Block Accelerator Manager (BAM) framework for porting vision algorithms on embedded hardware. However, the BAM framework has notable drawbacks which result in higher stack usage, execution time and redundant code-base. We propose a novel lightweight framework for TI embedded platforms which addresses the current drawbacks of the BAM framework. We achieve an average reduction of 15.2% in execution time and 90% reduction in stack usage compared to the BAM framework.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Computer Vision Hardware and Software Market to Reach \$48.6 Billion by 2022 (2016). https://www.tractica.com/newsroom/press-releases/computer-vision-hardware-and-software-market-to-reach-48-6-billion-by-2022/
Global Automotive Camera-based ADAS Market 2018–2022 (2018). https://www.researchandmarkets.com/reports/4516968/global-automotive-camera-based-adas-market-2018
Gonzales-Conde Perez, J.L.: Analysis of Task Scheduling for Multi-Core Embedded Systems (2013)
Gostovic, M., Pranjkic, M., Kocic, O., Maruna, T.: Experience from porting complex algorithms on heterogeneous multi-core systems. In: IEEE 7th International Conference on Consumer Electronics-Berlin (ICCE-Berlin), pp. 235–238 (2017)
Hsiao, P.Y., Yeh, C.W.: A portable real-time lane departure warning system based on embedded calculating technique. In: IEEE 63rd Vehicular Technology Conference, VTC, vol. 6, pp. 2982–2986 (2006)
Jeng, M.J., Guo, C.Y., Shiau, B.C., Chang, L.B., Hsiao, P.Y.: Lane detection system based on software and hardware codesign. In: 4th International Conference on Autonomous Robots and Agents, ICARA, pp. 319–323. IEEE (2009)
Kisacanin, B., Bhattacharyya, S.S., Chai, S.: Embedded Computer Vision. Springer, Heidelberg (2008)
Kocić, O., Simić, A., Bjelica, M.Z., Maruna, T.: Optimization of driver monitoring ADAS algorithm for heterogeneous platform. In: 24th Telecommunications Forum (TELFOR), pp. 1–4. IEEE (2016)
Maghazeh, A., Bordoloi, U.D., Eles, P., Peng, Z.: General Purpose Computing on Low-Power Embedded GPUs: Has it Come of Age? (2013)
Nieto, M., Vélez, G., Otaegui, O., Gaines, S., Van Cutsem, G.: Optimising computer vision based ADAS: vehicle detection case study. IET Intell. Transport Syst. 10(3), 157–164 (2016)
Nikolic, Z., Agarwal, G., Williams, B., Pearson, S.: Ti Gives Sight to Vision-enabled Automotive Technologies. Texas Instruments, Technical report (2013)
Poudel, P., Shirvaikar, M.: Optimization of computer vision algorithms for real time platforms. In: 42nd Southeastern Symposium on System Theory (SSST), pp. 51–55. IEEE (2010)
Sankaran, J., Hung, C.Y., Kisačanin, B.: EVE: a flexible SIMD coprocessor for embedded vision applications. J. Signal Process. Syst. 75(2), 95–107 (2014)
Stein, G.P., Rushinek, E., Hayun, G., Shashua, A.: A computer vision system on a chip: a case study from the automotive domain. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops, CVPR, p. 130 (2005)
TI: KeyStone Architecture Enhanced Direct Memory Access (EDMA3) Controller (2015). http://www.ti.com/lit/ug/sprugs5b/sprugs5b.pdf
TI: BAM Algorithm Framework User Guide (2019). http://www.ti.com/tool/processor-sdk-tdax. Linux and RTOS Processor SDK for Vision V3.06.00
Torud, S.: A Technical Overview of eXpressDSP-Compliant Algorithms for DSP Software Producers (2002). http://www.ti.com/lit/an/spra579c/spra579c.pdf
Velez, G., Cortés, A., Nieto, M., Vélez, I., Otaegui, O.: A reconfigurable embedded vision system for advanced driver assistance. J. Real-Time Image Proc. 10(4), 725–739 (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 IFIP International Federation for Information Processing
About this paper
Cite this paper
Ashish, A., Lal, S., Juurlink, B. (2023). An Efficient Lightweight Framework for Porting Vision Algorithms on Embedded SoCs. In: Wehrmeister, M.A., Kreutz, M., Götz, M., Henkler, S., Pimentel, A.D., Rettberg, A. (eds) Analysis, Estimations, and Applications of Embedded Systems. IESS 2019. IFIP Advances in Information and Communication Technology, vol 576. Springer, Cham. https://doi.org/10.1007/978-3-031-26500-6_11
Download citation
DOI: https://doi.org/10.1007/978-3-031-26500-6_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-26499-3
Online ISBN: 978-3-031-26500-6
eBook Packages: Computer ScienceComputer Science (R0)