Recent Advances in mmWave-Radar-Based Sensing, Its Applications, and Machine Learning Techniques: A Review
Next Article in Journal
LagunAR: A City-Scale Mobile Outdoor Augmented Reality Application for Heritage Dissemination
Previous Article in Journal
Anomaly Detection in the Production Process of Stamping Progressive Dies Using the Shape- and Size-Adaptive Descriptors
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Recent Advances in mmWave-Radar-Based Sensing, Its Applications, and Machine Learning Techniques: A Review

by
A. Soumya
1,
C. Krishna Mohan
1 and
Linga Reddy Cenkeramaddi
2,*
1
Department of Computer Science Engineering, Indian Institute of Technology, Hyderabad 502285, India
2
Department of Information and Communication Technology, University of Agder, 4879 Grimstad, Norway
*
Author to whom correspondence should be addressed.
Sensors 2023, 23(21), 8901; https://doi.org/10.3390/s23218901
Submission received: 25 August 2023 / Revised: 6 October 2023 / Accepted: 21 October 2023 / Published: 1 November 2023

Abstract

:
Human gesture detection, obstacle detection, collision avoidance, parking aids, automotive driving, medical, meteorological, industrial, agriculture, defense, space, and other relevant fields have all benefited from recent advancements in mmWave radar sensor technology. A mmWave radar has several advantages that set it apart from other types of sensors. A mmWave radar can operate in bright, dazzling, or no-light conditions. A mmWave radar has better antenna miniaturization than other traditional radars, and it has better range resolution. However, as more data sets have been made available, there has been a significant increase in the potential for incorporating radar data into different machine learning methods for various applications. This review focuses on key performance metrics in mmWave-radar-based sensing, detailed applications, and machine learning techniques used with mmWave radar for a variety of tasks. This article starts out with a discussion of the various working bands of mmWave radars, then moves on to various types of mmWave radars and their key specifications, mmWave radar data interpretation, vast applications in various domains, and, in the end, a discussion of machine learning algorithms applied with radar data for various applications. Our review serves as a practical reference for beginners developing mmWave-radar-based applications by utilizing machine learning techniques.

1. Introduction

The development of millimeter wave (mmWave) radar sensors during the past ten years has been spurred on by numerous research applications, including civilian and non-civilian applications [1,2]. With the latest improvements in chip technology and lowered cost, the mmWave radar sensor has gained widespread popularity in a wide range of applications. The mmWave radar system includes a transmitting antenna, a receiving antenna, and a signal processing system to determine an object’s dynamic information, such as range, velocity, and angle of arrival (AoA). The mmWave radar transmits a mmWave signal into space by striking an object, and this signal gets reflected. The receiving antenna captures the echo signal, which is then mixed with a transmitting signal to obtain an intermediate-frequency (IF) signal. This IF signal is processed to obtain object information. Various mmWave radars and working bands are shown in Table 1. mmWave radars operate in the frequency range between 24 GHz and 300 GHz. Processing IF signals allow for the measurement of an object’s range, velocity, and angle of arrival (AoA) [3].
The performance of signal processing is continually being improved along with hardware components. The performance of mmWave-radar-based sensing is entirely based on detecting mmWaves reflected by objects and subsequent signal processing. The performance of the mmwave radar is independent of external lighting conditions and works well even in low-light conditions and dazzling light. mmWave radar sensors are now widely used in a variety of civilian applications, including obstacle detection, motion recognition, localization, and tracking, owing to low-cost chip technology and improved reliability [4]. As a result, these improvements in radar technology and digital signal processing lead to good accuracy in range and velocity estimation and better resolution in contrast with other traditional radars. In addition to the benefits listed above, mmWave radar has superior penetration capacity through various weather conditions like rain, fog, and snow.
Today’s radar-based sensing is more diverse. Applications range from civilian to military and include a variety of automotive, industrial, and medical applications. Research in the field is being refined as a result of technological advancements and more accurate detection. To perceive the surrounding environment, mmWave radar sensors can easily be integrated with other imaging sensors. Multi-sensor fusion effectively uses data from multiple sensors to augment one another and improves the ability to extract detailed information about targets under a variety of environmental and climatic conditions [3]. The mmWave radar is more often used in various applications when compared to other sensors, such as RGB cameras, ultrasonic sensors, infrared sensors, and light detection and ranging (LiDAR). Various applications demand the fusion of one or two sensors along with mmWave radar [5].
The advantages mentioned above have increased the use and popularity of mmWave radars. This article focuses on different state-of-the-art mmWave radars with key technical specifications. The main focus of our study is on state-of-the-art mmWave radars, their key performance metrics along with suitable applications, key measurements and their interpretation, mmWave radar frequency selection criteria based on specifications and application requirements, and machine learning techniques for mmWave-radar-based sensing. Our review stands out as unique from other reviews due to its application focus on the use of machine learning methods and provides a quick review of mmWave radar models with specifications. The main significant aspects of this paper are highlighted in Table 2, presenting how it differs from earlier surveys.
The remainder of this article is organized as follows: Section 2 focuses on the performance metrics of mmWave radar sensing. Section 3 presents the measurements and interpretation of the mmWave radar sensor. Various mmWave-radar-based applications and machine learning techniques are focused on in Section 4. Finally, Section 5 concludes the article.

2. Performance Metrics in mmWave-Radar-Based Sensing

Currently, mmWave radars have become ubiquitous, with a wide variety of applications. The types of components in mmWave radars are shown in Figure 1. The synthesizer generates the chirp, the transmitter transmits this chirp signal, the transmitted chirp is reflected off the objects in front of the radar, and the reflected signal is received via the receiver antenna. The RX signal and TX signal are mixed to generate the resultant IF signal. By processing the IF signal, all the key parameters can be estimated. When multiple objects are in front of the radar, one Tx chirp generates multiple reflected chirps from different objects, and the IF signal will have multiple tones corresponding to each of the reflections. The purpose of the analog-to-digital converter (ADC) is to digitize the IF signal. Fast Fourier transform (FFT) is performed on this digitized IF signal to obtain the range profile.
Early radar systems were primarily utilized for navigation and object detection at short ranges. They were used in maritime navigation, for example, to detect other vessels or impediments in foggy circumstances. However, advancements in semiconductor technology and processing led to advancements in the development of advanced radar systems [7]. The mmWave radar provides better antenna miniaturization than other traditional radars. Broadband radio frequency (RF) signals allow for the better resolution capability of the radar, which is the key to many high-performance automotive, medical, and industrial applications. Additionally, their enhanced portability and affordable chip have made them suitable for usage in various day-to-day applications.
A mmWave frequency-modulated continuous wave (FMCW) radar accurately estimates the range and velocity of multiple targets from the radar sensor without the need for more transceivers [9]. For the accurate estimation of the range and velocity of multiple targets, one TX antenna and one RX antenna are sufficient. However, the angle of arrival (AoA) estimation of multiple targets demands more hardware resources, such as more TX antennas and more RX antennas. The greater the number of transceiver antennas, the better the AoA estimation performance will be. However, while detecting objects using one mmWave radar, signals from other nearby radars cause interference, which eventually degrades the performance of the mmWave radar. However, there are some mitigation techniques, though it is still challenging, and this is still an ongoing research topic.
To select the suitable mmWave radar based on the application, the following performance metrics play a crucial role [10,11]:
  • Range—The range is estimated by analyzing the frequency content in the IF signal. As shown in Figure 2a, transmitted and received chirps as a function of time for a single object detected. It can be observed that the received chirp is a time-delay ( τ ) version of the transmitted chirp.
    The time delay can be measured as:
    ( τ ) = 2 R / C
    where R is the distance to the detected object and C is the speed of light.
    The initial phase of the IF signal is  ϕ 0
    ( ϕ 0 ) = 4 π R / λ
    The range is computed as:
    R = C × f I F / 2 S
    The maximum range is decided via the sampling frequency of this IF signal. The larger the sampling frequency, the better the maximum range capacity of the radar will be. The other deciding factor for the maximum range is the transmission power. There is no hardware constraint on the accurate range estimation of multiple targets. One TX antenna and one RX antenna are sufficient.
    Rmax = F s C / 2 S
    Another fundamental limitation for maximum range comes from the transmitting power:
    R m a x = ( ( σ P t G T X G R X λ 2 T m e a s ) / ( 4 π 3 S N R m i n k T F ) ) 1 4
    where  P t is output power of device;  G T X is the TX antenna gain,  G R X is the RX antenna fain;  σ is the radar cross-section of the target (RCS);  T m e a s is total measurement time; SNR is the signal-to-noise ratio; k is the Boltzmann constant; and T is antenna temperature.
  • Velocity—mmWave radar estimates the velocity of multiple targets using the phase difference between IF signals, as illustrated in Figure 2b. There is no hardware constraint for the accurate velocity estimation of the multiple targets. One TX antenna and one RX antenna are sufficient.
    The phase difference is derived as  Δ Φ 4 π V T c / λ , where  T c is the chirp duration time. The velocity is computed as:
    V = λ Δ Φ / 4 π T c
    The measurement is unambiguous only if | Δ Φ | <  π . We can derive that vs. <  λ /4 T c .
    The maximum possible velocity estimation depends on how fast chirps can be transmitted.
    Vmax = λ / 4 T c
  • Angle of arrival—Estimating the angle of arrival of one object requires at least one TX antenna and two RX antennas as shown in Figure 3. The greater the number of RX antennas, the better the AoA estimation performance will be. By using MIMO, more transceiver elements can be made with a limited number of TX and RX antennas. However, accurate AoA estimation of multiple targets demands more hardware resources, such as more TX and RX antennas.
    The phase difference between the IF signals of the two receivers is derived as:
    ( Δ Φ ) = 2 π Δ R / λ
    Under the assumption of a planar wavefront basic geometry  Δ R = d s i n ( θ ), where d is the distance between the receiving antennas. The angle of arrival  θ is computed from  Δ ϕ
    ( θ ) = sin ( ( λ Δ Φ ) / ( 2 π d ) )
    The unambiguous measurement of the angle of arrival requires that ( Δ Φ ) <  π .
    This leads to:
    ( θ m a x ) = sin ( ( λ ) / ( 2 d ) )
  • Range resolution—The shortest distance at which two objects can become close while still being detected as two distinct objects via radar. The smaller this distance, the better the resolving capability of the radar will be. A radar with greater RF bandwidth gives better range resolution.
    The smallest frequency differences of an IF signal are related to the chirp duration,  T c .
    ( Δ f ) > 1 T c
    where  T c is the observation interval or chirp duration.
    ( s i n c e ( Δ f ) = S 2 Δ R c )
    ( Δ R ) > c / 2 S T c = c / 2 B ( s i n c e B = S T c )
    Range resolution depends only on the RF bandwidth swept by the chirp.
    Range   resolution = C / ( 2 B )
    where C is the speed of light, and B is the radar bandwidth. For example, a bandwidth of 4 GHz gives a range resolution of 3.75 cm.
  • Velocity resolution—The smallest velocity difference the two targets can have while still being detected via radar as two distinct targets with two distinct velocities. Velocity resolution can be improved by increasing the frame time. A frame consists of a number of series of chirps.
    ( Δ Φ ) = 4 π V T c / λ
    One can mathematically derive the velocity resolution (Vres) if the frame period  T f = N T c .
    V > Vres =  λ /(2  T f )
    Vres = λ / ( 2 T f )
    where  T f is the frame time.
  • Angle of arrival resolution—The angle of arrival resolution is the smallest angle that can be formed between two targets and radar while still being detected via the radar as two distinct targets. The smaller the angle of arrival resolution, the better the radar’s resolving capability. Extending the number of antennas (both TX and RX) improves the AoA resolution.
    ( θ ( r e s ) ) = 2 / N R X
All the performance parameters, such as range, velocity, angle of arrival, range resolution, velocity resolution, AoA resolution, maximum range, maximum velocity, and maximum AoA, are analytically tabulated in Table 3.
The following are important factors to take into account when choosing a mmWave radar [10,11]:
  • Sensor type—The RF bandwidth, IF bandwidth, ADC sampling rate, range resolution, velocity resolution, and AoA resolution are important key factors in deciding the performance. mmWave radar sensors are broadly categorized into three sensor types: long-range, medium-range, and short-range radars, as listed in Table 4. The appropriate sensor should be chosen depending on the application demands and needs.
  • Frequency and bandwidth—It is advantageous to have a high-frequency sensor; it uses a low antenna size and gives a better angular resolution. High bandwidth offers a high-range resolution. A 77 GHz frequency radar with a 4 GHz bandwidth gives a range resolution of 3.75 cm. Popular mmWave radar models with specifications are listed in Table 5.
  • Accessories—As the needs of mmWave radars change, upgrading the firmware and software becomes necessary. Hence, choosing a manufacturer that can offer stable software updates is important. mmWave radars have been integrated with Lidars in [35,36] to provide better results; additionally, radars fused with cameras or infrared sensors are studied in [37,38,39]. Texas Instruments (TI) introduced a commercial radar, TDA3x, board for radar camera fusion to provide effective tracking and detection applied in [40]. There is a discussion of fusion techniques in [41,42], such as low-level and feature-level fusion.

3. Measurements from mmWave Radar Sensor and Interpretation of the Data

3.1. Range Profile

A sample range profile measured using the millimeter wave radar sensor is illustrated in Figure 4a. Taking the fast Fourier transform (FFT) of an intermediate-frequency signal yields the range profile. This range profile depicts the relative reflected power from the targets as a function of range. The target is indicated via the peaks in the range profile. Targets with a large cross-section reflect more power, producing a stronger peak. Targets located near the radar produce a strong peak in the range profile.
A range–Doppler heatmap displays multiple targets with their speeds as a function of range, as shown in Figure 4b. Stationary targets have zero Doppler while moving targets have a range–Doppler map with non-zero Doppler values. This essentially provides dynamic information about the targets, such as their velocity and range.

3.2. Range–Azimuth Heatmap

The range–azimuth heatmap in Figure 5a is intended to display radar cube information corresponding to a zero Doppler bin for every combination of range and angle bin. It essentially gives the location information about the targets with respect to radar in a Cartesian coordinate system. The colored signal power representation within the plot shows the range and angle coordinate points where the targets are located.

3.3. Three-dimensional Scatter Plot

The detected targets are displayed in 3D space by selecting a non-zero elevation resolution as the antenna configuration, as shown in Figure 5b.

4. Applications of mmWave Radars and Machine Learning Techniques

mmWave radars are used in a variety of applications, as illustrated in Figure 6. These include automotive applications, industrial applications, military applications, medical applications, robotics and automation applications, civilian applications, and security and surveillance applications.

4.1. Automotive Applications

Automotive applications use mmWave radar sensors to accurately localize and measure the radial range, velocity, and AoA of moving objects. The applications include adaptive cruise control, autonomous emergency braking, blind spot detection, lane change assistance, front cross-traffic alert, rear cross-traffic alert, automated parking, body/chassis applications, and in-cabin applications. The relative positioning of vehicles has been estimated using mmWave radar in [43]. Vehicle detection in advanced driving assistant systems using automotive radar with range–azimuth–Doppler dimensions is studied in [44]. A 2D car detection system for autonomous driving applications is studied in [45]. The ability of an autonomous vehicle to perceive and comprehend its surroundings is studied in [46]. The use of mmWave radars for vehicle detection in self-driving applications is studied in [47]. The use of mmWave radar sensor and vision sensor fusion for obstacle detection in autonomous driving is studied in [48]. To obtain high accuracy in new advanced driver-assistance systems (ADASs), mmWave radars have been used in vehicles [49], as shown in Figure 7. A 60 GHz mmWave radar has been used to reduce driver distractions with real-time hand gesture recognition instead of touchscreens and wearable components [50]. Machine-learning-based hand gesture recognition is studied in [51] using CNN and LSTM. People occupancy detection in a vehicle has been implemented utilizing mmWave radar [52]. Furthermore, contactless non-intrusive vehicle occupant detection is studied in [53], and autonomous navigation by predicting vehicle location utilizing mmWave radar is studied in [54]. Radar sensors placed at the front and rear corner of the car that form beams for front and rear blind spot detection, as well as for cross-traffic alert, are demonstrated in [55]. mmWave radar became a solution for ground-based traffic monitoring, and the management of both terrestrial and aerial vehicles using angle estimations in [56]. The detailed automotive applications and associated radar details are tabulated in Table 6.

4.2. Industrial Applications

mmWave radars have become popular as they provide precise measurements that are useful in industrial applications. Industrial applications include level sensing of fluids, volume identification for solids, infrastructure systems, surface quality assessment in production industries, and vibration monitoring. Utilizing mmWave radar for automatic crack detection to distinguish between cracked and uncracked ceramic tiles and for quality control of packaged ceramic tiles is presented in [68]. In industrial processes, to have control over the usage of liquid and identify leakages, mmWave radars have been utilized for accurately measuring fluid levels in tanks, as presented in [69]. In [70], a framework for accurate material identification for six different materials using mmWave radar is presented. In addition, the volume of the materials has been determined. Using low-power transmission signals and reflections with a non-line-of-sight (NLOS) method for detecting moving objects has been studied in [71]. This study includes a model for the echo signal of the NLOS target by considering the multipath effect and the weak target echo signal issues. The detection and classification of gases and aerosols have been implemented in [72]. Detecting the vibrational target objects by modifying shaking frequencies and assessing the performance is studied in [10]. The monitoring of the mass flow of pneumatically transported bulk materials using mmWave measuring is presented in [73]. mmWave radars are useful in metal production industries, where they require the precise measurement of slabs of copper, steel, and aluminum in production. In rolling mills, mmWave radar sensor technology is useful to provide accurate measurements, even in smoky, hot, steamy, and dusty conditions, as shown in Figure 8. The detailed industrial applications along with the radar utilized are tabulated in Table 7.

4.3. Medical Applications

Medical applications for mmWave radars have also gained importance due to their sensitive detection capability and the penetration of mmWave signals in biological tissues. Using mmWave radar, various glucose concentration levels in blood samples to distinguish the healthy or diabetic have been studied in [81]. In [82], contactless breathing rate and heart rate monitoring of patients using mmWave were implemented, as shown in Figure 9. mmWave radar sensors have been used for monitoring vital signs via non-contact means in a robust way [83]. The use of mmWave radar in real-time human motion behavior detection is presented in [84]. The recognition of multiple patient behaviors has been simultaneously studied utilizing mmWave radars in [85]. The real-time detection and tracking of human skeletal positions for patient monitoring is studied in [86]. Considering body movements as micro-motion parameters for real-time fitness tracking via non-contact means has been studied in [87]; additionally, fitness tracking by classifying and counting exercises is presented in [88]. The detection of sleeping pose identification utilizing mmWave radar has been implemented in [89]. For skin diagnosis applications, mmWave radar has been utilized in [90]. The utilization of a wearable radar sensor for continuous blood pressure monitoring is presented in [91]. Detailed medical applications utilizing mmWave radars are tabulated in Table 8.

4.4. Robotics and Automation Applications

Robotics applications include both indoor and outdoor environments. Detecting transparent objects such as glass walls is very important in autonomous navigation. mmWave radars reliably detect glass walls [99]. They are also quite reliable as ground-speed radars in agricultural and warehouse robots [99]. Using the same ground-speed radar, it is possible to sense the surface edges if the radar is mounted in front of it, facing toward the ground. Safeguards around robotic arms are another important field wherein mmWave radar plays a vital role. Mapping and navigation is another important application where mmWave radars are used in indoor environments. Robotic applications for human path tracking and collision avoidance are explored utilizing mmWave radars [100]. The detection of obstacles and avoiding collision in a 360-degree path in robotics using mmWave radars is demonstrated in [101], as shown in Figure 10. Incorporating an antenna on package sensors with a wider field of view in both azimuth and elevation helps in the intelligent sensing of transparent objects and dark objects, which is studied in [102]. Glass walls and the materials behind them can be detected using mmWave radar sensors [99]. Detailed robotics and automation applications and associated radar details are tabulated in Table 9.

4.5. Security and Surveillance Applications

mmWave radars are useful in security and surveillance applications because they can detect moving objects and obstacles in low-light conditions. In particular, personal screening and maintaining security aspects are discussed in [105]. mmWave radars are being used in air traffic control systems and low-altitude space surveillance applications to detect and display the position of aerial vehicles. Aerial vehicle activity monitoring with radar range and angle measurements is studied in [106]. Airborne radars for obstacle avoidance, landing aids, automotive radars for collision avoidance, and driving safety support are studied in [107]. In [108], airborne surveillance with navigational aid on the ground using mmWave synthetic aperture radar (SAR) is implemented, which tracks the actual flight route and records it. Unmanned aerial vehicle (UAV) detection with respect to a range of up to 40 m using low-cost mmWave sensors is reported in [2]. In airports and other sensitive places, mmWave radars are utilized in the identification of intrusions in [109]. Vehicle detection and tracking in traffic monitoring applications with a range greater than 100 m are shown in Figure 11. A richer radar point cloud representation for a traffic monitoring scenario is shown in [110]. People tracking using radar applications for consumers in indoor and outdoor environments is presented in [111]. Furthermore, channel tracking for a vehicular communication system is studied in [112]. Detailed security and surveillance and civilian applications and associated radar details are tabulated in Table 10.

4.6. Civilian Applications

mmWave radars have grown in popularity because they are robust to adverse weather conditions and find many uses in the civilian sector. The creation of a drone setup by integrating a mmWave sensor to detect power lines up to a 40-m range with improved performance and fast detection is shown in Figure 12. Debris detection on airport runways, early risk warnings for helicopters, power line detection in flying paths, and malicious drone detection are some of the applications of mmWave radars. Detecting small foreign objects on airport runways for a safe landing is studied in [117], as shown in Figure 13. mmWave radars reliably detect high-voltage invisible power lines in snowy and inclement weather. Risk avoidance with early warnings from mmWave sensors to rescue helicopters is discussed in [114].
In [120], a cooperative radar sensing network is implemented for tracking small, hidden, unauthorized unmanned aerial vehicles (UAVs). Micro-UAV detection for defense applications using 24 GHz mmWave radars is presented in [126]. The classification of birds and drones using radar micro-Doppler signatures is presented in [127]. The detection and mitigation of GPS spoofing for drones is explored in [128]. Aircraft runway extraction in low-visibility conditions for a safe landing is investigated in [129]. Furthermore, in [115], the use of mmWave radars for the safe landing of helicopters in inclement weather conditions based on height drift data is studied. Another interesting application is implemented in [130], which utilizes a CNN architecture to generate radar maps for recognizing and classifying various real road images captured from gravel, mud, and river surfaces.

4.7. Other Applications

Object detection is one of the earliest applications of mmWave radar, which extends to human fall detection, as presented in [131]. Hand gesture recognition for user interactions with computers is studied in [132]. A model for long-range gesture recognition is investigated in [133]. Furthermore, the real-time recognition of macro-gestures is presented in [134]. Human pose estimation through occlusions and walls is explored in [135]. The implementation of mmWave harmonic sensors to track small insects is conducted in [136]. The use of 61 GHz mmWave radar for human face classification is investigated in [137]. Non-contact skin sensing for analyzing human emotional arousal and stress status using mmWave radars is implemented in [97]. The use of mmWave radar combined with GNN and LSTM for human activity recognition is explored in [138].
In addition to the aforementioned areas, mmWave radars are also used in underground mining with range measurements [139], spying on phone calls [80], efficient soil moisture sensing [140], micro-action recognition systems [141], mmWave radar and audio signal fusion for speech recognition [142]. Recent advances in sensor technology, combined with machine learning techniques, have also enabled new applications for mmWave radar sensors to be developed.
The use of mmWave radar combined with machine learning algorithms has grown in popularity in recent years. As shown in Table 11, we provide an overview of machine learning algorithms that are widely used in computer vision and related fields and have been applied to radar signal processing. The applications of machine learning include object detection, classification, clustering, and tracking, utilizing radar data. IF signals from radars contain a predefined set of target features, and these IF signals are used in machine learning models to make subsequent predictions. However, deep learning algorithms are based on multiple layers of neural networks to learn high-level feature representations from input radar IF data, which are then used to make intelligent decisions.
Furthermore, many research works are in progress that input radar signals into various deep learning techniques for object detection, such as those in [45,143,144,145]; object classification, such as those in [146,147]; object segmentation, such as those in [46,148]; and multi-class target classification, such as those in [149], using mmWave radar range–angle images. Furthermore, target classification using the range FFT of a mmWave radar’s statistical features is studied in [150]. The utilization of various deep learning techniques and micro-Doppler patterns from radar data for object classification is explored in [151]. Multi-person identification with distinct micro-Doppler signatures is studied in [152].
Table 11. Machine learning techniques for mmWave radar sensing.
Table 11. Machine learning techniques for mmWave radar sensing.
ReferencesYearMethodApplicationComments
[88]2016CNN, data transformation techniquesFitness tracking
  • Can classify different exercises with 95.53 accuracy and is capable of counting repetitive exercises.
  • Counting repetitive exercises improves accuracy.
[132]2016Random forest algorithmHand gesture recognition
  • RF offers  86 % per-gesture accuracy with raw data.
  • RF with Bayesian Filter offers  92 % per-gesture accuracy with raw data.
[84]2019Convolution neural network (CNN)Human behavior detection
  • Point cloud data are processed using the CFAR algorithm.
  • The usage of micro-Doppler information on human activities with CNN produces an accuracy above  99 % .
[131]2019NN is compared with SVM, DTFall detection
  • Attains  98 % accuracy with NN backpropagation.
  • Evaluated on only three possible human positions with coordination points.
[153]2019CNN, ConvLSTM, RFReceived power prediction
  • Power prediction from image works effectively with rotated 3D CNN, and spatiotemporal features are predicted with a Random forest algorithm.
  • Received power of 500ms with high accuracy and RMS errors less than 1.0 is achieved.
[112]2019LSTMChannel tracking in vehicular system
  • Accurate user channel prediction, and less overhead rate.
  • Usage of LSTMs is to predict the user channel based on past channel-state information.
[45]2019PointNets2D car detection
  • Using PointNets for classification with segmentation.
  • Mutli-class object detection needs to be investigated.
[46]2020CNN, RNNScene understanding via classification
  • CNN with grid maps as input for classifying static objects.
  • RNN with point clouds as input for classifying dynamic instances.
[47]2020DBSCAN, Faster R-CNNVehicle detection
  • The proposed method performs better as it is a DBSCAN method based on elevation resolution and also removes noise points using filters.
  • Using Faster R-CNN achieves  96 % accuracy by representing the target with the density of the point cloud.
[110]2020Point clouds, GMMMultimodal traffic monitoring
  • GMM performs point cloud segmentation from sensor-collected point clouds.
  • Can extend with DBSCAN for classifying more transportation modes.
[48]2020SAF-FOC frameworkObstacle detection
  • Feature-level fusion performs well compared with data-level and decision-level fusion.
  • To cover 360 coverage, the framework can be extended with multiple sensors.
[86]2020CNNDetecting human skeletal pose
  • Radar data to image representation with the help of depth, azimuth, and elevation information of reflection points to identify skeletal position.
  • Proposed an architecture with significantly reduced computational complexity with reused weights, and it also provided lower localization error, such as  3.2 cm depth and  2.7 cm elevation.
[138]2021Graph neural network with LSTMHuman activity recognition and gesture recognition
  • Iteratively extracts the point cloud features and updates the graphs.
  • Excellent action recognition performance compared to other methods.
[154]2021SVMShape classification and object detection
  • Uses SVM with RFB kernel to achieve an accuracy of  96 % .
  • Comparatively less accuracy is obtained to classify multiple target objects.
[98]2022CNNAutomatic monitoring of heart rate and breathing rate
  • Obtained  87 % classification accuracy by forming low, average, high, and a combination of six classes using CNN.
  • Removes the noise caused via vibrations and gives clear rate.
[70]2022CNN, K-nearest neighborMaterial identification
  • K-NN uses two feature sets, while CNN uses the material’s distinctive features for identifying the materials.
  • Enhanced classification accuracy of  98 % in identifying the six materials at three different volume levels.

5. Conclusions

mmWave radar sensors have significant advantages compared to other sensors, making them an ideal solution for a vast number of applications. This article discussed the key performance parameters as well as the interpretation of radar measurements for mmWave radar sensors. The most recent mmWave radar advances and cutting-edge mmWave radars were thoroughly reviewed. The use of mmWave radar sensors was discussed in a variety of applications, such as automotive, industrial, robotics and automation, medical, security, and surveillance fields, as well as others. Finally, machine learning techniques applied to mmWave radar sensor data were investigated.
The future of mmWave radar technology seems promising, with plenty of room for growth and expansion. Here, we present some major trends and developments to keep an eye on in future years. mmWave radars are projected to play a critical role in advanced driver-assistance systems (ADASs) and driverless vehicles in automotive applications. In the future, the increased integration of mmWave radar sensors in automobiles is likely to improve safety, enable autonomous driving, and improve situational awareness in a variety of weather conditions. mmWave radars have the potential to transform industrial applications, such as non-destructive testing, quality control, and process automation. Future advancements may result in smaller, more adaptable, and cost-effective industrial mmWave radar systems. There is significant interest in employing mmWave radar for medical applications, such as the remote monitoring of vital signs, fall detection for the elderly, and early illness identification in healthcare and medical imaging. Healthcare-related mmWave radar equipment may advance in the future. mmWave radar systems are useful in security and surveillance applications, such as perimeter monitoring, intrusion detection, and surveillance in complex settings. Future advancements could result in more complex and integrated security solutions. In the field of IoT and smart cities, mmWave radar sensors could find uses in smart cities for traffic control, environmental monitoring, and public safety. Space exploration uses mmWave radar technology for remote sensing, landing, and planetary exploration. As space exploration advances, mmWave radar devices may play an important part in future space missions. Continued advances in signal processing methods and the application of machine learning techniques will enhance the capabilities of mmWave radar systems, allowing for better object detection, tracking, and imaging. The miniaturization of mmWave radar components and their integration into smaller and more diversified devices may be future trends, making them more accessible for a larger range of applications. Challenges include mitigating interference from other mmWave sources, dealing with atmospheric effects, and ensuring regulatory compliance.

Author Contributions

Conceptualization, L.R.C.; methodology, L.R.C. and A.S.; software, L.R.C. and A.S.; validation, L.R.C. and A.S.; formal analysis, L.R.C. and A.S.; investigation, L.R.C. and A.S.; resources, L.R.C., A.S. and C.K.M.; data curation, L.R.C. and A.S.; writing—original draft preparation, L.R.C. and A.S.; writing—review and editing, L.R.C., A.S. and C.K.M.; visualization, L.R.C. and A.S.; supervision, L.R.C. and C.K.M.; project administration, L.R.C.; funding acquisition, L.R.C. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the INCAPS project: 287918 of the International Partnerships for Excellent Education, Research and Innovation (INTPART) program from the Research Council of Norway and the Low-Altitude UAV Communication and Tracking (LUCAT) project: 280835 of the IKTPLUSS program from the Research Council of Norway.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data sharing not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Wilson, A.; Kumar, A.; Jha, A.; Cenkeramaddi, L.R. Embedded Sensors, Communication Technologies, Computing Platforms and Machine Learning for UAVs: A Review. IEEE Sens. J. 2021, 22, 1807–1826. [Google Scholar] [CrossRef]
  2. Morris, P.J.B.; Hari, K. Detection and localization of unmanned aircraft systems using millimeter-wave automotive radar sensors. IEEE Sens. Lett. 2021, 5, 1–4. [Google Scholar] [CrossRef]
  3. Venon, A.; Dupuis, Y.; Vasseur, P.; Merriaux, P. Millimeter Wave FMCW RADARs for perception, recognition, and localization in automotive applications: A survey. IEEE Trans. Intell. Veh. 2022, 7, 533–555. [Google Scholar] [CrossRef]
  4. Hakobyan, G.; Yang, B. High-performance automotive radar: A review of signal processing algorithms and modulation schemes. IEEE Signal Process. Mag. 2019, 36, 32–44. [Google Scholar] [CrossRef]
  5. Cenkeramaddi, L.R.; Bhatia, J.; Jha, A.; Vishkarma, S.K.; Soumya, J. A survey on sensors for autonomous systems. In Proceedings of the 2020 15th IEEE Conference on Industrial Electronics and Applications (ICIEA), Kristiansand, Norway, 9–13 November 2020; IEEE: Piscataway, NJ, USA, 2020; pp. 1182–1187. [Google Scholar]
  6. Roodaki, P.M.; Taghian, F.; Bashirzadeh, S.; Jalaali, M. A survey of millimeter-wave technologies. In Proceedings of the 2011 International Conference on Electrical and Control Engineering, Yichang, China, 16–18 September 2011; IEEE: Piscataway, NJ, USA, 2011; pp. 5726–5728. [Google Scholar]
  7. Patole, S.M.; Torlak, M.; Wang, D.; Ali, M. Automotive radars: A review of signal processing techniques. IEEE Signal Process. Mag. 2017, 34, 22–35. [Google Scholar] [CrossRef]
  8. Abdu, F.J.; Zhang, Y.; Fu, M.; Li, Y.; Deng, Z. Application of deep learning on millimeter-wave radar signals: A review. Sensors 2021, 21, 1951. [Google Scholar] [CrossRef]
  9. Ikram, M.Z.; Ahmad, A.; Wang, D. High-accuracy distance measurement using millimeter-wave radar. In Proceedings of the 2018 IEEE Radar Conference (RadarConf18), Oklahoma City, OK, USA, 23–27 April 2018; IEEE: Piscataway, NJ, USA, 2018; pp. 1296–1300. [Google Scholar]
  10. Ciattaglia, G.; De Santis, A.; Disha, D.; Spinsante, S.; Castellini, P.; Gambi, E. Performance evaluation of vibrational measurements through mmWave radars. In Proceedings of the 2020 IEEE 7th International Workshop on Metrology for AeroSpace (MetroAeroSpace), Pisa, Italy, 22–24 June 2020; IEEE: Piscataway, NJ, USA, 2020; pp. 160–165. [Google Scholar]
  11. Darlis, A.R.; Ibrahim, N.; Kusumoputro, B. Performance Analysis of 77 GHz mmWave Radar Based Object Behavior. J. Commun. 2021, 16, 576–582. [Google Scholar] [CrossRef]
  12. Lovescu, C.; Rao, S. The Fundamentals of Millimeter Wave Radar Sensors. Available online: https://www.ti.com/lit/pdf/spyy005 (accessed on 10 February 2023).
  13. IWR6843aop. Available online: https://www.ti.com/tool/IWR6843AOPEVM (accessed on 3 January 2023).
  14. IWR1843. Available online: https://www.ti.com/lit/ds/swrs228a/swrs228a.pdf?ts=1673330497709&ref_url=https%253A%252F%252Fwww.ti.com%252Ftool%252FIWR1843BOOST (accessed on 3 January 2023).
  15. Stanislas, L.; Peynot, T. Characterisation of the Delphi Electronically Scanning Radar for robotics applications. In Proceedings of the Australasian Conference on Robotics and Automation 2015, Canberra, Australia, 2–4 December 2015; Australian Robotics and Automation Association: Sydney, NSW, Australia, 2015; pp. 1–10. [Google Scholar]
  16. NavTech CIR204-h. Available online: https://levelfivesupplies.com/wp-content/uploads/2019/01/CIR-datasheet.pdf (accessed on 30 December 2022).
  17. AWR1843. Available online: https://www.ti.com/lit/ds/symlink/awr1843aop.pdf?ts=1673203974876&ref_url=https%253A%252F%252Fwww.ti.com%252Fsensors%252Fmmwave-radar%252Fautomotive%252Fproducts.html (accessed on 3 January 2023).
  18. BOSCH. Available online: https://www.bosch-engineering.jp/media/jp/pdfs_3/einsatzgebiete_4/produktdatenblaetter_2/120903_LRR3_EN_V05_final.pdf (accessed on 23 December 2022).
  19. Continental Engineering Services. ARS 408-21. Available online: https://conti-engineering.com/wp-content/uploads/2020/02/ARS-408-21_EN_HS-1.pdf (accessed on 31 December 2022).
  20. SRR600. Available online: https://www.continental-automotive.com/en-gl/Passenger-Cars/Autonomous-Mobility/Enablers/Radars/SRR600 (accessed on 22 December 2022).
  21. AWR1843AOP. Available online: https://www.ti.com/product/AWR1843AOP#product-details (accessed on 22 December 2022).
  22. AWR1642. Available online: https://www.ti.com/lit/ds/symlink/awr1642.pdf?ts=1673244878752&ref_url=https%253A%252F%252Fwww.ti.com%252Fproduct%252FAWR1642 (accessed on 31 December 2022).
  23. IWR1642. TI Robots. Available online: https://www.ti.com/lit/ds/symlink/iwr1642.pdf?ts=1673279643829&ref_url=https%253A%252F%252Fwww.ti.com%252Fproduct%252FIWR1642 (accessed on 31 December 2022).
  24. TEF810X. Nxp Radar. Available online: https://www.nxp.com/docs/en/data-sheet/TEF810XDS.pdf (accessed on 31 December 2022).
  25. SAF85xx. Nxp Model. Available online: https://www.nxp.com/products/radio-frequency/radar-transceivers-and-socs/high-performance-77ghz-rfcmos-automotive-radar-one-chip-soc:SAF85XX (accessed on 31 December 2022).
  26. TEF82xx. Nxp Radar Model. Available online: https://www.nxp.com/products/radio-frequency/radar-transceivers/fully-integrated-77-ghz-rfcmos-automotive-radar-transceiver:TEF82xx (accessed on 31 December 2022).
  27. ARS540. Available online: https://www.continental-automotive.com/en-gl/Passenger-Cars/Autonomous-Mobility/Enablers/Radars/Long-Range-Radar/ARS540 (accessed on 31 December 2022).
  28. AWRL1443. Ti Automative Radar Model. Available online: https://www.ti.com/lit/ds/symlink/awr1443.pdf?ts=1673521768628&ref_url=https%253A%252F%252Fwww.ti.com%252Fproduct%252FAWR1443 (accessed on 31 December 2022).
  29. IWRL6432. Industrial Radar Model. Available online: https://www.ti.com/lit/ds/symlink/iwrl6432.pdf?ts=1673520655112&ref_url=https%253A%252F%252Fwww.ti.com%252Fproduct%252FIWRL6432 (accessed on 31 December 2022).
  30. ARS4-A. Available online: https://apps.fcc.gov/els/GetAtt.html?id=144885&x= (accessed on 31 December 2022).
  31. AWR2243. Available online: https://www.ti.com/lit/ug/spruit8d/spruit8d.pdf?ts=1673514555771 (accessed on 31 December 2022).
  32. AWR1243. Available online: https://www.ti.com/lit/wp/spyy003/spyy003.pdf (accessed on 22 December 2022).
  33. NXP4D-S32R45. Available online: https://www.electronicproducts.com/nxp-unveils-4d-imaging-radar-processor-for-l2-autonomy/ (accessed on 10 January 2022).
  34. RDK-S32R274. Available online: https://www.nxp.com/docs/en/fact-sheet/RDK-S32R274_FS.pdf (accessed on 22 December 2022).
  35. Hajri, H.; Rahal, M.C. Real time lidar and radar high-level fusion for obstacle detection and tracking with evaluation on a ground truth. arXiv 2018, arXiv:1807.11264. [Google Scholar]
  36. Kwon, S.K.; Hyun, E.; Lee, J.H.; Lee, J.; Son, S.H. A low-complexity scheme for partially occluded pedestrian detection using LiDAR-radar sensor fusion. In Proceedings of the 2016 IEEE 22nd International Conference on Embedded and Real-Time Computing Systems and Applications (RTCSA), Daegu, Republic of Korea, 17–19 August 2016; IEEE: Piscataway, NJ, USA, 2016. [Google Scholar]
  37. Sengupta, A.; Cheng, L.; Cao, S. Robust multiobject tracking using mmwave radar-camera sensor fusion. IEEE Sens. Lett. 2022, 6, 1–4. [Google Scholar] [CrossRef]
  38. Ulrich, M.; Maile, F.; Löcklin, A.; Yang, B.; Kleiner, B.; Ziegenspeck, N. A model for improved association of radar and camera objects in an indoor environment. In Proceedings of the 2017 Sensor Data Fusion: Trends, Solutions, Applications (SDF), Bonn, Germany, 10–12 October 2017; IEEE: Piscataway, NJ, USA, 2017; pp. 1–6. [Google Scholar]
  39. Sikdar, A.; Cao, S.; Zheng, Y.F.; Ewing, R.L. Radar depth association with vision detected vehicles on a highway. In Proceedings of the 2014 IEEE Radar Conference, Cincinnati, OH, USA, 19–23 May 2014; IEEE: Piscataway, NJ, USA, 2014; pp. 1159–1164. [Google Scholar]
  40. Zhong, Z.; Liu, S.; Mathew, M.; Dubey, A. Camera radar fusion for increased reliability in ADAS applications. Electron. Imaging 2018, 2018, 258-1. [Google Scholar] [CrossRef]
  41. Steux, B.; Laurgeau, C.; Salesse, L.; Wautier, D. Fade: A vehicle detection and tracking system featuring monocular color vision and radar data fusion. In Proceedings of the Intelligent Vehicle Symposium, Versailles, France, 17–21 June 2002; IEEE: Piscataway, NJ, USA, 2002; Volume 2, pp. 632–639. [Google Scholar]
  42. Mahlisch, M.; Hering, R.; Ritter, W.; Dietmayer, K. Heterogeneous fusion of Video, LIDAR and ESP data for automotive ACC vehicle tracking. In Proceedings of the 2006 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, Heidelberg, Germany, 3–6 September 2006; IEEE: Piscataway, NJ, USA, 2006; pp. 139–144. [Google Scholar]
  43. de Ponte Müller, F. Survey on ranging sensors and cooperative techniques for relative positioning of vehicles. Sensors 2017, 17, 271. [Google Scholar] [CrossRef] [PubMed]
  44. Major, B.; Fontijne, D.; Ansari, A.; Teja Sukhavasi, R.; Gowaikar, R.; Hamilton, M.; Lee, S.; Grzechnik, S.; Subramanian, S. Vehicle detection with automotive radar using deep learning on range-azimuth-doppler tensors. In Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops, Seoul, Republic of Korea, 27 October–2 November 2019. [Google Scholar]
  45. Danzer, A.; Griebel, T.; Bach, M.; Dietmayer, K. 2D car detection in radar data with pointnets. In Proceedings of the 2019 IEEE Intelligent Transportation Systems Conference (ITSC), Auckland, New Zealand, 27–30 October 2019; IEEE: Piscataway, NJ, USA, 2019; pp. 61–66. [Google Scholar]
  46. Schumann, O.; Lombacher, J.; Hahn, M.; Wöhler, C.; Dickmann, J. Scene understanding with automotive radar. IEEE Trans. Intell. Veh. 2019, 5, 188–203. [Google Scholar] [CrossRef]
  47. Huang, Y.; Zhang, H.; Guo, K.; Li, J.; Xu, G.; Chen, Z. Density-based vehicle detection approach for automotive millimeter-wave radar. In Proceedings of the 2020 IEEE 3rd International Conference on Electronic Information and Communication Technology (ICEICT), Shenzhen, China, 13–15 November 2020; IEEE: Piscataway, NJ, USA, 2020; pp. 534–537. [Google Scholar]
  48. Chang, S.; Zhang, Y.; Zhang, F.; Zhao, X.; Huang, S.; Feng, Z.; Wei, Z. Spatial attention fusion for obstacle detection using mmwave radar and vision sensor. Sensors 2020, 20, 956. [Google Scholar] [CrossRef] [PubMed]
  49. Gao, X.; Xing, G.; Roy, S.; Liu, H. Experiments with mmwave automotive radar test-bed. In Proceedings of the 2019 53rd Asilomar Conference on Signals, Systems, and Computers, Pacific Grove, CA, USA, 3–6 November 2019; IEEE: Piscataway, NJ, USA, 2019; pp. 1–6. [Google Scholar]
  50. Smith, K.A.; Csech, C.; Murdoch, D.; Shaker, G. Gesture recognition using mm-wave sensor for human-car interface. IEEE Sens. Lett. 2018, 2, 1–4. [Google Scholar] [CrossRef]
  51. Yu, J.T.; Yen, L.; Tseng, P.H. mmWave radar-based hand gesture recognition using range-angle image. In Proceedings of the 2020 IEEE 91st Vehicular Technology Conference (VTC2020-Spring), Antwerp, Belgium, 25–28 May 2020; IEEE: Piscataway, NJ, USA, 2020; pp. 1–5. [Google Scholar]
  52. Munte, N.; Lazaro, A.; Villarino, R.; Girbau, D. Vehicle occupancy detector based on FMCW mm-wave radar at 77 GHz. IEEE Sens. J. 2022, 22, 24504–24515. [Google Scholar] [CrossRef]
  53. Texas Instruments. Vehicle Occupant Detection using TI mmWave Sensors. Available online: https://training.ti.com/vehicle-occupant-detection-using-ti-mmwave-sensors (accessed on 1 May 2022).
  54. Jose, E.; Adams, M.; Mullane, J.S.; Patrikalakis, N.M. Predicting millimeter wave radar spectra for autonomous navigation. IEEE Sens. J. 2010, 10, 960–971. [Google Scholar] [CrossRef]
  55. Texas Instruments. Crosstraffic Alert Radar Sensor. Available online: https://training.ti.com/automotive-corner-radar-using-ti-mmwave-sensors. (accessed on 24 January 2023).
  56. Cenkeramaddi, L.R.; Rai, P.K.; Dayal, A.; Bhatia, J.; Pandya, A.; Soumya, J.; Kumar, A.; Jha, A. A Novel Angle Estimation for mmWave FMCW Radars Using Machine Learning. IEEE Sens. J. 2021, 21, 9833–9843. [Google Scholar] [CrossRef]
  57. Texas Instruments. Advanced Driver Assistance Systems (ADAS). Available online: https://www.ti.com/applications/automotive/adas/overview.html#aem-application-Browse (accessed on 1 May 2022).
  58. Russell, M.; Crain, A.; Curran, A.; Campbell, R.; Drubin, C.; Miccioli, W. Millimeter-wave radar sensor for automotive intelligent cruise control (ICC). IEEE Trans. Microw. Theory Tech. 1997, 45, 2444–2453. [Google Scholar] [CrossRef]
  59. Liu, G.; Zhou, M.; Wang, L.; Wang, H.; Guo, X. A blind spot detection and warning system based on millimeter wave radar for driver assistance. Optik 2017, 135, 353–365. [Google Scholar] [CrossRef]
  60. AWR1243 Radar. Available online: https://www.ti.com/lit/wp/spyy009/spyy009.pdf (accessed on 22 December 2022).
  61. AWR1642 Radar. Available online: https://www.ti.com/video/5703076705001 (accessed on 22 December 2022).
  62. 77GHz Single Chip Radar Sensor Enables Automotive Body and Chassis Applications. Available online: https://www.ti.com/lit/wp/spry315/spry315.pdf?ts=1674543928796&ref_url=https%253A%252F%252Fwww.google.com%252F (accessed on 22 December 2022).
  63. Texas Instruments. Webinar—Automotive Parking System Using TI mmWave Sensors. Available online: https://training.ti.com/webinar-automotive-parking-system-using-ti-mmwave-sensors?context=1128486-1139157-1137700 (accessed on 1 May 2022).
  64. AWR1843AOPEVM Radar. Available online: https://e2e.ti.com/blogs_/b/behind_the_wheel/posts/how-aop-technology-expands-radar-sensor-placement-for-automotive-applications (accessed on 22 December 2022).
  65. BlindspotAWR1843AOPEVM Radar. Available online: https://training.ti.com/zh-tw/blind-spot-detection-motorcycles-using-ti-mmwave-radar?context=1149404-1149401 (accessed on 22 December 2022).
  66. Yurduseven, O.; Fromenteze, T.; Decroze, C.; Fusco, V.F. Frequency-diverse computational automotive radar technique for debris detection. IEEE Sens. J. 2020, 20, 13167–13177. [Google Scholar] [CrossRef]
  67. Li, X.; Wang, X.; Yang, Q.; Fu, S. Signal Processing for TDM MIMO FMCW Millimeter-Wave Radar Sensors. IEEE Access 2021, 9, 167959–167971. [Google Scholar] [CrossRef]
  68. Agarwal, S.; Singh, D. An Adaptive Statistical Approach for Non-Destructive Underline Crack Detection of Ceramic Tiles Using Millimeter Wave Imaging Radar for Industrial Application. IEEE Sens. J. 2015, 15, 7036–7044. [Google Scholar] [CrossRef]
  69. Fluidlevel Radar. Available online: https://www.ti.com/lit/wp/spyy004/spyy004.pdf (accessed on 20 January 2022).
  70. Skaria, S.; Hendy, N.; Al-Hourani, A. Machine Learning Methods for Material Identification Using mmWave Radar Sensor. IEEE Sens. J. 2022, 23, 1471–1478. [Google Scholar] [CrossRef]
  71. Wei, Y.; Sun, B.; Zhou, Y.; Wang, H. Non-Line-of-Sight Moving Target Detection Method Based on Noise Suppression. Remote Sens. 2022, 14, 1614. [Google Scholar] [CrossRef]
  72. Hattenhorst, B.; Piotrowsky, L.; Pohl, N.; Musch, T. An mmWave sensor for real-time monitoring of gases based on real refractive index. IEEE Trans. Microw. Theory Tech. 2021, 69, 5033–5044. [Google Scholar] [CrossRef]
  73. Baer, C.; Jaeschke, T.; Mertmann, P.; Pohl, N.; Musch, T. A mmWave measuring procedure for mass flow monitoring of pneumatic conveyed bulk materials. IEEE Sens. J. 2014, 14, 3201–3209. [Google Scholar] [CrossRef]
  74. OndoSense. Metal Production, Shortrange. Available online: https://ondosense.com/en/applications/width-measurement-of-slabs-in-hot-rolling-mills/ (accessed on 1 May 2022).
  75. Park, J.; Nguyen, C. Development of a new millimeter-wave integrated-circuit sensor for surface and subsurface sensing. IEEE Sens. J. 2006, 6, 650–655. [Google Scholar] [CrossRef]
  76. Nakagawa, T.; Hyodo, A.; Kogo, K.; Kurata, H.; Osada, K.; Oho, S. Contactless Liquid-Level Measurement With Frequency-Modulated Millimeter Wave through Opaque Container. IEEE Sens. J. 2013, 13, 926–933. [Google Scholar] [CrossRef]
  77. Weiß, J.; Santra, A. One-Shot Learning for Robust Material Classification Using Millimeter-Wave Radar System. IEEE Sens. Lett. 2018, 2, 1–4. [Google Scholar] [CrossRef]
  78. Texas Instruments, mmWave. Available online: https://www.ti.com/lit/wp/spry328/spry328.pdf (accessed on 23 January 2022).
  79. Delden, M.v.; Westerdick, S.; Musch, T. Investigations on Foam Detection Utilizing Ultra-Broadband Millimeter Wave FMCW Radar. In Proceedings of the 2019 IEEE MTT-S International Microwave Workshop Series on Advanced Materials and Processes for RF and THz Applications (IMWS-AMP), Bochum, Germany, 16–18 July 2019; pp. 103–105. [Google Scholar] [CrossRef]
  80. Basak, S.; Gowda, M. mmspy: Spying phone calls using mmwave radars. In Proceedings of the 2022 IEEE Symposium on Security and Privacy (SP), San Francisco, CA, USA, 22–26 May 2022; IEEE: Piscataway, NJ, USA, 2022; pp. 1211–1228. [Google Scholar]
  81. Omer, A.E.; Shaker, G.; Safavi-Naeini, S.; Murray, K.; Hughson, R. Glucose levels detection using mm-wave radar. IEEE Sens. Lett. 2018, 2, 1–4. [Google Scholar] [CrossRef]
  82. Texas Instruments. Mmwave, Sensor. Available online: https://training.ti.com/contactless-patient-and-elderly-care-using-mmwave-sensors (accessed on 1 May 2023).
  83. Ahmad, A.; Roh, J.C.; Wang, D.; Dubey, A. Vital signs monitoring of multiple people using a FMCW millimeter-wave sensor. In Proceedings of the 2018 IEEE Radar Conference (RadarConf18), Oklahoma City, OK, USA, 23–27 April 2018; IEEE: Piscataway, NJ, USA, 2018; pp. 1450–1455. [Google Scholar]
  84. Zhang, R.; Cao, S. Real-time human motion behavior detection via CNN using mmWave radar. IEEE Sens. Lett. 2018, 3, 1–4. [Google Scholar] [CrossRef]
  85. Jin, F.; Zhang, R.; Sengupta, A.; Cao, S.; Hariri, S.; Agarwal, N.K.; Agarwal, S.K. Multiple patients behavior detection in real-time using mmWave radar and deep CNNs. In Proceedings of the 2019 IEEE Radar Conference (RadarConf), Boston, MA, USA, 22–26 April 2019; IEEE: Piscataway, NJ, USA, 2019; pp. 1–6. [Google Scholar]
  86. Sengupta, A.; Jin, F.; Zhang, R.; Cao, S. mm-Pose: Real-time human skeletal posture estimation using mmWave radars and CNNs. IEEE Sens. J. 2020, 20, 10032–10044. [Google Scholar] [CrossRef]
  87. Tiwari, G.; Gupta, S. An mmWave radar based real-time contactless fitness tracker using deep CNNs. IEEE Sens. J. 2021, 21, 17262–17270. [Google Scholar] [CrossRef]
  88. Tiwari, G.; Bajaj, P.; Gupta, S. mmFiT: Contactless Fitness Tracker Using mmWave Radar and Edge Computing Enabled Deep Learning. IEEE Internet Things J. 2021, XX, 1–8. [Google Scholar]
  89. Yang, Z.; Pathak, P.H.; Zeng, Y.; Liran, X.; Mohapatra, P. Vital sign and sleep monitoring using millimeter wave. ACM Trans. Sens. Netw. TOSN 2017, 13, 1–32. [Google Scholar] [CrossRef]
  90. Arab, H.; Chioukh, L.; Ardakani, M.D.; Dufour, S.; Tatu, S.O. Early-stage detection of melanoma skin cancer using contactless millimeter-wave sensors. IEEE Sensors J. 2020, 20, 7310–7317. [Google Scholar] [CrossRef]
  91. Wen, L.; Dong, S.; Zhang, Z.; Gu, C.; Mao, J. Noninvasive Continuous Blood Pressure Monitoring Based on Wearable Radar Sensor with Preliminary Clinical Validation. In Proceedings of the 2022 IEEE/MTT-S International Microwave Symposium–IMS 2022, Denver, CO, USA, 19–24 June 2022; pp. 707–710. [Google Scholar] [CrossRef]
  92. Shi, J.; Lee, K. Systolic blood pressure measurement algorithm with mmWave radar sensor. KSII Trans. Internet Inf. Syst. TIIS 2022, 16, 1209–1223. [Google Scholar]
  93. Hu, Y.; Toda, T. Remote Vital Signs Measurement of Indoor Walking Persons Using mm-Wave FMCW Radar. IEEE Access 2022, 10, 78219–78230. [Google Scholar] [CrossRef]
  94. Wu, J.; Dahnoun, N. A health monitoring system with posture estimation and heart rate detection based on millimeter-wave radar. Microprocess. Microsyst. 2022, 94, 104670. [Google Scholar] [CrossRef]
  95. Ran, Y.; Zhang, D.; Chen, J.; Hu, Y.; Chen, Y. Contactless Blood Pressure Monitoring with mmWave Radar. In Proceedings of the GLOBECOM 2022–2022 IEEE Global Communications Conference, Rio de Janeiro, Brazil, 4–8 December 2022; pp. 541–546. [Google Scholar] [CrossRef]
  96. Antolinos, E.; García-Rial, F.; Hernández, C.; Montesano, D.; Godino-Llorente, J.I.; Grajal, J. Cardiopulmonary activity monitoring using millimeter wave radars. Remote Sens. 2020, 12, 2265. [Google Scholar] [CrossRef]
  97. Xu, X.; Zhang, D.; Chen, J.; Wu, Z.; Sun, Q.; Chen, Y. Contactless GSR Sensing Using mmWave Radar. IEEE Sens. J. 2022, 22, 24264–24275. [Google Scholar] [CrossRef]
  98. Gupta, K.; Srinivas, M.; Soumya, J.; Pandey, O.J.; Cenkeramaddi, L.R. Automatic Contact-less Monitoring of Breathing Rate and Heart Rate utilizing the Fusion of mmWave Radar and Camera Steering System. IEEE Sens. J. 2022, 22, 22179–22191. [Google Scholar] [CrossRef]
  99. Texas Instruments. Robotic Applications. Available online: https://www.ti.com/lit/wp/spry311a/spry311a.pdf?ts=1674551319819 (accessed on 23 January 2022).
  100. TIsafe, M. Safe Robots. Available online: https://training.ti.com/autonomous-robotics-using-ti-mmwave-sensors?context=1128486-1139156-1147844 (accessed on 23 December 2022).
  101. Texas Instruments. 360mmwave Radar Sensor. Available online: https://training.ti.com/360-degree-safety-bubble-robotics-using-ti-mmwave-sensors?context=1128486-1139156-1147582 (accessed on 1 May 2023).
  102. Texas Instruments. Intelligent, Aop. Available online: https://training.ti.com/intelligent-robotics-ti-mmwave-aop-sensors?context=1128486-1139156-1138090 (accessed on 1 May 2022).
  103. Zhao, P.; Lu, C.X.; Wang, B.; Chen, C.; Xie, L.; Wang, M.; Trigoni, N.; Markham, A. Heart Rate Sensing with a Robot Mounted mmWave Radar. In Proceedings of the 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, France, 31 May 2020–31 August 2020; pp. 2812–2818. [Google Scholar] [CrossRef]
  104. Texas Instruments. Safe Guard Robots. Available online: https://training.ti.com/safety-guards-industrial-robots?context=1128486-1139156-1146381 (accessed on 31 December 2022).
  105. Luukanen, A.; Appleby, R.; Kemp, M.; Salmon, N. Millimeter-wave and terahertz imaging in security applications. In Terahertz Spectroscopy and Imaging; Springer: Berlin/Heidelberg, Germany, 2012; pp. 491–520. [Google Scholar]
  106. Rai, P.K.; Idsøe, H.; Yakkati, R.R.; Kumar, A.; Khan, M.Z.A.; Yalavarthy, P.K.; Cenkeramaddi, L.R. Localization and activity classification of unmanned aerial vehicle using mmWave FMCW radars. IEEE Sens. J. 2021, 21, 16043–16053. [Google Scholar] [CrossRef]
  107. Wenger, J. Automotive radar-status and perspectives. In Proceedings of the IEEE Compound Semiconductor Integrated Circuit Symposium, CSIC’05, Palm Springs, CA, USA, 30 October 2005–2 November 2005; IEEE: Piscataway, NJ, USA, 2005; p. 4. [Google Scholar]
  108. Caris, M.; Stanko, S.; Palm, S.; Sommer, R.; Pohl, N. Synthetic aperture radar at millimeter wavelength for UAV surveillance applications. In Proceedings of the 2015 IEEE 1st International Forum on Research and Technologies for Society and Industry Leveraging a better tomorrow (RTSI), Turin, Italy, 16–18 September 2015; IEEE: Piscataway, NJ, USA, 2015; pp. 349–352. [Google Scholar]
  109. Sheen, D.; McMakin, D.; Hall, T. Three-dimensional millimeter-wave imaging for concealed weapon detection. IEEE Trans. Microw. Theory Tech. 2001, 49, 1581–1592. [Google Scholar] [CrossRef]
  110. Jin, F.; Sengupta, A.; Cao, S.; Wu, Y.J. Mmwave radar point cloud segmentation using gmm in multimodal traffic monitoring. In Proceedings of the 2020 IEEE International Radar Conference (RADAR), Washington, DC, USA, 28–30 April 2020; IEEE: Piscataway, NJ, USA, 2020; pp. 732–737. [Google Scholar]
  111. Ninos, A.; Hasch, J.; Heizmann, M.; Zwick, T. Radar-Based Robust People Tracking and Consumer Applications. IEEE Sens. J. 2022, 22, 3726–3735. [Google Scholar] [CrossRef]
  112. Guo, Y.; Wang, Z.; Li, M.; Liu, Q. Machine learning based mmWave channel tracking in vehicular scenario. In Proceedings of the 2019 IEEE International Conference on Communications Workshops (ICC Workshops), Shanghai, China, 20–24 May 2019; IEEE: Piscataway, NJ, USA, 2019; pp. 1–6. [Google Scholar]
  113. Texas Instruments. Traffic, Mmwave. Available online: https://www.ti.com/lit/wp/spyy002b/spyy002b.pdf?ts=1674394540230&ref_url=https%253A%252F%252Fwww.ti.com%252Fsensors%252Fmmwave-radar%252Findustrial%252Foverview.html (accessed on 1 May 2022).
  114. Migliaccio, C.; Nguyen, B.; Pichot, C.; Yonemoto, N.; Yamamoto, K.; Yamada, K.; Nasui, H.; Mayer, W.; Gronau, A.; Menzel, W. Millimeter-wave radar for rescue helicopters. In Proceedings of the 2006 9th International Conference on Control, Automation, Robotics and Vision, Singapore, 5–8 December 2006; IEEE: Piscataway, NJ, USA, 2006; pp. 1–6. [Google Scholar]
  115. Hagelen, M.; Briese, G.; Essen, H.; Bertuch, T.; Knott, P.; Tessmann, A. A millimetrewave landing aid approach for helicopters under brown-out conditions. In Proceedings of the 2008 IEEE Radar Conference, Rome, Italy, 26–30 May 2008; pp. 1–4. [Google Scholar] [CrossRef]
  116. Feil, P.; Kraus, T.; Menzel, W. Short range mm-wave SAR for surveillance and security applications. In Proceedings of the 8th European Conference on Synthetic Aperture Radar, Aachen, Germany, 7–10 June 2010; VDE: Berlin, Germany, 2010; pp. 1–4. [Google Scholar]
  117. Menzel, W. Millimeter-wave radar for civil applications. In Proceedings of the The 7th European Radar Conference, Paris, France, 30 September–1 October 2010; IEEE: Piscataway, NJ, USA, 2020; pp. 89–92. [Google Scholar]
  118. Andrews, D.A.; Harmer, S.W.; Bowring, N.J.; Rezgui, N.D.; Southgate, M.J. Active millimeter wave sensor for standoff concealed threat detection. IEEE Sens. J. 2013, 13, 4948–4954. [Google Scholar] [CrossRef]
  119. Will, C.; Vaishnav, P.; Chakraborty, A.; Santra, A. Human target detection, tracking, and classification using 24-GHz FMCW radar. IEEE Sens. J. 2019, 19, 7283–7299. [Google Scholar] [CrossRef]
  120. Guerra, A.; Dardari, D.; Djurić, P.M. Dynamic radar network of UAVs: A joint navigation and tracking approach. IEEE Access 2020, 8, 116454–116469. [Google Scholar] [CrossRef]
  121. Almalioglu, Y.; Turan, M.; Lu, C.X.; Trigoni, N.; Markham, A. Milli-RIO: Ego-motion estimation with low-cost millimetre-wave radar. IEEE Sens. J. 2020, 21, 3314–3323. [Google Scholar] [CrossRef]
  122. Ding, W.; Cao, Z.; Zhang, J.; Chen, R.; Guo, X.; Wang, G. Radar-based 3D human skeleton estimation by kinematic constrained learning. IEEE Sens. J. 2021, 21, 23174–23184. [Google Scholar] [CrossRef]
  123. Li, W.; Chen, R.; Wu, Y.; Zhou, H. Indoor Positioning System Using a Single-Chip Millimeter Wave Radar. IEEE Sens. J. 2023, 23, 5232–5242. [Google Scholar] [CrossRef]
  124. Texas Instruments. Power Line Communication Using TI mmWave Sensors. Available online: https://www.ti.com/lit/wp/slyy038/slyy038.pdf (accessed on 26 October 2023).
  125. Navtech Debris Detection Using Navtech Radar Sensor. Available online: https://navtechradar.com/explore/debris-detection/ (accessed on 26 October 2023).
  126. Ezuma, M.; Ozdemir, O.; Anjinappa, C.K.; Gulzar, W.A.; Guvenc, I. Micro-UAV detection with a low-grazing angle millimeter wave radar. In Proceedings of the 2019 IEEE Radio and Wireless Symposium (RWS), Orlando, FL, USA, 20–23 January 2019; IEEE: Piscataway, NJ, USA, 2019; pp. 1–4. [Google Scholar]
  127. Rahman, S.; Robertson, D.A. Radar micro-Doppler signatures of drones and birds at K-band and W-band. Sci. Rep. 2018, 8, 1–11. [Google Scholar] [CrossRef] [PubMed]
  128. Pardhasaradhi, B.; Cenkeramaddi, L.R. GPS spoofing detection and mitigation for drones using distributed radar tracking and fusion. IEEE Sens. J. 2022, 22, 11122–11134. [Google Scholar] [CrossRef]
  129. Liu, C.; Zhao, Q.; Zhang, Y.; Tan, K. Runway extraction in low visibility conditions based on sensor fusion method. IEEE Sens. J. 2014, 14, 1980–1987. [Google Scholar]
  130. Sabery, S.M.; Bystrov, A.; Gardner, P.; Stroescu, A.; Gashinova, M. Road Surface Classification Based on Radar Imaging Using Convolutional Neural Network. IEEE Sens. J. 2021, 21, 18725–18732. [Google Scholar] [CrossRef]
  131. Alanazi, M.A.; Alhazmi, A.K.; Yakopcic, C.; Chodavarapu, V.P. Machine learning models for human fall detection using millimeter wave sensor. In Proceedings of the 2021 55th Annual Conference on Information Sciences and Systems (CISS), Baltimore, MD, USA, 24–26 March 2021; IEEE: Piscataway, NJ, USA, 2021; pp. 1–5. [Google Scholar]
  132. Lien, J.; Gillian, N.; Karagozler, M.E.; Amihood, P.; Schwesig, C.; Olson, E.; Raja, H.; Poupyrev, I. Soli: Ubiquitous gesture sensing with millimeter wave radar. ACM Trans. Graph. TOG 2016, 35, 1–19. [Google Scholar] [CrossRef]
  133. Liu, Y.; Wang, Y.; Liu, H.; Zhou, A.; Liu, J.; Yang, N. Long-range gesture recognition using millimeter wave radar. In Proceedings of the Green, Pervasive, and Cloud Computing: 15th International Conference, GPC 2020, Xi’an, China, 13–15 November 2020; Springer: Berlin/Heidelberg, Germany, 2020; pp. 30–44. [Google Scholar]
  134. Ninos, A.; Hasch, J.; Zwick, T. Real-time macro gesture recognition using efficient empirical feature extraction with millimeter-wave technology. IEEE Sens. J. 2021, 21, 15161–15170. [Google Scholar] [CrossRef]
  135. Zhao, M.; Li, T.; Abu Alsheikh, M.; Tian, Y.; Zhao, H.; Torralba, A.; Katabi, D. Through-wall human pose estimation using radio signals. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 18–22 June 2018; pp. 7356–7365. [Google Scholar]
  136. Tahir, N.; Brooker, G. Toward the development of millimeter wave harmonic sensors for tracking small insects. IEEE Sens. J. 2015, 15, 5669–5676. [Google Scholar] [CrossRef]
  137. Lim, H.S.; Jung, J.; Lee, J.E.; Park, H.M.; Lee, S. DNN-based human face classification using 61 GHz FMCW radar sensor. IEEE Sens. J. 2020, 20, 12217–12224. [Google Scholar] [CrossRef]
  138. Gong, P.; Wang, C.; Zhang, L. Mmpoint-GNN: Graph neural network with dynamic edges for human activity recognition through a millimeter-wave radar. In Proceedings of the 2021 International Joint Conference on Neural Networks (IJCNN), Shenzhen, China, 18–22 July 2021; IEEE: Piscataway, NJ, USA, 2021; pp. 1–7. [Google Scholar]
  139. Brooker, G.M.; Scheding, S.; Bishop, M.V.; Hennessy, R.C. Development and application of millimeter wave radar sensors for underground mining. IEEE Sens. J. 2005, 5, 1270–1280. [Google Scholar] [CrossRef]
  140. Chen, W.; Feng, Y.; Cardamis, M.; Jiang, C.; Song, W.; Ghannoum, O.; Hu, W. Soil moisture sensing with mmWave radar. In Proceedings of the Proceedings of the 6th ACM Workshop on Millimeter-Wave and Terahertz Networks and Sensing Systems, Sydney, NSW, Australia, 17 October 2022; pp. 19–24.
  141. Zhang, Z.; Meng, W.; Song, M.; Liu, Y.; Zhao, Y.; Feng, X.; Li, F. Application of multi-angle millimeter-wave radar detection in human motion behavior and micro-action recognition. Meas. Sci. Technol. 2022, 33, 105107. [Google Scholar] [CrossRef]
  142. Liu, T.; Gao, M.; Lin, F.; Wang, C.; Ba, Z.; Han, J.; Xu, W.; Ren, K. Wavoice: A noise-resistant multi-modal speech recognition system fusing mmwave and audio signals. In Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems, Coimbra, Portugal, 15–17 November 2021; pp. 97–110. [Google Scholar]
  143. Wang, L.; Tang, J.; Liao, Q. A study on radar target detection based on deep neural networks. IEEE Sens. Lett. 2019, 3, 1–4. [Google Scholar] [CrossRef]
  144. Nabati, R.; Qi, H. Rrpn: Radar region proposal network for object detection in autonomous vehicles. In Proceedings of the 2019 IEEE International Conference on Image Processing (ICIP), Taipei, Taiwan, 22–25 September 2019; IEEE: Piscataway, NJ, USA, 2019; pp. 3093–3097. [Google Scholar]
  145. Gao, X.; Xing, G.; Roy, S.; Liu, H. Ramp-cnn: A novel neural network for enhanced automotive radar object recognition. IEEE Sens. J. 2020, 21, 5119–5132. [Google Scholar] [CrossRef]
  146. Heuel, S.; Rohling, H. Two-stage pedestrian classification in automotive radar systems. In Proceedings of the 2011 12th International Radar Symposium (IRS), Leipzig, Germany, 7–9 September 2011; IEEE: Piscataway, NJ, USA, 2011; pp. 477–484. [Google Scholar]
  147. Patel, K.; Rambach, K.; Visentin, T.; Rusev, D.; Pfeiffer, M.; Yang, B. Deep learning-based object classification on automotive radar spectra. In Proceedings of the 2019 IEEE Radar Conference (RadarConf), Boston, MA, USA, 22–26 April 2019; IEEE: Piscataway, NJ, USA, 2019; pp. 1–6. [Google Scholar]
  148. Schumann, O.; Hahn, M.; Dickmann, J.; Wöhler, C. Semantic segmentation on radar point clouds. In Proceedings of the 2018 21st International Conference on Information Fusion (FUSION), Cambridge, UK, 10–13 July 2018; IEEE: Piscataway, NJ, USA, 2018; pp. 2179–2186. [Google Scholar]
  149. Gupta, S.; Rai, P.K.; Kumar, A.; Yalavarthy, P.K.; Cenkeramaddi, L.R. Target classification by mmWave FMCW radars using machine learning on range-angle images. IEEE Sens. J. 2021, 21, 19993–20001. [Google Scholar] [CrossRef]
  150. Bhatia, J.; Dayal, A.; Jha, A.; Vishvakarma, S.K.; Joshi, S.; Srinivas, M.; Yalavarthy, P.K.; Kumar, A.; Lalitha, V.; Koorapati, S.; et al. Classification of targets using statistical features from range fft of mmwave fmcw radars. Electronics 2021, 10, 1965. [Google Scholar] [CrossRef]
  151. Angelov, A.; Robertson, A.; Murray-Smith, R.; Fioranelli, F. Practical classification of different moving targets using automotive radar and deep neural networks. IET Radar Sonar Navig. 2018, 12, 1082–1089. [Google Scholar] [CrossRef]
  152. Huang, X.; Ding, J.; Liang, D.; Wen, L. Multi-person recognition using separated micro-Doppler signatures. IEEE Sens. J. 2020, 20, 6605–6611. [Google Scholar] [CrossRef]
  153. Nishio, T.; Okamoto, H.; Nakashima, K.; Koda, Y.; Yamamoto, K.; Morikura, M.; Asai, Y.; Miyatake, R. Proactive received power prediction using machine learning and depth images for mmWave networks. IEEE J. Sel. Areas Commun. 2019, 37, 2413–2427. [Google Scholar] [CrossRef]
  154. Arab, H.; Ghaffari, I.; Chioukh, L.; Tatu, S.; Dufour, S. Machine learning based object classification and identification scheme using an embedded millimeter-wave radar sensor. Sensors 2021, 21, 4291. [Google Scholar] [CrossRef]
Figure 1. Architecture of the mmWave radar sensor.
Figure 1. Architecture of the mmWave radar sensor.
Sensors 23 08901 g001
Figure 2. (a) IF signal and (b) chirp frame [12].
Figure 2. (a) IF signal and (b) chirp frame [12].
Sensors 23 08901 g002
Figure 3. (a) Two antennas are required to estimate AoA and (b) maximum angular field of view [12].
Figure 3. (a) Two antennas are required to estimate AoA and (b) maximum angular field of view [12].
Sensors 23 08901 g003
Figure 4. (a) Range profile and (b) range–Doppler heatmap.
Figure 4. (a) Range profile and (b) range–Doppler heatmap.
Sensors 23 08901 g004
Figure 5. (a) Range–azimuth heatmap and (b) 3D scatter plot.
Figure 5. (a) Range–azimuth heatmap and (b) 3D scatter plot.
Sensors 23 08901 g005
Figure 6. Applications of mmWave radar sensing.
Figure 6. Applications of mmWave radar sensing.
Sensors 23 08901 g006
Figure 7. Advanced driver-assistance system [57].
Figure 7. Advanced driver-assistance system [57].
Sensors 23 08901 g007
Figure 8. Width measurement in a cold and hot rolling mill [74].
Figure 8. Width measurement in a cold and hot rolling mill [74].
Sensors 23 08901 g008
Figure 9. Contactless patient monitoring application [82].
Figure 9. Contactless patient monitoring application [82].
Sensors 23 08901 g009
Figure 10. Robotics application [100].
Figure 10. Robotics application [100].
Sensors 23 08901 g010
Figure 11. Traffic monitoring application [113].
Figure 11. Traffic monitoring application [113].
Sensors 23 08901 g011
Figure 12. Power line communication [124].
Figure 12. Power line communication [124].
Sensors 23 08901 g012
Figure 13. Debris detection on airport runways [125].
Figure 13. Debris detection on airport runways [125].
Sensors 23 08901 g013
Table 1. Operational frequencies within the bandwidth spectrum.
Table 1. Operational frequencies within the bandwidth spectrum.
Working Band (GHz)Bandwidth (GHz)Resolution
24 0.25 GHz60 cm
774 GHz 3.75 cm
607 GHz 2.1 cm
942 GHz 7.5 cm
1009 GHz 1.6 cm
30040 GHz 0.375 cm
30020 GHz 0.75 cm
Table 2. Comparison of our work with earlier review articles.
Table 2. Comparison of our work with earlier review articles.
ReferenceYearFocus AreaSPMIApplPMML/DL Tech.Comments
[6]2011Different mmWave technology specificationsRestricted to limited technologies and data processing
[7]2017Focus on architecture, estimation techniquesRestricted to advanced driver assistance system
[4]2019Review of digital modulation and interference mitigation methodsRestricted to automated driving technology
[5]2020Working principles of vision sensors and performance parameters for autonomous systemsRestricted to autonomous systems
[8]2021Uses deep learning and fusion modelsDeep fusion operations and datasets need to be improved
[3]2022To determine working principles, data representation methods, and challengesRestricted to detection applications
[1]2022On various on-board sensors, hardware components, software environments, and machine learning algorithmsRestricted to unmanned aerial vehicle applications
Our Work2022Performance metrics of mmWave radar, state-of-the-art mmWave radar models available on the market, radar data interpretation, applications of mmWave radars, machine learning techniques for mmWave radarConsiders sensing applications using mmWave radar sensor in broad areas of science and engineering
SP—signal processing; MI—measurement interpretation; Appl—applications; PM—performance metrics; ML/DL Tech.—machine learning or deep learning techniques.
Table 3. Performance metrics of mmWave radar.
Table 3. Performance metrics of mmWave radar.
RangeVelocityAngle of arrival
R = ( C ×  f I F )/ 2 S V =  λ   Δ Φ / 4 π T c θ sin (( λ   Δ Φ )/(2 π d))
Range resolutionVelocity resolutionAngle of arrival resolution
dres =  C / 2 B Vres =  λ /(2  T f ) θ res = 2/ N R X
Max rangeMax velocityMax angle of arrival
dmax =  F s C/ 2 S Vmax =  λ /4  T c θ max =  sin (( λ /2 d))
R—target’s range from the radar; V—target’s Velocity; θ —target’s angle of arrival; C—speed of light; S—slope of chirp, B/ T c ; Δ ϕ —phase difference between IF signals; Tf—frame time,  N T C ; B—chirp RF bandwidth; f I F —IF signal frequency; F s —sampling rate of the IF signal; T c —chirp duration time; λ —wavelength of the chirp signal; N—number of chirps; N R X —number of receiving antennas; d—distance between receiving antennas.
Table 4. Suitable mmWave radar types with respect to the applications.
Table 4. Suitable mmWave radar types with respect to the applications.
TypeRange (m)Bandwidth (MHz)Azimuth View Angle (deg.)Elevation View Angle (deg.)Applications
Long-range radar10–250600±15±5Autonomous cruise control
Medium-range radar1–100600±40±5Lane change assistance system, collision mitigation
Short-range radar1–304000±80±10Blind spot detection, parking assistance
Table 5. Popular mmWave radar models and their specifications.
Table 5. Popular mmWave radar models and their specifications.
ReferenceModel NameRange (m)Working Band (GHz)Azimuth Field of View (deg)Elevation Field of View (deg)Chip Memory (MB)User Interface and Connectivity
[13]TI-IWR6843AOPEVM18060 GHz–64GHz±120±1201.75TMMWAVEICBOOST, DCA1000, I2C, LVDS, QSPI, SPI, UART
[14]TI-IWR184318076 GHz–81 GHz100±152CAN, LVDS, QSPI, I2C, SPI, UART, CSI-2
[15]Delphi ESR17476 GHz±10±45-CAN
[16]NavTech CIR204-h20076 GHz–77 GHz360--1 Gbps Ethernet
[17]TI-AWRL643225057 GHz–64 GHz±18-1QSPI, PWM, I2C
[18]BoschLRR325077 GHz30--CAN
[19]Continental ARS408-2125077 GHz±914-CAN 500 kbps
[20]Continental SRR600>18076 GHz–81 GHz±90±40-Ethernet, CAN-FD
[21]TI-AWR1843AOPEVM15076 GHz–81 GHz1401402DCA1000EVM, CAN, CAN-FD
[22]TI-AWR164210076 GHz–81 GHz±60±10   1.5 CAN, CAN-FD, SPI, I2C, UART
[23]TI-IWR164215076 GHz–77 GHz±100±15   1.5 CAN, CAN-FD, QSPI
[24]NXP-TEF810X25076 GHz–81 GHz±18-   1.5 LVDS, CSI2
[25]NXP-SAF85xx25076 GHz–81 GHz±18-   5.5 SGMII Ethernet, dual CAN FD
[26]NXP-TEF82xx25076 GHz–81 GHz±18-   0.576 CSI-2, LVDS
[27]Continental-ARS54030076 GHz–81 GHz±60±601CAN, Ethernet
[23]TI-IWR14436077 GHz–79 GHz±65±15   1.5 LVDS, DCAN, QSPI, CSI2
[28]TI-AWR14436076 GHz–81 GHz±65±15   1.5 LVDS, DCAN, QSPI
[29]TI-IWRL64326057 GHz–64 GHz±65±151I2C, SPI, UART, QSPI
[30]Continental-ARS4-A25077 GHz±75±201CAN, Ethernet
[31]TI-AWR2243BOOST15076 GHz–81 GHz±90±90   1.5 SPI, UART, I2C, CAN-FD
[32]TI-AWR124325076 GHz–81 GHz±60±151SPI, MIPI-CSI2, UART
[33]NXP4D-S32R4530077 GHz±56±561PCIe, Ethernet, CAN-FD
[34]RDK-S32R27420079–81 GHz±30±301Ethernet, CAN-FD
Table 6. Automotive applications using popular radars.
Table 6. Automotive applications using popular radars.
ReferenceYearApplicationRadar Used
[58]1997Intelligent cruise control with collision warningFMCW (76 GHz–77 GHz)
[59]2017Blind spot detection and warning systemAWR1843 (76 GHz–77 GHz)
[60]2017Automated emergency breakingTI-AWR1243 (76 GHz–78 GHz)
[60]2017In-car occupant detectionTI-AWR1642 (76 GHz–81 GHz)
[61]2017Driver vital sign monitoringTI-AWR1642 (77 GHz)
[62]2018Automotive body and chassis sensing applicationsTI-AWR1642 (77 GHz)
[50]2018In-car controlling with gesturesFMCW-mmWave (60 GHz)
[63]2019Automated parking systemTI-AWR1843 (77 GHz)
[64]2020Lane change assistance with obstacle detectionTI-AWR1843AOPEVM (77 GHz)
[65]2020Parking assistance with obstacle detectionTI-AWR1642BOOST (77 GHz–81 GHz)
[66]2020Debris detection for automotive radarmmWave (76 GHz–81 GHz)
[67]2021Automotive vehicle detection in parking lotTI AWR2243BOOST-MIMO (76 GHz–81 GHz)
[65]2022Motor cycle safety and Blind spot detectionTI-AWR1843AOP (76 GHz–81 GHz)
[55]2022Automotive corner radar for cross traffic alertTI-AWR1843EVM (76 GHz–81 GHz)
Table 7. Industrial applications using popular radars.
Table 7. Industrial applications using popular radars.
ReferenceYearApplicationRadar Used
[75]2006Surface sensingmmWave sensor (29.72 GHz–37.7 GHz)
[76]2013Measuring the liquid level and interface sensingmmWave Doppler sensor (77 GHz)
[68]2015Crack detection in ceramic tilesV-Band Imaging Radar (60 GHz)
[69]2017Fluid level sensingTI-IWR1443 (77 GHz)
[77]2018Material classificationFMCW radr with Infineon’s DEMO-BGT60TR24 sensor (60 GHz)
[78]2018Motion detection and intersection monitoringIWR6843 60 GHz radar
[79]2019Foam detection in chemical applicationsIC with mmWave ssensor (80 GHz)
[10]2020Obtaining the performance on detecting vibrational targetsFMCW 80 GHz sensor integrated on SiGe chip
[80]2022Eavesdropping and spying on phone callsTI-AWR1843BOOST (77 GHz)
[70]2022Material identificationTI-IWR1443 FMCW (77 GHz–81 GHz)
Table 8. Medical applications with popular radars.
Table 8. Medical applications with popular radars.
ReferenceYearApplicationRadar Used
[81]2018Blood glucose level detectionFMCW-XENSIV (60 GHz)
[85]2019Multiple patients behavior detectionTI-AWR1642BOOST (77 GHz)
[90]2020Skin cancer detectionDesigned sensor (77 GHz)
[87]2021Contactless fitness trackingTI-IWR1642 (77 GHz–81 GHz)
[82]2022Contactless monitoring of patients and elderly people aloneIWR6843AOPEVM (60 GHz–64 GHz)
[92]2022Measuring systolic blood pressureTI-IWR6843AOP (60 GHz–64 GHz)
[93]2022Vital sign measuringTI-IWR1443 (77 GHz–81 GHz)
[94]2022Health monitoring with posture estimationTI-IWR6843 (60 GHz–64 GHz)
[95]2022Blood pressure monitoringTI-AWR1843 (77 GHz–81 GHz)
[96]2022Cardiorespiratory rate monitoringCommercial FMCW (122 GHz)
[97]2022Galvanic skin test to assess mental acuity and stress levelsTI-AWR1843 (77 GHz)
[98]2022Automated heart rate and breathing rate monitoringTI-AWR1443BOOST (77 GHz)
Table 9. Robotics and automation applications with popular radars.
Table 9. Robotics and automation applications with popular radars.
ReferenceYearApplicationRadar Used
[102]2019Intelligent robot for transparent object sensingIWR6843 (60 GHz)
[103]2020Robot-mounted mmWave radar for tracking heart rateIWR6843 (62 GHz)
[54]2020Predicting autonomous robot navigationFMCW (77 GHz)
[101]2020Collision detection and avoidanceIWR6843 (60 GHz)
[104]2020mmWave radars as safe guard robotsIWR6843 (60 GHz)
[100]2021Automated indoor navigation and path trackingAWR6843 (77 GHz)
[99]2021Glass wall and partition detectionIWR1443BOOSTEVM (77 GHz)
Table 10. Security and surveillance and civilian applications with popular radars.
Table 10. Security and surveillance and civilian applications with popular radars.
ReferenceYearApplicationRadar Used
[114]2006Power line prediction in helicopter rescuemmWave radar (94 GHz)
[115]2008mmWave radars for safe helicopter landingRadar module with 94 GHz
[116]2010Providing indoor security of short rangemmWave SAR (77 GHz)
[117]2010Debris detection on airport runwaysmmWave radar (73 GHz–80 GHz)
[118]2013Concealed threat detectionW-band (75 GHz–110 GHz)
[108]2015Surveillance imaging applicationsMIRANDA radar (35 GHz and 94 GHz)
[113]2018Traffic monitoringIWR1642EVM 77 GHz radar
[119]2019Human target detection, classification, trackingISM band (24 GHz MIMIC)
[120]2020Tracking of malicious and hidden dronesmmWave (77 GHz)
[121]2021Ego-motion estimating in indoor environmentsTI-AWR1843BOOST (76 GHz–81 GHz)
[2]2021Unmanned aircraft system detection and localizationAWR1843 Boost (76 GHz–81 GHz)
[106]2021Aerial vehicle locating and air traffic managementAWR1843 (76 GHz–79 GHz)
[122]20213D human skeletal pose estimationTI-AWR1843 (77 GHz)
[123]2023Indoor positioning systemIWR6843ISK (60 GHz–64 GHz)
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Soumya, A.; Krishna Mohan, C.; Cenkeramaddi, L.R. Recent Advances in mmWave-Radar-Based Sensing, Its Applications, and Machine Learning Techniques: A Review. Sensors 2023, 23, 8901. https://doi.org/10.3390/s23218901

AMA Style

Soumya A, Krishna Mohan C, Cenkeramaddi LR. Recent Advances in mmWave-Radar-Based Sensing, Its Applications, and Machine Learning Techniques: A Review. Sensors. 2023; 23(21):8901. https://doi.org/10.3390/s23218901

Chicago/Turabian Style

Soumya, A., C. Krishna Mohan, and Linga Reddy Cenkeramaddi. 2023. "Recent Advances in mmWave-Radar-Based Sensing, Its Applications, and Machine Learning Techniques: A Review" Sensors 23, no. 21: 8901. https://doi.org/10.3390/s23218901

APA Style

Soumya, A., Krishna Mohan, C., & Cenkeramaddi, L. R. (2023). Recent Advances in mmWave-Radar-Based Sensing, Its Applications, and Machine Learning Techniques: A Review. Sensors, 23(21), 8901. https://doi.org/10.3390/s23218901

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop