ArticlePDF Available

Micro-Doppler Mini-UAV Classification Using Empirical-Mode Decomposition Features

Authors:
  • Seoul National University of Science and Technology

Abstract and Figures

In this letter, we propose an empirical-mode decomposition (EMD)-based method for automatic multicategory mini-unmanned aerial vehicle (UAV) classification. The radar echo signal is first decomposed into a set of oscillating waveforms by EMD. Then, eight statistical and geometrical features are extracted from the oscillating waveforms to capture the phenomenon of blade flashes. After feature normalization and fusion, a nonlinear support vector machine is trained for target class-label prediction. Our empirical results on real measurement of radar signals show encouraging mini-UAV classification accuracy performance.
Content may be subject to copyright.
ACCEPTED VERSION, IEEE GEOSCIENCE AND REMOTE SENSING LETTERS 1
Micro-Doppler mini-UAV Classification Using
Empirical Mode Decomposition Features
Beom-Seok Oh, Xin Guo, Fangyuan Wan, Kar-Ann Toh, Zhiping Lin
Abstract—In this letter, we propose an empirical mode decom-
position (EMD) based method for automatic multi-category mini-
UAV classification. The radar echo signal is firstly decomposed
into a set of oscillating waveforms by EMD. Then, eight statistical
and geometrical features are extracted from the oscillating
waveforms to capture the phenomenon of blade flashes. After
feature normalization and fusion, a nonlinear support vector
machine is trained for target class label prediction. Our empirical
results on real measurement of radar signals show encouraging
mini-UAV classification accuracy performance.
Index Terms—Micro-Doppler Signature, Empirical Mode De-
composition, Unmanned Aerial Vehicle Classification
I. INTRODUCTION
DURING the past decade, both the technology and the
industry of UAV have advanced greatly. The equipment
cost has been significantly lowered while the flying perfor-
mance of UAVs has been largely enhanced. This advancement
enables UAV to be deployed in a wide range of applications
(e.g., parcel delivery). On the other hand, UAVs may form a
threat to security-sensitive areas if they are used for spying,
reconnaissance and even for attack. This is particularly true
since existing mini-sized UAVs are difficult to detect due to
their small size, slow flying speed and low flying altitude. For
those security-sensitive areas, an accurate automatic detection
and classification of mini-UAVs is of particular interest.
The radar technology is widely adopted in surveillance sys-
tems because it has fast remote sensing capabilities regardless
of weather. Among the various signal processing techniques
for radar signals, the micro-Doppler signature (m-DS) [1] is
the most popular choice for mini-UAV classification [2]–[7].
This is because the m-DS extracted from radar echo signals
can capture the unique characteristics of micro-motion induced
by the mini-UAV propeller/rotor blades [5]–[7]. Table I shows
a summary of existing radar m-DS based state-of-the-art mini-
UAV classification methods.
In the two most recent works [6], [7], the authors have
reported very good classification performances. However, al-
though a pre-trained convolutional deep network model is
utilized in [6], collecting a large enough number of labeled
data for deep network tuning is costly. The method proposed
in [7] is for a binary-category problem only and it is not
B.-S. Oh, F. Wan and Z. Lin are with School of Electrical and Electronic
Engineering, Nanyang Technological University, 50 Nanyang Avenue, 639798
Singapore.
X. Guo is with Temasek Laboratories at Nanyang Technological University
(TL@NTU), 50 Nanyang Drive, 637553 Singapore.
K.-A. Toh is with School of Electrical and Electronic Engineering, Yonsei
University, 50 Yonsei-ro, Seodaemun-gu, Seoul, 03722, Republic of Korea.
The authors thank the Thales Nederland for providing the CW radar data.
Corresponding author: ezplin@ntu.edu.sg
TABLE I
EXIST ING WO RKS O N RADAR M-DS BASED MINI-UAV CLASSI FICATION
Authors Main objective Radar m-DS Classification
(year) (Num. of target class) analysis
Molchanov et mini-UAV model/type Spectrogram NBC1, linear &
al. (2014) [2] classification (5 & 11) nonlinear SVM2
Harmanny et mini-UAV type Spectrogram, Maximum a
al. (2015) [3] classification (5) Cepstrogram posteriori
Fioranelli et mini-UAV payloads Spectrogram NBC,
al. (2015) [4] classification (2) DDA3
Torvik et al. Quadcopters vs. birds Radar Nearest neigh-
(2016) [5] classification (4) polarimetry bor classifier
Kim et al. Quadcopter vs. Spectrogram + Convolutional
(2017) [6] hexacopter (2) CVD4neural network
Ren and Jiang mini-UAV vs. birds 2-D complex-log- Subspace reli-
(2017) [7] classification (2) Fourier transform ability analysis
Proposed mini-UAV model EMD Nonlinear
method classification (2 & 11) SVM
1NBC: naive Bayes classifier, 2SVM: support vector machine, 3DDA: diagonal-linear
variant of the discriminant analysis, 4CVD: cadence-velocity diagram.
straightforward to extend to the multi-category problem. Note
that classifying a mini-UAV into its type/model is an important
task as different mini-UAV may form a different level of threat.
Table I also shows that the majority of works in the literature
is relying on the short-time Fourier transform (STFT) analysis
such as spectrogram. We note that many Fourier analysis
based prior arts require signals with a longer dwell time to
capture the desired spectral information. Moreover, the time-
frequency resolution may pose a limitation for the STFT-based
techniques. A simple and yet effective resolution to address
these limitations is to analyze the m-DS using a non-Fourier
time-frequency analysis method. In this work, we propose to
deploy the EMD [8] for the m-DS analysis of mini-UAVs.
The core idea of EMD is to treat the signal as fast oscilla-
tions superimposed on slow oscillations. Essentially, the EMD
decomposes a real-valued univariate signal xRdinto a set
of oscillating waves as: x=L
l=1ml+qL,where mlRdindi-
cates the l-th intrinsic mode function (IMF) and qLRdis a
residue [8]. Each of the obtained IMFs is dominated by certain
frequency components. Different from the STFT analysis, the
frequency band of each IMF is adaptively determined based
on the input signal. Another unique characteristic of the EMD
is that the signal is decomposed locally. Our idea behind using
the EMD for the mini-UAV radar m-DS analysis is to capture
the phenomenon of blade flashes locally and adaptively.
The EMD method has been successfully deployed in a
wide range of applications such as speech signal processing
[9], fault diagnosis [10], electroencephalography analysis [11],
m-DS analysis for classification of large aerial targets (e.g.,
jet-/ propeller-aircraft and helicopter) [12]–[15], and ground
moving vehicle [16]. However, none of the existing works
is on mini-UAV classification. While some EMD analysis
results on mini-UAV echo signals are presented in [17], their
ACCEPTED VERSION, IEEE GEOSCIENCE AND REMOTE SENSING LETTERS 2
analysis is limited to signals measured under indoor condition.
Moreover, no further study on EMD (e.g., feature extraction
and classification) is reported in [17].
Since the radar echo from mini-UAVs is generally much
weaker than that from the large manned aerial vehicles, the
existing EMD-based works [12]–[16] cannot be directly ap-
plied to the mini-UAV classification problem. In [14] and [16],
for example, a few statistical features (e.g., entropy, second
order moment etc.) were respectively extracted from the first
IMF and the sum of the remaining IMFs for classification of
large aerial vehicles and ground moving vehicles. However,
as shown in Figs. 1 and 2, the first IMF of mini-UAVs’
echo contains almost no target information. Our analysis (see
Section II for details) shows that the order of IMF in which
the blade flash responses appear varies over mini-UAV types.
Moreover, the order of blade flash IMF may vary within a
mini-UAV type according to the signal quality.
Motivated by the above observationson the EMD properties
and in view of the lack of study in mini-UAV classification, in
this letter, we propose an EMD based method for mini-UAV
classification. Essentially, a radar echo signal is decomposed
into a set of IMFs using EMD. Eight statistical and geometrical
features, which are designed for label discrimination, are then
respectively extracted from the IMFs. After normalization and
fusion, the extracted features are used to train a nonlinear
SVM classifier for target class label prediction. The main
contributions of this letter can be enumerated as follows:
Proposal of an effective EMD-based method for mini-
UAV classification. Four novel geometrical features are
proposed and extracted together with four conventional
statistical features from a set of IMFs.
Provision of an empirical analysis on radar mini-UAV m-
DS showing the relationships between the spectrogram
and the IMFs in terms of the blade flash phenomenon.
Extraction of three sets of features from a complex-valued
signal using the real-valued EMD, and then fuse them for
mini-UAV classification performance enhancement.
II. MICRO-DOPPLER SIGNATURE ANALYSIS USING EMD
In this section, the effectiveness of using EMD for radar
m-DS analysis is empirically investigated. Particularly, the m-
DS induced by the micro-motion of three types of mini-UAVs
(e.g., helicopter, fixed-wing and quadcopter) is considered.
A physically measured continuous-wave (CW) radar echo
(see Section IV-A for the radar setup) is firstly analyzed
using the STFT which produces a spectrogram, and the EMD
which produces a set of IMFs. Both analysis results are then
compared to each other in terms of the blade flash phenomenon
[1]. The STFT is computed using a sliding Hamming window
of length 28with 90% overlapping.
A. Helicopter type mini-UAV
Fig. 1 shows two sets of a spectrogram and the first four
IMFs, obtained by analyzing the radar signals (of 50ms long)
of a helicopter mini-UAV. In Fig. 1 (a), the spectrogram
obtained using the radar echo of a helicopter mini-UAV with
strong m-DS is shown. In the subplot, the micro-Doppler
spectrum width and blade flashes are clearly visible [1]. Via
0 0.01 0.02 0.03 0.04 0.05
0
0.5
1
Norm. input
0 0.01 0.02 0.03 0.04 0.05
-0.2
0
0.2
IMF1
0 0.01 0.02 0.03 0.04 0.05
-0.2
0
0.2
IMF2
0 0.01 0.02 0.03 0.04 0.05
-0.2
0
0.2
IMF3
0 0.01 0.02 0.03 0.04 0.05
Time (s)
-0.2
0
0.2
IMF4
a b
cd
0 0.01 0.02 0.03 0.04 0.05
0
0.5
1
Norm. input
0 0.01 0.02 0.03 0.04 0.05
-0.2
0
0.2
IMF1
0 0.01 0.02 0.03 0.04 0.05
-0.2
0
0.2
IMF2
0 0.01 0.02 0.03 0.04 0.05
-0.2
0
0.2
IMF3
0 0.01 0.02 0.03 0.04 0.05
Time (s)
-0.2
0
0.2
IMF4
Micro-Doppler Signature (dB): Helicopter
0.005 0.01 0.015 0.02 0.025 0.03 0.035 0.04 0.045
Time (s)
-20
-15
-10
-5
0
5
10
15
20
Doppler (KHz)
-60
-55
-50
-45
-40
-35
-30
-25
-20
Micro-Doppler Signature (dB): Helicopter
0.005 0.01 0.015 0.02 0.025 0.03 0.035 0.04 0.045
Time (s)
-20
-15
-10
-5
0
5
10
15
20
Doppler (KHz)
-60
-55
-50
-45
-40
-35
-30
-25
-20
Fig. 1. Two sets of a spectrogram and the first four IMFs obtained using a
measurement radar signal ((a) and (c)) with strong m-DS and ((b) and (d))
with weak m-DS (due to different angle of viewing) of a helicopter mini-UAV.
a simple analysis on the blade flashes [18], several physical
mini-UAV parameters namely, the number of blades and its
length, blade tip velocity, rotation rate and blade symmetry,
can be retrieved from the subplot. It should be noted here
that, however, such information can be retrieved with a certain
accuracy only when the m-DS is strong enough. For example,
the spectrogram shown in Fig. 1 (b) is computed using a radar
signal of the same mini-UAV model, but with weak m-DS due
to different angle of viewing the mini-UAV(e.g., the rotor mast
of the helicopter mini-UAV was nearly parallel to the radar
line of sight). The mini-UAV parameters retrieved in Fig. 1
(b) might be totally different from those in Fig. 1 (a).
Different from the spectrogram, the IMFs do not possess
physical-parameter-specific information. The EMD instead
captures existence of blade flashes with time information. Fig.
1 (c) and (d) respectively show the first four IMFs obtained
from the two radar signals used to compute the spectrograms
shown in Fig. 1 (a) and (b). As shown in Fig. 1 (c), the first
IMF (IMF1) oscillates with an almost constant variance over
time. On the other hand, the local amplitude of IMF2 changes
significantly at certain time points. By synchronizing such
amplitude patterns with the spectrogram shown in Fig. 1 (a), it
is observed that those blade flashes captured by EMD appear
as high amplitude with a small number of zero-crossings
within a certain IMF (e.g., IMF2 of Fig. 1 (c)). Even for the
weak m-DS as shown in Fig. 1 (d), the IMF3 still contains
such blade flash patterns which are useful for classification.
B. Fixed-wing type and Quadcopter type mini-UAVs
We now consider two different types of mini-UAV, namely
a fixed-wing type (see Fig. 2 (a) and (c)) and a quadcopter
type (Fig. 2 (b) and (d)). Due to space constraint, only radar
signals with strong m-DS are shown here. Similar to those
IMFs shown in Fig. 1 (c), the blade flashes induced by these
two mini-UAV types appear at IMF4 (see Fig. 2 (c)) and
at IMF3 (see Fig. 2 (d)), respectively. The main reason for
observing such responses from different orders of IMF is
due to different characteristics of rotor blades. For example,
in general, the main rotor blades of a helicopter mini-UAV
are much longer and wider than that of a fixed-wing and
a quadcopter mini-UAV. Such physical differences in blades
ACCEPTED VERSION, IEEE GEOSCIENCE AND REMOTE SENSING LETTERS 3
a b
cd
0 0.01 0.02 0.03 0.04 0.05
0
0.5
1
Norm. input
0 0.01 0.02 0.03 0.04 0.05
-0.05
0
0.05
IMF1
0 0.01 0.02 0.03 0.04 0.05
-0.05
0
0.05
IMF2
0 0.01 0.02 0.03 0.04 0.05
-0.05
0
0.05
IMF3
0 0.01 0.02 0.03 0.04 0.05
Time (s)
-0.05
0
0.05
IMF4
0 0.01 0.02 0.03 0.04 0.05
0
0.5
1
Norm. input
0 0.01 0.02 0.03 0.04 0.05
-0.05
0
0.05
IMF1
0 0.01 0.02 0.03 0.04 0.05
-0.05
0
0.05
IMF2
0 0.01 0.02 0.03 0.04 0.05
-0.05
0
0.05
IMF3
0 0.01 0.02 0.03 0.04 0.05
Time (s)
-0.05
0
0.05
IMF4
Micro-Doppler Signature (dB): Plane
0.005 0.01 0.015 0.02 0.025 0.03 0.035 0.04 0.045
Time (s)
-20
-15
-10
-5
0
5
10
15
20
Doppler (KHz)
-60
-55
-50
-45
-40
-35
-30
-25
-20
Fig. 2. Two sets of a spectrogram and the first four IMFs obtained using a
measurement radar signal of ((a) and (c)) a fixed-wing mini-UAV and ((b)
and (d)) a quadcopter mini-UAV.
affect the return signals, and thus micro-Doppler frequency.
This is an important property for mini-UAV classification.
III. PROPOSED METHOD FOR MINI-UAV CLASSIFICATION
We have empirically shown in Section II that the EMD can
effectively capture the unique patterns of m-DS induced by the
micro-motion of mini-UAV blades. To extract and utilize such
unique information for mini-UAV classification, in this section,
we propose to extract eight statistical and geometrical features
from the obtained IMFs. After normalization and fusion, the
obtained features are used to train a nonlinear SVM classifier.
A. Features extraction from IMFs and Normalization
Let siCd,i=1,···,m,denotes the i-th univariate radar
signal, where mindicates the total number of training samples.
Since siis complex-valued, it is firstly converted to a real-
valued signal xi=|si| ∈ Rd,where |·| indicates the magnitude
function. The EMD decomposes xiinto Lnumber of IMFs
mi
land a residue qi
L. For simplicity, mi
lwill be denoted as ml
hereafter unless otherwise specified. The number of resulted
IMFs, L, varies according to the frequency contents contained
in the signal xi. In this work, only the first K<LIMFs are
used for extraction of the eight features listed in Table II.
Features 1 to 4are the conventional statistical features
adopted from the literature while Features 5 to 8are geomet-
rical features newly proposed in this work. Features 6 and 7
are designed to geometrically capture the blade flash responses
(see Fig. 1 (c) and (d)) within the IMFs while Features 5
and 8are for capturing geometrical relationships between two
consecutive IMFs. These new features are chosen because the
blade flash response and its geometrical relationship informa-
tion cannot be found in the literature.
The extracted eight feature vectors are subsequently con-
catenated: fi=fT
i,1,fT
i,2,···,fT
i,8TR8K2,and then stacked
into a matrix form: FMag = [f1,f2,···,fm]R(8K2)×m. For
the subsequent classification process, each row vector of FMag
is normalized to within the range of [0,1]using the min-max
normalization technique. Since the test data is not available
beforehand, its features can only be normalized with respect
to the min and max values of the training features.
B. Feature level fusion of the EMD features
It is observed from our preliminary results that the infor-
mation contained in the eight features may not be enough
to produce a good accuracy performance. Particularly, feature
vector fiR8K2extracted at K=6 and from a 50ms
signal xiR4,800, is just of 46 dimension. To enhance the
classification accuracy performance, we propose to extract
two more sets of the eight features namely, FReal from
Real(si)and FImag from Imaginary(si), together with FMag
extracted from |si|. The fused feature is defined as follows:
FFusion = [(FMag)T,(FReal )T,(FImag)T]TR3(8K2)×m.
C. Mini-UAV classification using the RBF-SVM classifier
The extracted feature matrix, FMag or FFusion, is then used
to train the SVM with a nonlinear radial basis function (RBF)
kernel. To handle the multi-categories, the SVM is trained
with the one-vs-all learning scheme. This nonlinear SVM
classifier is adopted due to its strong theoretical foundations
with guaranteed reliable classification performance. Due to
space constraint, we refer to [20] for more details on the SVM.
IV. EXPERIMENTS
The main goal of this study is to empirically verify the effec-
tiveness of the proposed method for mini-UAV classification.
To achieve this goal, a set of real radar signals returned from
11 objects, is utilized in this experimental study. The resulted
accuracy performance is then compared with that of competing
state-of-the-arts. The following subsections provide the details
of our dataset, experimental setup and results.
A. Dataset and Preprocessing
As shown in Table III, the dataset consists of eleven object
models including six commercial mini-UAVs. This dataset,
provided by Thales Nederland, was collected at outdoors
using an X-band CW radar (9.7GHz radio frequency, 192KHz
sampling rate). A horn antenna was manually adjusted towards
the nearby target object (see the fourth column of Table III
for the distance range between the radar and target object).
The radar signal is decimated by a factor of two to reduce
the sampling rate to 96KHz. The identified valid signals are
then divided into non-overlapping segments of {20, 30, ···,
100}ms long (a.k.a. dwell time) similar to that in [2]. This is
to observe the relationship among the dwell time, the accuracy
performance and the number of IMFs, K. In [2], Molchanov
et al.’s method, which was STFT-based, worked well only
for segments with longer dwell time (>100ms). Since our
proposed method is non-Fourier based, we are particularly
interested in investigating the shortest possible working range
for the dwell time. Through this range study, the relationship
between the minimum number of IMFs Kand the dwell time
can be explored. In field application, a proper value for the
dwell time can be found based on a cross-validation test using
the accumulated training data.
B. Evaluation of the proposed method (11-category problem)
1) Experimental setup: The main objective here is to clas-
sify an unseen test sample into one of the eleven categories
shown in Table III. The proposed method has two adjustable
ACCEPTED VERSION, IEEE GEOSCIENCE AND REMOTE SENSING LETTERS 4
TABLE II
THE EIG HT S TATIST ICAL (FEATURES 1TO 4) AN D GEOMETRICAL (FEATURES 5TO 8) FEATURES TO BE EXTRACTED FROM IMFS,mlWHERE l=1,··· ,K
No. Brief description Feature Details / Note
1 Number of zero crossing [19] fi,1= [Z1,··· ,ZK]TRKZl=d
n=2|sign[ml(n)] sign [ml(n1)]|,sign[ml(n)] = 1
if ml(n)0, otherwise 1. ml= [ml(1),··· ,ml(d)]T
2 Normalized signal energy [10], [16] fi,2= [E1/E,··· ,EK/E]TRKEl=d
n=1|ml(n)|2is the signal energy of ml,E=K
l=1El
3 Standard deviation [20] fi,3= [std (m1),··· ,std (mK)]TRKstd(m)returns the standard deviation of m
4 Entropy (see chapter 11 of [21]) fi,4= [En (m1),··· ,En(mK)]TRKEn(ml) = P(ml)log2P(ml)and P(·)returns
the histogram counts of mlwith 256 bins
5 Entropy of two concatenated IMFs fi,5=En(m
1),··· ,En m
K1TRK1m
l=mT
l,mT
l+1T: a concatenation of two consecutive IMFs
6 Normalized max-mean difference fi,6= [D1,··· ,DK]TRKDl=max
γ
(ml)mean(ml>0)
max
γ
(ml),max
γ
(ml)returns the
γ
-th maxi-
mum value of ml, and mean(·)denotes the mean function.
The
γ
is used to remove exceptional outliers
7 Distance between two fi,7= [P1,··· ,PK]TRKPl=|argmax(Fl)d/22
d,Fl=
f=|Ml(f)|2,and
frequency peaks Ml(f)indicates the Fourier transform of ml(n)
8 Ratio of zero-crossing number Zlfi,8= [Z2/Z1,··· ,ZK/ZK1]TRK1Refer to Feature 1 for details of Zl
TABLE III
SPECIFICATIONS OF THE R EAL MEASUREMENT DATASET
No. Target Target Distance range Num. segments
object name object type to the target(50ms long)
1 Birds non-UAV 5m–50m 1,129
2 Yak54 Fixed-wing 20m–150m 1,480
3 EasyStar 780
4 T-REX450 1,759
5 Logo 400 Helicopter 20m–70m 1,141
6 Logo 600 717
7 Parrot 2.0 Quadcopter 3m–20m 3,534
8 / 9 1 / 2 rotors Stationary 5m, 10m, 15m, 298 / 336
10/11 3 / 4 rotors rotor 20m for each 240 / 600
Since the CW radar cannot measure the target distance range, the distance range was
estimated based on the land size of the mini-UAV trial field, and based on those video
recordings which were acquired together with the radar data.
parameters namely, the number of IMFs Kused for feature
extraction, and the RBF kernel width
σ
for the adopted
nonlinear SVM classifier. Since the Kis closely related to the
dimension of the extracted features, the proposed method shall
be evaluated over various K∈ {3,···,7}settings. Different
from the K, an optimal value for
σ
=7 is chosen among
{0.1,1,5: 2 : 19,50,100}in terms of random 10 runs of 2 folds
cross-validation tests using only the training set. The stopping
criterion for computing each IMF is fixed at 10 iterations [22].
The test classification accuracy performance is computed
as The number of correctly matched test samples
Total number of test samples .For statistical evidence,
a test based on random 20 runs of 10 fold cross-validation
is performed, where the average is recorded. All experiments
were performed on a PC (3.2GHz, 8G RAM) under the Matlab
platform. The Matlab code for EMD is obtained from [22].
2) Results and discussions: Fig. 3 shows the test average
accuracy values of the proposed method obtained at K
{3,···,7}, which are plotted over different dwell times. To
position the proposed method among those competing mini-
UAV classification methods, its test accuracy is compared with
that of Molchanov et al.’s work [2]. Since the classification
results reported in [2] were obtained using the same dataset
except for certain protocol details (e.g., sampling rate, signal
normalization and cropping), the directly taken accuracy val-
ues at {50ms,75ms,100ms}from [2] are shown in the plot.
Fig. 3 shows that the proposed method before fusion
(denoted as ‘Proposed (Single)’) outperforms the compared
Molchanov et al.’s method when K∈ {6,7}IMFs are utilized
20 30 40 50 60 70 80 90 100
Dwell time, ms
0.75
0.8
0.85
0.9
Test Classification Rate (%)
Average accuracy over different dwell times, 11 class
Molchanov et al. [2]
Proposed (Single, K=3)
Proposed (Single, K=4)
Proposed (Single, K=5)
Proposed (Single, K=6)
Proposed (Single, K=7)
Proposed (Fusion, K=3)
Proposed (Fusion, K=4)
Proposed (Fusion, K=5)
Proposed (Fusion, K=6)
75ms
Fig. 3. Performances of the proposed method at K∈ {3,··· ,7}and at
σ
=7.
The extractable Kvaries according to the frequency contents contained in the
signal (e.g., 7 IMFs can be extracted only when the dwell time 80ms).
TABLE IV
CONFU SION MATRIX (%) OF THE ‘PRO POSED (FUSI ON,K=6 AT 70MS)’
Estimated class label
1 2 3 4 5 6 7 8 9 10 11
199 0.4 0 0 0 0 0.6 0 0 0 0
2 1.1 86.3 5.5 0.1 0.1 0 6.9 0 0 0 0
3 1.9 31.4 58.1 0 0.1 0 8.5 0 0 0 0
T 4 0.1 1.9 0.1 96.1 1.2 0.1 0.5 0 0 0 0
r 5 0.1 0.4 0.2 1.4 97.9 0 0 0 0 0 0
u 6 0.6 0 0 0.2 0.1 99.1 00000
t 7 0.7 0.1 0.3 0 0 0 98.9 0 0 0 0
h 8 1.4 0 0 0 0 0 0 95.6 3.0 0 0
9 0.9 0 0 0 0 0 1 3.3 94.6 0 0.2
10 1.8 0 0 0 0 0 2.5 0.9 6.7 66.2 21.9
11 0.7 0 0 0.4 0 0 0 0 1.3 4.4 93.2
for feature extraction. Interestingly, the performance gap is
observed to be larger when the dwell time is shorter (e.g.,
50ms). After the feature level fusion (‘Proposed (Fusion)’), the
proposed method for K>3 produces higher accuracies than
those of Molchanov et al.’s method. From the confusion matrix
of the ‘Proposed (Fusion, K=6 at 70ms)’ as shown in Table
IV, it is observed that most of the errors occur from categories
3 and 10. About 7–8.5% of the fixed-wing echos (categories 2
and 3) are also wrongly classified as a quadcopter (category 7).
Particularly, when the radar echo signals contain weak blade
flashs and/or similar blade flash patterns over categories (e.g.,
2 and 3), our method produces incorrect classification since
the eight features are only sensitive to the blade flash patterns
from the IMFs.
Fig. 4 shows the average test classification accuracies
ACCEPTED VERSION, IEEE GEOSCIENCE AND REMOTE SENSING LETTERS 5
Features 1-4
Features 1-4,5
Features 1-4,6
Features 1-4,7
Features 1-4,8
Features 1-4,6,7
Features 1-4,5,8
Features 1-4,5,6,7,8
0.8
0.85
0.9
Classification
rate (%)
Proposed (Single)
Proposed (Fusion)
Fig. 4. The impact of the proposed features on the classification accuracy
performance (%)at a dwell time of 50ms and K=6. For example, the
Features 1–4,6’ means five features (Features 1, 2, 3, 4 and 6) are utilized
TABLE V
COMPARIS ON BET WEEN THE PRO POSED MET HOD A ND COMPE TING
STATE-OF-THE-ARTS. AVERAGE TEST RESULTS TAK EN OVER RANDOM 20
RUNS OF 2FOLD CROSS -VALIDATION TEST S US ING 50MS SIGNAL
Method EER FARFRR=1%
Spectrogram+PCA7.75 27.00
CVD+PCA6.68 28.41
Cepstrogram+PCA10.17 48.07
2D complex-log-Fourier transform+PCA[7] 3.98 4.50
2D complex-log-Fourier transform+SRA[7] 3.27 3.89
Proposed (Single, K=4) 3.54 4.78
Proposed (Fusion, K=4) 3.43 4.67
The error rates are directly taken from [7]. Note that all the error rates
listed in this table were obtained using the identical data and protocols.
obtained over different combinations of the features. It is
observed from Fig. 4 that each of the proposed features
contains uncorrelated and discriminative information. Due to
the inclusion of more blade-flash-related information from
Features 5–8, our method achieves the best accuracy perfor-
mance, which is about 4–5% higher than that of using only
the four statistical features (‘Features 1–4’).
C. Comparison with state-of-the-arts (2-category problem)
As shown in Table V, the proposed method is now compared
with competing state-of-the-arts (e.g., the 2D complex-log-
Fourier transform [7] and the subspace reliability analysis
(SRA) [7]) under a binary classification problem. Note that
the dataset utilized in [7] is exactly the same with that of
ours. Following the experimental protocols reported in [7], the
equal error rate (EER) and the false acceptance rate when the
false rejection rate equals to 1% (FARFRR=1%) of the proposed
method are obtained (see Table V). These error rates are then
compared with those taken directly from [7]. Different from
the results shown in Fig. 3, the proposed method achieves
the best error rates at K=4, which appear to be similar to
(or slightly worse than) those of the 2D complex-log-Fourier
based methods [7]. However, as aforementioned, the methods
proposed in [7] were for a binary-category problem only and it
is not clear how to extend to the multi-category problem. The
table also shows that our method significantly outperforms the
spectrogram, CVD and cepstrogram based methods.
V. CONCLUSION
In this letter, an EMD based method was proposed for mini-
UAV classification. The radar echo signal was decomposed
into a set of IMFs for m-DS estimation. From our empirical
analysis, it was observed that blade flashes appeared as sharp
changes towards high magnitudes with fewer number of zero-
crossings than those time segments without such blade flashes.
Moreover, the order of IMF’s, in which such responses appear,
was observed to be different across mini-UAV types. To extract
such information, eight statistical and geometrical features
were extracted from the first few IMFs. After normalization
and fusion, the extracted features were classified using the
SVM classifier. Our empirical results on physical radar sig-
nals showed comparable or better accuracy performance than
competing state-of-the-arts for mini-UAV classification.
REFERENCES
[1] V. C. Chen, The micro-Doppler Effect in radar. Artech House, 2011.
[2] P. Molchanov, R. I. A. Harmanny, J. J. M. de Wit, K. Egiazarian, and
J. Astola, “Classification of small UAVs and birds by micro-Doppler
signatures,Int. J. Microw. Wirel. T., vol. 6, no. 3-4, pp. 435–444, 2014.
[3] R. I. A. Harmanny, J. J. M. de Wit, and G. Premel-Cabic, “Radar micro-
Doppler mini-UAV classification using spectrograms and cepstrograms,”
Int. J. Microw. Wirel. T., vol. 7, no. 3-4, pp. 469–477, 2015.
[4] F. Fioranelli, M. Ritchie, H. Griffiths, and H. Borrion, “Classification of
loaded/unloaded micro-drones using multistatic radar,Electron. Lett.,
vol. 51, no. 22, pp. 1813–1815, 2015.
[5] B. Torvik, K. E. Olsen, and H. Griffiths, “Classification of Birds and
UAVs Based on Radar Polarimetry,” IEEE Geosci. Remote Sens. Lett.,
vol. 13, no. 9, pp. 1305–1309, 2016.
[6] B. K. Kim, H.-S. Kang, and S.-O. Park, “Drone classification using
convolutional neural networks with merged doppler images,” IEEE
Geosci. Remote Sens. Lett., vol. 14, no. 1, pp. 38–42, 2017.
[7] J. Ren and X. Jiang, “Regularized 2-d complex-log spectral analysis
and subspace reliability analysis of micro-doppler signature for uav
detection,Pattern Recogn., vol. 69, pp. 225–237, 2017.
[8] N. E. Huang, Z. Shen, S. R. Long, M. C. Wu, H. H. Shih, Q. Zheng, N.-
C. Yen, C. C. Tung, and H. H. Liu, “The empirical mode decomposition
and the Hilbert spectrum for nonlinear and non-stationary time series
analysis,” in Proc. Roy. Soc. London Ser. A, vol. 454, no. 1971, 1998,
pp. 903–995.
[9] A. Bouzid and N. Ellouze, “Empirical Mode Decomposition of Voiced
Speech Signal,” in Proc. Int. Symp. Control, Commun. Sig. Proc. IEEE,
2004, pp. 603–606.
[10] Y. Yu, Y. Dejie, and C. Junsheng, “A roller bearing fault diagnosis
method based on EMD energy entropy and ANN,” J. sound vib., vol.
294, no. 1, pp. 269–277, 2006.
[11] F. Riaz, A. Hassan, S. Rehman, I. K. Niazi, and K. Dremstrup, “EMD-
Based Temporal and Spectral Features for the Classification of EEG
Signals Using Supervised Learning,” IEEE Trans. Neural Syst. Rehabil.
Eng., vol. 24, no. 1, pp. 28–35, 2016.
[12] X. Bai, M. Xing, F. Zhou, G. Lu, and Z. Bao, “Imaging of Micromotion
Targets With Rotating Parts Based on Empirical-Mode Decomposition,”
IEEE Trans. Geosci. Remote Sens., vol. 46, no. 11, pp. 3514–3523, 2008.
[13] C. Cai, W. Liu, J. S. Fu, and Y. Lu, “Radar Micro-Doppler Signature
Analysis with HHT,” IEEE Trans. Aerosp. Electron. Syst., vol. 2, no. 46,
pp. 929–938, 2010.
[14] L. Du, B. Wang, Y. Li, and Hongwei, “Robust Classification Scheme for
Airplane Targets With Low Resolution Radar Based on EMD-CLEAN
Feature Extraction Method,IEEE Sensors J., vol. 13, no. 12, pp. 4648–
4662, 2013.
[15] Y. Wang, X. Wu, W. Li, Z. Li, Y. Zhang, and J. Zhou, “Analysis of
micro-Doppler signatures of vibration targets using EMD and SPWVD,”
Neurocomputing, vol. 171, pp. 48–56, 2016.
[16] Y. Li, L. Du, and H. Liu, “Hierarchical Classification of Moving Vehicles
Based on Empirical Mode Decomposition of Micro-Doppler Signatures,
IEEE Trans. Geosci. Remote Sens., vol. 51, no. 5, pp. 3001–3013, 2013.
[17] A. Brewster and A. Balleri, “Extraction and analysis of micro-Doppler
signatures by the Empirical Mode Decomposition,” in Proc. IEEE Radar
Conf., 2015, pp. 0947–0951.
[18] D. Tahmoush, “Detection of small UAV helicopters using micro-
Doppler,” in Proc. SPIE Defen. Secur. International Society for Optics
and Photonics, 2014, pp. 907717–907 717.
[19] S. Baykut and T. Akg¨ul, “Multiscale zero-crossing statistics of intrinsic
mode functions for white Gaussian noise,” in Proc. European Sig. Proc.
Conf., 2010, pp. 135–138.
[20] R. O. Duda, P. E. Hart, and D. G. Stork, Pattern classification. John
Wiley & Sons, 2012.
[21] R. C. Gonzalez, R. E. Woods, and S. L. Eddins, Digital Image Process-
ing Using MATLAB. Third New Jersey: Prentice Hall, 2003.
[22] P. Flandrin, “Empirical Mode Decomposition,” http://perso.ens-
lyon.fr/patrick.flandrin/emd.html, [Online; accessed 2-October-2016].
... Traditional ML methods have been used for this application: SVM in refs. [139,140], Maximum a Posteriori (MAP) in ref. [3], decision trees in ref. [141] among others. On the other hand, DL-based methods bring certain advantages as automatic feature extraction and classification boundaries saving time and committing fewer errors [142]. ...
Article
Full-text available
Radar systems are a topic of great interest, especially due to their extensive range of applications and ability to operate in all weather conditions. Modern radars have high requirements such as its resolution, accuracy and robustness, depending on the application. Noise Radar Technology (NRT) has the upper hand when compared to conventional radar technology in several characteristics. Its robustness to jamming, low Mutual Interference and low probability of intercept are good examples of these advantages. However, its signal processing is more complex than that associated to a conventional radar. Artificial Intelligence (AI)‐based signal processing is getting increasing attention from the research community. However, there is yet not much research on these methods for noise radar signal processing. The aim of the authors is to provide general information regarding the research performed on radar systems using AI and draw conclusions about the future of AI in noise radar. The authors introduce the use of AI‐based algorithms for NRT and provide results for its use.
Article
Full-text available
Considering the implication of radar sensors in our daily life and environment. Localizing and identifying drones are becoming a research with a greater focus in recent years. Consequently, when an unmanned aerial vehicle is used with bad intention, this can lead to a serious public safety and privacy probem. This study investigate pratical use of spectrum range for multistatic passive radar (MSPR) signal processing . Firstly, signal processing is performed after MSPR sensing detection range ,this include multipath energy detection, reference signal extraction, and receiving antenna configuration. Secondly, based on the MSPR nature, the reference signal is extracted and analyzed. In addition,taking into consideration the vulnerability of passive radar when comes to a moving target localization and real time tracking detection ,a novel method for spectrum sensing and detection which relies on Gaussian filter is proposed. The main goal is to optimize the use of the reference signal extracted with minimum interference as the shared reference signal in spectrum sensing. This will improve the system detection capability and spectrum access. Finally, a recursive method based on Bernoulli random filter is proposed, this takes consideration of drone’s present and unknown states based on time. Moreover, a system is developed meticulously to track and enhance detection of the target. A careful result of the experiment demonstrated that spectral detection can be achieved accurately even when the drone is moving while chasing its position. It shows that Cramer Rao lower error bounds remains significantly within 3% range.
Article
It is necessary for radar sensors used in security and privacy surveillance systems to determine the movements of mini-unmanned aerial vehicles (UAVs) to evaluate and analyze their flight intent or purpose. For a typical quadrotor, its movement depends on the different rotation rates and directions of the four rotors individually positioned at the end of the cross frame. To extract the micro-Doppler signature of the multiple rotors, we define the exponential complex sinusoidal basis (ECSB) according to the modulation properties of the micro-Doppler echo. This allows us to convert the parameter estimation of the multidimensional signal into a sparse decomposition process in the one-dimensional (1D) space of the signal. Based on this, the micro-Doppler signal is decomposed using the proposed exponential orthogonal matching pursuit (EOMP). The approach decomposes the signal’s exponent into a series of complex sinusoidal components, and the sparse solution can accurately indicate the rotation status of the UAV rotors. To assess the performance of the proposed method, two machine learning (ML) classification models, the support vector machine (SVM) and decision tree (DT), are investigated. The proposed approach has been validated using simulation and experimental data. The results indicate that the SVM model outperforms the DT model in terms of classification performance, achieving an accuracy of 97.3%. These findings suggest that the approach could be a promising tool for surveilling UAVs.
Article
The continuous advancement of shipbuilding technology has enabled the further development of sea transport and naval vessels, which also poses significant challenges to navigation safety. Accurate recognition of different types of ships is crucial. In this study, three typical ships, namely destroyer, cruise ship, and aircraft carrier, were taken as examples. The micro-Doppler effect of these ships was analyzed using a UAV-based ultra-wideband radar. Echo signal models were established and compared with measured Doppler signals. Furthermore, a lightweight self-supervised learning network was proposed to achieve accurate recognition of small-sample labeled ship targets. The neural network architecture, including specific layers and parameters, was introduced. To enhance the micro-Doppler features, the one-dimensional signals were transformed into two-dimensional images, thereby converting the ship recognition problem into an image classification problem. The experimental results demonstrate that the proposed network achieves high recognition accuracy under different situations. When evaluated on measured data, the overall recognition rate reaches 97.50%. Moreover, even in challenging scenarios with a low signal-to-clutter ratio of -10dB, the overall recognition rate for simulated data still exceeds 90%, demonstrating the effectiveness and advantages of the proposed network.
Article
Full-text available
At present, an increasing number of small UAVs(Unmanned Aerial Vehicles) are commercialized and common, and the application of small UAVs has very good development prospects, such as UAV distribution services, UAV aerial photography services, and UAV formation performance. However, the misuse of small drones poses a significant threat. Lawbreakers use small drones equipped with various sensors to spy on personal privacy, steal corporate secrets, and threaten national conferences, which have had many adverse effects on society. In future wars, these small drones will perhaps be used on the battlefield along with high-end weapons. Therefore, it is necessary to find a solution for effectively identifying the basic information of UAV. For the existence of UAV and various small UAV types, this paper proposes a combination of RF sensing and target detection techniques with target detection algorithms to learn RF signal frequency frequency hopping features to detect UAV presence and identify the detected UAV. First, the RF signal of the UAV was obtained in real time by a software radio, and the time-frequency analysis of the short-time Fourier transform and wavelet transform is performed to generate frequency domain images with retained frequency hopping features. Then, the improved Yolov5-7.0 target detection model was employed for training, and finally, the trained model was used for identification and classification. The results showed that the method can effectively assist the detection and classification of UAVs that were obtained by identifying and classifying 5400 unlabeled images. The F1 score was 0.93, and the three assessment measures of P(Precision), R(Recall), and mAP(mean Average Precision) were 1.00, 1.00, and 0.967, respectively.
Article
Full-text available
Unmanned aerial vehicles (UAVs) can support low-cost, highly mobile communications while making it possible to establish dedicated terrestrial networks. To overcome the pointing error (PE) and beam misalignment of millimeter-wave large-scale multiple-input multiple-output/free-space optics (MIMO/FSO) caused by UAV jitter, a millimeter-wave massive MIMO/FSO hybrid beamforming method based on tensor train decomposition is proposed. This approach is used for reconfigurable intelligent surface (RIS) network-assisted UAV millimeter-wave massive MIMO/FSO to improve system spectral efficiency. Firstly, the high-dimensional channel of RIS-assisted millimeter-wave massive MIMO/FSO in UAV is represented as a low-dimensional channel by tensor training decomposition. Secondly, the two-way gated recursive unit attention neural network model can effectively solve the FSO PE caused by UAV jitter, and the fast fading channel and Doppler frequency shift are estimated by the Fast Cyclic Tensor Power Method (FCTPM) based on tensor training decomposition. Finally, the RIS phase shift matrix is optimized by singular value decomposition. The hybrid beamforming and RIS phase-shift matrices were estimated by using the low-complexity phase extraction alternating minimization method to solve the beam misalignment problem. Simulation results show that by using the proposed method, the spectrum utilization rate is improved by 23.6% compared with other methods.
Article
Micro-Doppler signatures have been widely employed for automatic recognition of various radar targets that exhibit micro-motions via time-frequency distributions. However, most existing studies using time-frequency analysis for a good classification performance often require a continuous and long observation time to show stable and regular micro-motion characteristics. In this paper, we propose a single-frame recognition scheme based on two-channel vision transformer (ViT) for low resolution radar target classification. The proposed approach is achieved through the three successive steps: one-frame radar signal generation, feature images representation, and two-channel ViT network. In the first step, one-frame radar signal for each coherent processing interval is generated based on a low-resolution pulsed radar system. Then the short-time Fourier transform and bispectrum are considered to fully excavate the micro-Doppler signatures in the second step, and the energy- and phase-based feature images are represented in one-frame time. In the last step, we investigate a two-channel ViT network to realize the single-frame decision recognition. The effectiveness of the proposed two-channel ViT model, which fuses short-time Fourier transform and bispectrum features, is validated by the experimental results obtained from a group of measured radar data.
Article
Full-text available
Unmanned aerial vehicle (UAV) has become an important radar target recently because of its wide applications and potential security threats. Traditionally, visual features such as spectrogram were often extracted for human operators to identify the micro-Doppler signature (mDS) of UAVs, i.e. sinusoidal modulation. In this paper, the authors aim to design a system for machine automatic classification of UAVs from other targets, particularly from birds as both UAVs and birds are small and slow-moving radar targets. Most existing mDS representations such as spectrogram, cepstrogram and cadence velocity diagram discard the phase spectrum, and only make use of the magnitude spectrum. What’s more, people often take the logarithm of the spectrum to enlarge the weak mDS but without sufficient care, as noise may be enlarged at the same time. The authors thus propose a regularized 2-D complex-log-Fourier transform to address these problems. Furthermore, the authors propose an object-oriented dimension-reduction technique: subspace reliability analysis, which directly removes the unreliable feature dimensions of two class-conditional covariance matrices in two separate subspaces. On the benchmark dataset, the proposed approach demonstrates better performance than the state-of-the-art approaches. More specifically, the proposed approach significantly reduces the equal error rate of the second best approach, cadence velocity diagram, from 6.68% to 3.27%.
Article
Full-text available
This letter presents preliminary results on the use of multistatic radar and micro-Doppler analysis to detect and discriminate between micro- drones hovering carrying different payloads. Two suitable features related to the centroid of the micro-Doppler signature have been identified and used to perform classification, investigating also the added benefit of using information from a multistatic radar as opposed to a conventional monostatic system. Very good performance with accuracy above 90% has been demonstrated for the classification of hovering micro-drones.
Chapter
Micro-Doppler effects in narrowband radar are introduced in this chapter. We mainly analyze the micro-Doppler effects induced by rotations, vibrations, and precessions of targets. Rotations, vibrations, and precessions are typical micromotion dynamics of targets in the real world. Typical rotations include rotations of helicopter rotors, mechanical scanning radar antennas, turbine blades, etc. Typical vibrations include engine-induced car surface vibrations, mechanical oscillations of a bridge, etc. Precession is a major movement form of spatial targets, for example, precessions usually go with a ballistic missile in its midcourse flight. Analyzing the micro-Doppler effects of rotations, vibrations, and precessions provides a basic foundation for further discussions on micro-Doppler effects of complicated motions. The influence of radar platform vibration on micro-Doppler effect analysis is also investigated. Finally, related MATLAB codes are provided on the companion Website: http://booksite.elsevier.com/9780128098615/ .
Article
We propose a drone classification method based on convolutional neural network (CNN) and micro-Doppler signature (MDS). The MDS only presents Doppler information in time domain. The frequency domain representation of MDS is called as cadence-velocity diagram (CVD). To analyze the Doppler information of drone in time and frequency domain, we propose a new image by merging MDS and CVD, as merged Doppler image. GoogLeNet, a CNN structure, is utilized for the proposed image data set because of its high performance and optimized computing resources. The image data set is generated by the returned Ku-band frequency modulation continuous wave radar signal. Proposed approach is tested and verified in two different environments, anechoic chamber and outdoor. First, we tested our approach with different numbers of operating motor and aspect angle of a drone. The proposed method improved the accuracy from 89.3% to 94.7%. Second, two types of drone at the 50 and 100 m height are classified and showed 100% accuracy due to distinct difference in the result images.
Article
This letter aims to show the potential of using polarimetric parameters to distinguish between large birds and unmanned aerial vehicles (UAVs) of comparable size in the context of a modern long-range air defense radar. Time is a critical resource in such systems, and techniques for robust noncooperative target recognition not relying on spatial resolution or long dwell times are highly desired. Furthermore, methods less dependent on target micromotion are, in many cases, required. Methods exploiting polarimetric features are shown to have potential in both cases. An experiment in S-band shows that a simple nearest-neighbor classifier can achieve good separation between UAVs and birds both with and without detectable micromotion based on a set of polarimetric parameters alone.
Article
A set of experimental trials was conducted with a 10 GHz continuous wave radar to collect micro-Doppler signatures of a large single, double and triple bladed rotating fin and a sized miniature helicopter. We analysed the target micro-Doppler signatures and decomposed them using the Empirical Mode Decomposition (EMD) method in order to extract a series of Intrinsic Mode Functions (IMFs) which admit only an instantaneous frequency. The aim of this paper is to investigate what information is available in the target IMFs to help identify key features that can be used for improving target classification and identification. The experimental testing was complimented with a set of simulations to assist in the understanding of the results.
Article
In the micro-Doppler signature analysis of vibration targets, the joint time–frequency methods can provide useful information for target detection, classification, and recognition. In this paper, we proposed a procedure which combines both Empirical Mode Decomposition (EMD) and Smoothed Pseudo Wigner-Ville Distribution (SPWVD) techniques for the micro-Doppler analysis. The Ensemble Empirical Mode Decomposition (EEMD) based method was also proposed to address the problem of mode mixing which may occur in EMD procedure. The simulation results showed that, compared with the traditional Cohen׳s class time–frequency method (SPWVD), the method we proposed achieved much better performance under three different conditions (severe noise, weak modulation and compound vibrations).