Conference PaperPDF Available

Evaluation of Low-Cost/High-Accuracy Indoor Positioning Systems

Authors:

Abstract and Figures

Indoor positioning is a challenging research topic. Over the years, many different measurement principles and algorithms have been proposed. Each system has its own advantages and drawbacks, therefore trade-offs have to be made. For example, one generally needs to make a trade-off between cost and accuracy. However, recent developments in sensing technology have led to commercial systems that advertise sub-decimeter positioning accuracy for less than €1k. In this paper, we benchmark the accuracy of indoor positioning systems by Pozyx labs and Marvelmind robotics, as well as the VIVE tracker by HTC and Aruco Marker tracking in OpenCV. Results show that these systems achieve an average dynamic positioning accuracy of approximately 150 mm, 20 mm, 8 mm and 100 mm, respectively.
Content may be subject to copyright.
Evaluation of Low-Cost/High-Accuracy Indoor Positioning Systems
Robin Amsters,
Eric Demeester
and Peter Slaets
KU Leuven,
Department of Mechanical Engineering,
3000 Leuven, Belgium
Email: {firstname.lastname}@kuleuven.be
Nobby Stevens
KU Leuven,
Department of Electrical Engineering,
3000 Leuven, Belgium
Email:nobby.stevens@kuleuven.be
Quinten Lauwers
KU Leuven,
3000 Leuven, Belgium
Email: quinten.lauwers@student.kuleuven.be
Abstract—Indoor positioning is a challenging research topic. Over
the years, many different measurement principles and algorithms
have been proposed. Each system has its own advantages and
drawbacks, therefore trade-offs have to be made. For example,
one generally needs to make a trade-off between cost and
accuracy. However, recent developments in sensing technology
have led to commercial systems that advertise sub-decimeter
positioning accuracy for less than e1k. In this paper, we
benchmark the accuracy of indoor positioning systems by Pozyx
labs and Marvelmind robotics, as well as the VIVE tracker by
HTC and Aruco Marker tracking in OpenCV. Results show that
these systems achieve an average dynamic positioning accuracy of
approximately 150 mm, 20 mm, 8 mm and 100 mm, respectively.
KeywordsIndoor positioning; benchmarking; accuracy
I. INTRODUCTION
Positioning is not a particularly new problem. Mankind
has attempted to determine his position for centuries, using
instruments such as sextants, clocks, almanacs, maps, etc.,
One of the largest revolutions in this field is probably the
advent of the Global Positioning System (GPS), which can
provide position information almost anywhere on earth to
anyone with a receiver. However, GPS often does not work in
indoor environments, as the signals of the satellites lose much
strength when penetrating the walls of buildings [1], making
it difficult to receive them with traditional, low-cost sensors.
Moreover, the accuracy (that is, the Euclidean distance between
the true and the reported position) of such sensors is limited to
a couple of meters, which is insufficient for many indoor appli-
cations. A study performed by the National Exposure Research
Laboratory indicates that most people spend about 90% of
their time indoors [2]. Therefore, indoor location information
provides many business opportunities. This is illustrated by
the fact that the indoor mapping market is rapidly increasing
in size, and is estimated to be worth about $10 billion by 2020
[3]. As GPS cannot be used for indoor environments, different
technologies are required to obtain this position information.
While GPS has become the de facto standard for outdoor
environments, no such standard exists for indoor spaces [4].
The wide variety of indoor environments has prompted an
equally wide variety of Indoor Positioning Systems (IPS), each
with their own advantages and drawbacks. Usually, a trade-
off has to be made between accuracy and cost. In the past,
this trade-off was quite significant. However, in recent years,
a number of positioning systems have come to market that
should provide high accuracy (10 cm) at relatively low-
cost (e1k), potentially bridging the gap that existed before.
In this paper, we evaluate several commercially available
high-accuracy/low-cost indoor positioning systems. Different
measurement principles are represented, namely ultrasound,
ultrawideband radio, infrared light and computer vision. A
highly accurate (sub-millimeter) infrared measurement system
is used as a ground truth reference. The positioning systems
are benchmarked in the same environment, thus enabling an
objective comparison.
The rest of the paper is structured as follows; Section II
presents related work and the main contributions of this paper.
Section III elaborates on the different positioning systems
that were considered. The experimental setup is explained in
Section IV, and results are presented in Section V. Finally, a
conclusion is drawn in Section VI.
II. RE LATE D WO RK
Van Haute et al. [5] benchmarked several indoor position-
ing systems in a healthcare environment. Low-cost technolo-
gies like Wi-Fi, ZigBee and bluetooth low-energy (BLE) were
used. Accuracy of static measurements in the order of 1 to
4 meters was obtained. These kinds of radio-frequency (RF)
based systems are relatively popular for indoor localization,
due to the widespread availability of the hardware. However,
accuracy is rarely below 1 meter [1].
Ultrawideband (UWB) has been an increasingly important
topic in indoor positioning research in recent years. Typically,
UWB positioning systems determine the distance between
static anchors and a mobile node based on signal travel time.
A position estimate is then obtained via triangulation. Ruiz
and Seco [6] compared the commercial UWB systems sold
by DecaWave (the Pozyx system uses DecaWave transceivers)
and BeSpoon. Manual measurements with a ruler were used
as ground truth. Ruiz and Granja [7] added the Ubisense
system to this comparison, and extended the testing space
to a larger industrial warehouse as well (rather than the lab
environment as in [6]). A comparison was made based on
the ranging accuracy and positioning accuracy with a particle
filter. An overview of the positioning results of these papers
can be found in Table I. The Ubisense system was evaluated
separately as well by Maleek and Sadeghpour [8]. The focus of
their work was dynamic positioning and localization of factory
workers in order to increase safety. A number of experiments
were performed by placing a tag on a Lego track, as well
as experiments where the tag was used to localize a person.
Ground truth locations are calculated based on the starting
time and the known layout of the lego track for the first set
15Copyright (c) IARIA, 2019. ISBN: 978-1-61208-691-0
ALLSENSORS 2019 : The Fourth International Conference on Advances in Sensors, Actuators, Metering and Sensing
of experiments. For the experiments on worker localization,
the real position was determined with a robotics total station
(Leica iCON Robot 50). Their findings indicate 2D accuracy
of 15-31 cm depending on the experiment. Dabove et al.
evaluated the Pozyx system in [9]. In an office environment,
the average 3D positioning accuracy was 100 mm, and the
accuracy of the range measurements was found to be 320 mm.
In a narrow corridor, the horizontal accuracy and range error
were determined to be 87.4 mm and 225 mm, respectively.
Surveying equipment was used as ground truth reference for
static range measurements, and a grid pattern was used for
static positioning ground truth measurements. Finally, Ridolfi
et al. [10] evaluated the Pozyx kit as a positioning technology
for sports postures. Average positioning errors of 200 mm were
recorded (depending on tag placement and activity) and the
authors propose several implementations of filtering algorithms
to reduce this error. A motion capture system (MOCAP) was
used as ground truth.
TABLE I. OVERVIEW OF PREVIOUS UWB BENCHMARKING
RESULTS REPORTED IN [6] AND [7]. P90 REPRESENTS THE 90%
INTERVAL OF THE CUMULATIVE ERROR DISTRIBUTION
DecaWave BeSpoon Ubisense
Mean accuracy (office) [m] 0.24 0.51 /
P90 (office) [m] 0.51 0.99 /
Mean accuracy (factory) [m] 0.49 0.71 1.1
P90 (factory) [m] 1.09 1.16 2.39
The ranging of the Marvelmind system was, to the best of
our knowledge, only benchmarked by Cernohorsk and Novk
[11]. The error of the range measurements was found to be
in the order of a few centimeters, though some outliers exist
in absence of a direct line of sight. The absolute positioning
error was not evaluated.
The HTC VIVE is a relatively new system, and thus little
research about it is available. Chang et al. [12] compared sev-
eral head-mounted virtual reality systems, namely the 3Glasses
D2, Oculus Rift DK2, Google Cardboard and Samsung Gear
VR based on metrics such as positioning precision and sen-
sitivity. One degree of freedom motion was considered by
mounting the headsets on a servo motor. However, the HTC
VIVE was not considered. Niehorster et al. [13] did evaluate
the precision and latency of the HTC VIVE specifically.
Latency is conservatively estimated to be 22 ms, significantly
less than the latency of the 3Glasses D2 (44 ms) and Oculus
Rift DK2 (48 ms) measured by Chang et al. [12]. Niehorster
et al. concluded that the VIVE measures at a tilted reference
plane relative to the ground plane. However, the angles and
positions reported by the VIVE are consistent as long as the
system does not lose tracking. Positioning accuracy was not
reported.
It is clear that while some of these systems have been
evaluated in previous publications, further work is still
required. For example, position accuracy is not always
specified and even when reported, this is often the average
value. In the context of, for example, autonomous operation
of mobile robots, one is often also interested in the P95,
that is, the 95% interval of cumulative error distribution.
These results are usually not included ([6] and [7] do report
90% intervals, as shown in Table I). Additionally, static grid
measurements or measurements with a ruler are often used
as a ground truth reference. A survey of papers published in
the proceedings of the International Conference on Indoor
Positioning and Indoor Navigation (IPIN) concludes that this
method is used quite often in indoor positioning research [14].
In this work, we perform ground truth measurements with
a highly (sub-millimeter) accurate positioning system with
a relatively high update rate (50 Hz, see Section IV). This
allows better characterization of the dynamic performance of
the considered indoor positioning systems.
In summary, our main contributions are:
Evaluation of several measurement principles in the
same environment.
Measurements of moving receivers are compared with
a highly accurate, fast-measuring ground truth refer-
ence.
Evaluation of positioning accuracy, rather than ranging
distance.
Reporting of mean accuracy and P95 values, to pro-
vide both an overview of normal performance and
worst case scenarios.
III. SYS TE MS U ND ER EVALUATI ON
Table II provides an overview of the main specifications
of the IPS considered in this paper. The system cost includes
value added tax, and the specifications for the Aruco system are
based on the camera used in this work (Logitech HD webcam).
Scalability refers to whether a particular system can easily be
extended up to larger environments.
The indoor positioning system by Marvelmind robotics
uses ultrasound ranging to determine the position of one
or more mobile sensor modules (referred to as hedgehogs).
Ultrasound ranging is also used by the transmitters (referred
to as beacons) to determine their relative position. Therefore,
the Marvelmind system is self-calibrating. The sensor modules
have built-in rechargeable batteries, and whether a module is
a beacon or hedgehog can be selected in the software and
changed at will. The maximum update rate for tracking a
single hedgehog is 16 Hz. The system uses time division
multiplexing, so if multiple hedgehogs are tracked, the update
rate becomes:
Fupdate =16
nhedgehog
(1)
With Fupdate the update rate of every hedgehog and nhedgehog
the number of tracked hedgehogs.
The indoor positioning system by Pozyx labs uses ultraw-
ideband radio as a distance estimation principle. Additionally,
data from a 9-axis Inertial Measurement Unit (IMU) is fused
in order to improve the position estimate. The advantage of
ultrawideband over other RF technologies is that the increased
bandwidth makes it more likely that at least some of the
transmitted frequencies will go through or around obstacles
[15]. Therefore, accuracy can be significantly higher than, for
example, Bluetooth or Wi-Fi based positioning [4]. The system
has the option to self-calibrate, but we performed a manual
calibration to improve accuracy [16] (see Section V-B).
The HTC VIVE is sold as a virtual reality headset, and
ships with a Head-Mounted Display (HMD), two controllers
with infrared receivers and two infrared transmitters (called
lighthouses). Recently, a standalone tracker module has also
16Copyright (c) IARIA, 2019. ISBN: 978-1-61208-691-0
ALLSENSORS 2019 : The Fourth International Conference on Advances in Sensors, Actuators, Metering and Sensing
been released to enable simpler tracking of objects [17]. It
is the positioning of the tracker that was evaluated in this
paper. Each lighthouse is equipped with two lasers, which
sweep across its horizontal and vertical axes. The infrared
laser sweeps are detected by photodiodes which are mounted
on the controllers, headset or tracker modules. The difference
between arrival times of the laser at the photodiodes is used
to determine the position and orientation of the modules [13].
These laser measurements function mostly as drift correction.
In between sweeps, positions are estimated with IMU-based
dead-reckoning [18]. Contrary to the other systems considered
in this paper, the VIVE was not originally designed to be a
standalone positioning system. However, accurate position and
orientation tracking is required to provide a good virtual reality
user experience. As the OpenVR Software Development Kit
(SDK) has a published driver for the tracking hardware [19],
it is possible to access all the tracking information outside a
gaming environment, thus opening the door for a wide range
of other applications. As a positioning system, however, the
user experience is not as smooth as the Pozyx or Marvelmind
systems. For example, steamVR needs to be continuously
running in the background and the controllers need to be
connected even if one only wants to know the position of the
tracker. At the time of writing, it is also not possible to utilize
more than 2 lighthouses, thus limiting the operating space.
The final positioning system considered in this work is
based on Aruco marker detection [20] with a webcam and
OpenCV. The field of computer vision has many examples
of marker tracking, the implementation in this paper is likely
not the most accurate or user friendly system available. For
example, a calibration procedure is required to compensate
for the effects of lens distortion and to convert the measured
coordinates from pixels to meters [21]. The system is nonethe-
less included in this comparison as a representative example
of what a novice in the field could reasonably implement
themselves, and represents one of the lowest cost IPS that
can achieve sub-decimeter accuracy. The system returns z-
coordinates, but these should not be used as it is challenging
to estimate depth with a monocular camera.
TABLE II. SPECIFICATIONS OF THE CONSIDERED IPS.
Positioning system Marvelmind HTC VIVE Pozyx Aruco
Update rate (max) [Hz] 16 120 138 30
Approximate system cost
[e]
400 700 600 70
Measurement range [m] 50 5 30
Scalable ? Yes No Yes No
IV. EXP ER IM EN TAL SETUP
Experiments were conducted in a lab environment of ap-
proximately 5 meters by 5 meters. All beacons were mounted
at the edges of the test space. The Pozyx beacons are mounted
vertically at approximately the height of the receiver (see
Section V-B). The lighthouses for the VIVE are attached
to metal poles and pointed slightly downwards. Both the
Marvelmind beacons and the webcam are attached to the
ceiling at a height of approximately 2.8 meters. Figure 1
shows the experimental setup. The receivers of the various
positioning systems are mounted on top of a mobile robot
with a custom sensor platform (see Figure 2). The Pozyx tag
is mounted vertically to improve accuracy [16]. The tag is
connected to a raspberry pi 3 that also controls the robot.
Measurements for the HTC VIVE, Marvelmind and camera
system are received on a laptop. The robot moves at varying
speeds during the experiments, occasionally stopping to turn.
The maximum speed of the platform is about 0.2 m/s.
As a ground truth reference, the Krypton K600 coordi-
nate measurement machine (CMM) was used. This system is
equipped with 3 infrared cameras, which track the positions of
infrared LEDs that can be attached to objects. The accuracy of
the system is between 60 µm and 190 µm, depending on the
distance to the camera [22]. The krypton CMM is controlled
with and measurements are stored on a separate computer.
Figure 1. Experimental setup. One more Pozyx beacon is present but cannot
be seen on this perspective.
Figure 2. Robot platform used in the experiments
A. Data processing
Data from the systems under testing (SUT) are returned in
different formats (e.g., a .txt file for the HTC VIVE and as a
rosbag for the Marvelmind system). In order to compare data
from different systems, all the output is first converted to a
CSV file containing the timestamped positions. It is assumed
that timestamps recorded by different computers only have an
offset difference.
Following conversion, both the CSV data from the Krypton
CMM and the SUT are loaded into memory. The positions
of the infrared LEDs relative to the robot center are used
to determine the robot pose via Procrustes analysis [23] and
Kabsch algorithm [24], which determines the least-squares
solution for the pose matrix. Next, these pose matrices and the
position of the evaluation system relative to the robot center
are used to calculate the equivalent trajectory of the SUT (that
is, the trajectory that the SUT would report if it was placed at
the location of the krypton markers). However, this equivalent
17Copyright (c) IARIA, 2019. ISBN: 978-1-61208-691-0
ALLSENSORS 2019 : The Fourth International Conference on Advances in Sensors, Actuators, Metering and Sensing
trajectory can still be rotated or translated in space, and have
an offset time difference relative to the SUT. Additionally, the
sampling frequency of the krypton measurement system is not
necessarily the same as the SUT. To determine the points that
can be compared, virtual timestamps of the Krypton CMM
that provide the best match for the SUT are selected, based
on the assumption of a constant 50 Hz sampling rate and
the starting time of the experiment. Out of these timestamps,
those that overlap are selected for evaluation (see Figure 3).
At this stage in the post-processing, we have two datasets of
equal length (one equivalent dataset for the Krypton CMM and
one for the SUT). The position data can still be rotated and
translated relative to each other, and the time vectors can have
an offset difference. We therefore calculate the transformation
matrix that provides the best fit of the position data. The SUT
data is then transformed to the Krypton coordinate frame with
this matrix. Next, we shift the timestamps of the evaluation
samples with a period of the reference system and calculate the
transformed dataset. The time shift that provides the smallest
error is assumed to be the offset difference between the
clock. The result of this process is a reference dataset and an
evaluation dataset that is aligned in space and in time, from
which the accuracy can now be computed.
One might argue that the method described above provides
the smallest possible positioning errors as the data is trans-
formed to provide the best fit. Therefore, the entire length
of the datasets are not fitted to each other. Rather, for each
experiment approximately half of the data is used for fitting,
and the rest is used for evaluation.
Figure 3. Procedure for determining overlapping samples in the krypton and
SUT datasets. Samples in the same color are assumed to represent the same
timestep
V. EX PE RI ME NTAL RESULTS
Table III provides an overview of the measured accuracies
of the different positioning systems. The following Sections
will elaborate on these results. Accuracy is defined as follows:
ε=p(xref xSU T )2+ (yref ySU T )2+ (zref zSUT )2(2)
Where x,yand zare used to denote the different coordinate
axes, and the subscripts ref and SU T indicate the ground
truth and the system under testing, respectively.
TABLE III. ACCURACY OF THE CONSIDERED POSITIONING
SYSTEMS
Marvelmind HTC VIVE Pozyx Aruco
Accuracy (mean) [mm] 19,62 8,05 150,73 99,15
Accuracy (P95) [mm] 33,28 12,62 283,21 177,09
A. Marvelmind
Figure 4 shows the Marvelmind positioning results together
with the ground truth reference. It is clear that both trajectories
are a close match. At certain sections it can be challenging to
distinguish the two from one another. The mean accuracy with
respect to the ground truth reference is 19,62 mm. The 95%
interval of the cumulative error distribution was determined to
be 33,28 mm. Therefore, it appears that the advertised accuracy
of 2 cm is consistent with the average observed accuracy.
However, it should be noted that the CMM has a relatively
limited measurement range (as can be seen in Figure 4). When
performing experiments in larger space, there inexplicably
exists a region where the Marvelmind system does not measure
at all. We were unable to determine the cause of this signal
loss, as the beacons were not obstructed in this space nor were
there any apparent sources of interference present.
Figure 4. Marvelmind positioning results alongside Krypton CMM
measurements.
B. Pozyx
The Pozyx beacons were placed at an equal height in
an approximate square. In order to improve accuracy, the
distances between the beacons were determined based on
manual measurements rather than using the self-calibration
function (this is also recommended in the documentation [16]).
The relative distances can be used to calculate the angles of the
approximate square (see Figure 5), these angles should then
sum to 360 degrees. If this is the case, the beacon angles and
distances can be used to determine the beacon locations in any
coordinate system. In this paper, one beacon is selected as the
origin, and the other beacons are defined relative to it.
Positioning results were not as expected. The large degree
of noise in positioning data means determining the best fit
is challenging. When a fit is possible, positioning errors
are on average around 150 mm, with a P95 value of 233
mm (see Figure 6). These results can likely be attributed to
the large amounts of metal present in the lab environment,
which reduces the accuracy of UWB ranging. Therefore, a
measurement was also performed with a static receiver in an
open outdoor area. The results of this experiment are shown
in Figure 7. The measured positions are spread over an area of
approximately 20 cm, thus implying that the maximum (static)
accuracy of the system is 10 cm.
Our results are slightly better than the evaluation in [10],
where a mean accuracy of 20 cm was obtained. However, a
P95 value was not specified. Our analysis reaches significantly
different results than those in [9]. However, we suspect the
authors may have used a different definition for accuracy.
Negative values for 3D accuracy are present in some of the
figures, which is impossible in the definition in (2). The
definition that the authors did use is not specified. The obtained
mean accuracy is significantly better than that of the DecaWave
18Copyright (c) IARIA, 2019. ISBN: 978-1-61208-691-0
ALLSENSORS 2019 : The Fourth International Conference on Advances in Sensors, Actuators, Metering and Sensing
kit benchmarking in [6]. Additionally, our obtained P95 value
is much better than even the 90% interval measured by the
authors. Since the Pozyx developers kit used in this paper
makes use of DecaWave transceivers, we can therefore con-
clude that their additions such as machine learning and sensor
fusion improve performance, particularly at high intervals of
the cumulative probability function.
Figure 5. Calibration of Pozyx beacon positions
Figure 6. Pozyx positioning results (red) alongside Krypton CMM
measurements (blue).
Figure 7. Reported positions by pozyx when the receiver remains static in an
outdoor environment. Beacons were placed approximately 5 meters apart.
C. Aruco marker tracking
Positioning results from the computer vision system show
significantly less noise than the Pozyx system. Accuracy is
relatively high in the center of the test space. However, this
accuracy decreases towards the edge of the image (see Figure
8), possibly due to a small degree of image distortion that
remains even after calibration. Accuracy relative to the krypton
ground truth is around 100 mm on average, with a P95 value
of 177 mm.
Figure 8. Camera positioning results (red) alongside Krypton CMM
measurements (blue). Data was fitted to the left side of the figure, which is
why deviation is smallest in this region. Evaluation is performed on the rest
of the dataset which was not fitted.
D. HTC VIVE tracker
The HTC VIVE proves to be the most accurate system out
of all the experiments. As can be seen on Figure 9, the two
datasets match very closely, in fact it is challenging to observe
any difference. Therefore, these results are also shown in a
different perspective in Figure 10. Small variations in the z-
coordinate of the reference system are present. These variations
can likely be attributed to a non-perfect smoothness of the floor
or roundness of the robot wheels. The average positioning error
relative to the ground truth is 8 mm, with a P95 value of 12
mm.
Figure 9. HTC VIVE positioning results (red) alongside Krypton CMM
measurements (blue).
Figure 10. Side view of the HTC VIVE positioning results (red) alongside
the Krypton CMM measurements (blue)
19Copyright (c) IARIA, 2019. ISBN: 978-1-61208-691-0
ALLSENSORS 2019 : The Fourth International Conference on Advances in Sensors, Actuators, Metering and Sensing
VI. CONCLUSION
In this paper, we benchmarked a number of low-cost indoor
positioning systems. We used a highly accurate reference
system rather than conventional grid measurements or mea-
surements with a ruler as a ground truth. Additionally, we
measure the ground truth position at a high rate to better
characterize dynamic performance. While there likely will
never be a single ’best’ indoor positioning system, it is clear
from our results that significant progress has been made in
recent years. For just a few hundred euros, it is now possible
to purchase a positioning system that delivers accuracy of a few
centimeters out of the box. If one has more technical expertise,
then the HTC VIVE can provide even higher accuracy. It is
even possible to use the VIVE as a ground truth reference for
positioning systems that have an accuracy that is one order of
magnitude less than 1 cm. In this case, the VIVE can be a
more interesting option than the krypton CMM due the drastic
reduction in cost and the larger measurement space. When a
very low-cost positioning solution is required, it is possible to
achieve, on average, sub-decimeter accuracy for the price of
an webcam. However, both the HTC VIVE and the camera
based solution do not scale to larger environments, unlike for
the Marvelmind or Pozyx systems.
Future work can extend this analysis to include more posi-
tioning systems. For example by including commercially avail-
able optical tracking systems. Additional performance metrics
such as precision and power use could also be evaluated, to
provide a more complete assessment of the IPS. Finally, the
experiments in this paper were performed at approximately the
same movement speed. An evaluation at a range of velocities
could be useful for highly dynamic applications (e.g., drones).
ACKNOWLEDGMENT
Robin Amsters is an SB fellow of the Research Foundation
Flanders (FWO) under grant agreement 1S57718N.
REFERENCES
[1] L. Mainetti, L. Patrono, and I. Sergi, “A survey on indoor
positioning systems,” in 2014 22nd International Conference on
Software, Telecommunications and Computer Networks, SoftCOM
2014. IEEE, sep 2014, pp. 111–120. [Online]. Available: http:
//ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=7039067
[2] N. E. Klepeis et al., “National Human Activity Pattern Survey ( NHAPS
): Use of nationwide activity data for human exposure assessment The
National Human Activity Pattern Survey ( NHAPS ): a resource for
assessing exposure to environmental pollutants,” Journal of exposure
analysis and environmental epidemiology, 2001, pp. 231–252.
[3] P. Connolly and D. Bonte, “Indoor Location in Retail:
Where is the Money?” ABI Research, Tech. Rep., 2016,
URL: https://www.abiresearch.com/market-research/product/
1025355-indoor-location-in-retail-where-is-the-mon/ [accessed:
2018-12-21].
[4] R. Mautz, “Indoor Positioning Technologies,” Habilitation thesis, ETH
Zurich, 2012, URL: http://e-collection.library.ethz.ch/eserv/eth:5659/
eth-5659- 01.pdf [accessed: 2018-12-21].
[5] T. Van Haute et al., “Performance analysis of multiple Indoor Posi-
tioning Systems in a healthcare environment,” International Journal of
Health Geographics, vol. 15, no. 1, 2016, p. 7.
[6] A. Jimenez and F. Seco, “Comparing Decawave and Bespoon UWB
location systems: Indoor/outdoor performance analysis,” in 2016 In-
ternational Conference on Indoor Positioning and Indoor Navigation
(IPIN), vol. 66, no. 8. IEEE, oct 2016, pp. 1–8, URL: http://ieeexplore.
ieee.org/document/7743686/ [accessed: 2018-12-21].
[7] A. R. J. Ruiz and F. S. Granja, “Comparing Ubisense, BeSpoon, and
DecaWave UWB Location Systems: Indoor Performance Analysis,”
IEEE Transactions on Instrumentation and Measurement, vol. 66, no. 8,
2017, pp. 2106–2117.
[8] R. Maalek and F. Sadeghpour, “Accuracy assessment of ultra-wide
band technology in locating dynamic resources in indoor scenarios,”
Automation in Construction, vol. 63, 2016, pp. 12–26. [Online].
Available: http://dx.doi.org/10.1016/j.autcon.2015.11.009
[9] P. Dabove, V. Di Pietra, M. Piras, A. A. Jabbar, and S. A. Kazim,
“Indoor positioning using Ultra-wide band (UWB) technologies: Posi-
tioning accuracies and sensors’ performances,” 2018 IEEE/ION Posi-
tion, Location and Navigation Symposium, PLANS 2018 - Proceedings,
2018, pp. 175–184.
[10] M. Ridolfi et al., “Experimental evaluation of uwb indoor positioning
for sport postures,” Sensors (Switzerland), vol. 18, no. 1, 2018, pp.
1–20.
[11] J. Cernohorsk´
y and M. Nov´
ak, “Mobile robot indoor navigation,” 2016,
pp. 151–155.
[12] C.-M. Chang, C.-H. Hsu, C.-F. Hsu, and K.-T. Chen, “Performance
Measurements of Virtual Reality Systems: Quantifying the Timing and
Positioning Accuracy,” Proceedings of the 2016 ACM on Multimedia
Conference - MM ’16, 2016, pp. 655–659. [Online]. Available:
http://dl.acm.org/citation.cfm?doid=2964284.2967303
[13] D. C. Niehorster, L. Li, and M. Lappe, “The accuracy and precision of
position and orientation tracking in the HTC vive virtual reality system
for scientific research,” i-Perception, vol. 8, no. 3, 2017, pp. 1–23.
[14] S. Adler, S. Schmitt, K. Wolter, and M. Kyas, “A survey of experi-
mental evaluation in indoor localization research,” Indoor Positioning
and Indoor Navigation (IPIN), 2015 International Conference on, no.
October, 2015, pp. 1–10.
[15] S. Gezici et al., “Localization via ultra-wideband radios a look at
positioning aspects for future sensor networks,” IEEE Signal Processing
Magazine, vol. 22, no. 4, 2005, pp. 70–84.
[16] Pozyx Labs, “Pozyx - centimeter positioning for arduino,” 2015,
URL: https://www.pozyx.io/Documentation/Tutorials/ready to localize
[accessed: 2018-09-11].
[17] Valve, “VIVE - Vive Tracker,” 2017, URL: https://www.vive.com/us/
vive-tracker/ [accessed: 2018-09-11].
[18] O. Kreylos, “Lighthouse tracking examined — Doc-Ok.org,” 2016,
URL: http://doc-ok.org/?p=1478 [accessed: 2018-09-10].
[19] J. Van den Heuvel, “Driver Documentation,” 2018, URL:
https://github.com/ValveSoftware/openvr/wiki/Driver-Documentation
[accessed: 2018-12-21].
[20] S. Garrido-Jurado, R. Mu˜
noz-Salinas, F. J. Madrid-Cuevas, and
M. J. Mar´
ın-Jim´
enez, “Automatic generation and detection of highly
reliable fiducial markers under occlusion,” Pattern Recognition,
vol. 47, no. 6, jun 2014, pp. 2280–2292. [Online]. Available:
http://linkinghub.elsevier.com/retrieve/pii/S0031320314000235
[21] OpenCV, “Camera calibration With OpenCV OpenCV 2.4.13.7
documentation,” 2014, URL: https://docs.opencv.org/2.4/doc/tutorials/
calib3d/camera{ }calibration/camera{ }calibration.html [accessed:
2018-09-11].
[22] Krypton Electronic Engineering n.v., “Krypton Help Pages on
K400/K600 Hardware & Software Guide,” Leuven, Tech. Rep.,
2003. [Online]. Available: http://nees.buffalo.edu/training/krypton/
kx00 manual EN.PDF
[23] J. C. Gower, “Generalized procrustes analysis,” Psychometrika,
vol. 40, no. 1, 1975, pp. 33–51. [Online]. Available: https:
//doi.org/10.1007/BF02291478
[24] W. Kabsch, “A solution for the best rotation to relate two sets
of vectors,” Acta Crystallographica Section A, vol. 32, no. 5,
sep 1976, pp. 922–923. [Online]. Available: https://doi.org/10.1107/
S0567739476001873
20Copyright (c) IARIA, 2019. ISBN: 978-1-61208-691-0
ALLSENSORS 2019 : The Fourth International Conference on Advances in Sensors, Actuators, Metering and Sensing
... Object positioning techniques [1,2], particularly those low-cost but accurate, have gained significant traction in robotics research and education. Several of them have found widespread applications in the real world, such as location-based service and navigation. ...
... Global Positioning System (GPS) is one of the greatest revolutions in the localization application, and it can provide positioning information for almost all receivers on earth. However, it is not entirely amenable to indoor environments because the satellite signals can be blocked significantly by the walls of building construction [2]. Furthermore, the GPS accuracy (namely, the distance error between the ground truth and the reported position) of lowcost sensors is at the level of ~meters, and therefore, it cannot satisfy the requirements of many indoor applications. ...
... Hence, it emerges as the best option for the proposed system [23]. For example, the positioning accuracy of around 10 cm was achieved with the ArUco marker in experiments [2], although the positioning range is somewhat limited due to the use of only one camera. ...
Article
This paper presents a low-cost, accurate indoor positioning system that integrates image acquisition and processing and data-driven modeling algorithms for robotics research and education. Multiple overhead cameras are used to obtain normalized image coordinates of ArUco markers, and a new procedure is developed to convert them to the camera coordinate frame. Various data-driven models are proposed to establish a mapping relationship between the camera and the world coordinates. One hundred fifty data pairs in the camera and world coordinates are generated by measuring the ArUco marker at different locations and then used to train and test the data-driven models. With the model, the world coordinate values of the ArUco marker and its robot carrier can be determined in real time. Through comparison, it is found that a straightforward polynomial regression outperforms the other methods and achieves a positioning accuracy of about 1.5 cm. Experiments are also carried out to evaluate its feasibility for use in robot control. The developed system (both hardware and algorithms) is shared as an open source and is anticipated to contribute to robotic studies and education in resource-limited environments and underdeveloped regions.
... Low-cost technologies such as WiFi, ZigBee, and Bluetooth Low-Energy (BLE) are radio-frequency-based systems and are widely used in in mobile robots for indoor localization [14,15]. Although they are very popular due to the availability of the hardware, the accuracy of static measurements is in the order of 1 to 4 m [16]. ...
... The mobile robot location is estimated by exploiting approaches such as multilateration and trilateration [17]. In the paper [14], the authors benchmarked the accuracy of different types of indoor positioning systems including the Marvelmind robot. The experimental results demonstrated that, in larger spaces, there are situations where the Marvelmind system cannot not perform measurements because of corrupted packets identified using CRC methods, even if there are not any apparent sources of interference present. ...
Article
Full-text available
Monitoring and tracking issues related to autonomous mobile robots are currently intensively debated in order to ensure a more fluent functionality in supply chain management. The interest arises from both theoretical and practical concerns about providing accurate information about the current and past position of systems involved in the logistics chain, based on specialized sensors and Global Positioning System (GPS). The localization demands are more challenging as the need to monitor the autonomous robot’s ongoing activities is more stringent indoors and benefit from accurate motion response, which requires calibration. This practical research study proposes an extended calibration approach for improving Omnidirectional Mobile Robot (OMR) motion response in the context of mechanical build imperfections (misalignment). A precise indoor positioning system is required to obtain accurate data for calculating the calibration parameters and validating the implementation response. An ultrasound-based commercial solution was considered for tracking the OMR, but the practical observed errors of the readily available position solutions requires special processing of the raw acquired measurements. The approach uses a multilateration technique based on the point-to-point distances measured between the mobile ultrasound beacon and a current subset of fixed (reference) beacons, in order to obtain an improved position estimation characterized by a confidence coefficient. Therefore, the proposed method managed to reduce the motion error by up to seven-times. Reference trajectories were generated, and robot motion response accuracy was evaluated using a Robot Operating System (ROS) node developed in Matlab-Simulink that was wireless interconnected with the other ROS nodes hosted on the robot navigation controller.
... The parameter values for the prototype used in the experimental setup are r = 0.028m and b = 0.068m respectively, and the input saturation constraints arev = 0.19m/s andw = 2.82rad/s. The position (x, y) was measured using Marvelmind Indoor Positioning System [35] at 12 Hz. The utilization of Arduino as an intermediary between LEGO and Marvelmind facilitates swift code development, as significant portions of the code designed for simulation can be seamlessly transferred to Arduino. ...
Article
Full-text available
This paper presents a new control synthesis methodology for nonholonomic mobile robots subjected to time-varying delays and input saturation constraints. The proposed control method is based on smooth static nonlinear functions, leading to a simpler structure than other available control strategies for this class of systems. In addition, the convergence to a certain target position with guaranteed exponential decay rate can be proved for any orientation error. To this end, a nonlinear Lyapunov-Krasovskii functional has specifically been designed to deal with the inherent discontinuity of the kinematics model as well as the presence of time-varying delays. Thus, the control design can efficiently be addressed by means of Linear Matrix Inequalities (LMIs). Finally, the effectiveness of the proposed control design algorithm is validated through simulation and experimentally using a two-wheeled mobile robot.
... This off-the-shelf system has an attainable accuracy ranging of 0.02 m under lab conditions. Its high level of accuracy, low implementation cost, low energy consumption, and reliability in terms of signal strength under controlled conditions were some of the factors considered when selecting this hardware(Amsters et al. 2019). During the research, six (6) stationary ultrasonic beacons, one (1) mobile beacon and one(1)modem/router linked to each one via a radio interface were used. ...
Thesis
The high rate of fatalities in the construction domains is one of the major concerns of both practitioners and researchers. The dynamic nature of the construction, the limited number of safety managers, and the difficulty of visiting inaccessible, hard-to-reach, or unsafe locations are some of the factors that adversely affect the capability to frequently and adequately monitor construction sites and, therefore, identify hazards. Unmanned aerial systems (UASs) and positioning technologies have become potential tools for enhancing safety-related tasks on construction jobsites. This study aims to develop, assess, and implement customized UASs and positioning sensors for enhancing safety monitoring and hazard identification process on construction jobsites. To accomplish this objective, an exploratory case study was carried out to compare safety managers' risk perception using UAS-generated and traditional-based visual content. Later, an ultrasound-based positioning system was developed and tested on real construction sites. The main objective of the system was to determine workers' position and calculate their hazard exposure time indoors, mainly where UASs cannot operate for collecting visual data. Finally, two UASs were designed, developed, and tested using commercially available open-source software and hardware. The first UAS was equipped with a dual-frequency GNSS (L1/L2) and Post Processed Kinematic (PPK) technology to increase the quality and accuracy of the 3D visual representation of construction sites. A second UAS, iSafeUAS, was designed and tested to minimize the potential safety risks associated with UAS deployment for construction safety-related applications. The outcome of this research showed that the systematic use of both UASs and positioning technology on construction sites allows enhancing safety managers' risk perception, reduces time and effort during the data collection process, increases the amount and quality of the information retrieved, and minimizes the risk associated with the data collection process.
... In the next few years, most of the smartphones will integrate UWB chipsets [7,8] and/or support the WiFi FTM protocol [9]. Following the trend of the market and knowing the advantages that both technologies bring for indoor positioning, UWB and WiFi FTM are likely to become the de facto positioning technologies for indoors [10][11][12][13]. From the victims' perspective, the tendency of the integration of UWB and WiFi FTM in the chipsets makes the cost associated with this integration virtually null. ...
Article
Full-text available
Detecting and locating victims in emergency scenarios comprise one of the most powerful tools to save lives. Fast actions are crucial for victims because time is running against them. Radio devices are currently omnipresent within the physical proximity of most people and allow locating buried victims in catastrophic scenarios. In this work, we present the benefits of using WiFi Fine Time Measurement (FTM), Ultra-Wide Band (UWB), and fusion technologies to locate victims under rubble. Integrating WiFi FTM and UWB in a drone may cover vast areas in a short time. Moreover, the detection capacity of WiFi and UWB for finding individuals is also compared. These findings are then used to propose a method for detecting and locating victims in disaster scenarios.
... Measurement of movement patterns and patient posture has applications in disease screening and detection of emergency situations which leads to better and faster health-care decisions in remote home care. Another example of infrared is the VIVE tracker that requires so called infrared lighthouses to be installed in the room of interest [240]. Each lighthouse is equipped with two lasers, which sweep across its horizontal and vertical axes. ...
Article
Full-text available
Remote health care is currently one of the most promising solutions to ensure a high level of treatment outcome, cost-efficiency and sustainability of the healthcare systems worldwide. Even though research on remote health care can be traced back to the early days of the Internet, the recent COVID-19 has necessitated further improvement in existing health care systems with invigorated research on remote health care technologies. In this article we delve into the state-of-the-art research in latest technologies and technological paradigms that play a vital role in enabling the next generation remote health care and assisted living. First the need of using the latest technological developments in the domain of remote health care is briefly discussed. Then the most important technologies and technological paradigms that are crucial in enabling remote health care and assisted living are emphasised. Henceforth, a detailed survey of existing technologies, potential challenges in those technologies, and possible solutions is conducted. Finally, missing research gaps and important future research directions in each enabling technology are brought forth to motivate further research in remote health care.
... Measurement of movement patterns and patient posture has applications in disease screening and detection of emergency situations which leads to better and faster health-care decisions in remote home care. Another example of infrared is the VIVE tracker that requires so called infrared lighthouses to be installed in the room of interest [238]. Each lighthouse is equipped with two lasers, which sweep across its horizontal and vertical axes. ...
Preprint
Full-text available
This article surveys the latest developments in the technological landscape that enables remote health care. First, the most important technologies that are crucial for remote health care such as 5G, medical IoT, big data analytics, machine learning, and distributed ledger technologies, etc., are outlined, and then a thorough survey on those technologies with latest state-of-the-art applications in remote health care is conducted. Furthermore, very important research challenges and future research directions are laid out to initiate further research on those very important technologies that enable remote health care.
Article
Full-text available
Radio frequency (RF)-based indoor positioning systems (IPSs) use wireless technologies (including Wi-Fi, Zigbee, Bluetooth, and ultra-wide band (UWB)) to estimate the location of persons in areas where no Global Positioning System (GPS) reception is available, for example in indoor stadiums or sports halls. Of the above-mentioned forms of radio frequency (RF) technology, UWB is considered one of the most accurate approaches because it can provide positioning estimates with centimeter-level accuracy. However, it is not yet known whether UWB can also offer such accurate position estimates during strenuous dynamic activities in which moves are characterized by fast changes in direction and velocity. To answer this question, this paper investigates the capabilities of UWB indoor localization systems for tracking athletes during their complex (and most of the time unpredictable) movements. To this end, we analyze the impact of on-body tag placement locations and human movement patterns on localization accuracy and communication reliability. Moreover, two localization algorithms (particle filter and Kalman filter) with different optimizations (bias removal, non-line-of-sight (NLoS) detection, and path determination) are implemented. It is shown that although the optimal choice of optimization depends on the type of movement patterns, some of the improvements can reduce the localization error by up to 31%. Overall, depending on the selected optimization and on-body tag placement, our algorithms show good results in terms of positioning accuracy, with average errors in position estimates of 20 cm. This makes UWB a suitable approach for tracking dynamic athletic activities.
Article
Full-text available
The advent of inexpensive consumer virtual reality equipment enables many more researchers to study perception with naturally moving observers. One such system, the HTC Vive, offers a large field-of-view, high-resolution head mounted display together with a room-scale tracking system for less than a thousand U.S. dollars. If the position and orientation tracking of this system is of sufficient accuracy and precision, it could be suitable for much research that is currently done with far more expensive systems. Here we present a quantitative test of the HTC Vive’s position and orientation tracking as well as its end-to-end system latency. We report that while the precision of the Vive’s tracking measurements is high and its system latency (22 ms) is low, its position and orientation measurements are provided in a coordinate system that is tilted with respect to the physical ground plane. Because large changes in offset were found whenever tracking was briefly lost, it cannot be corrected for with a one-time calibration procedure. We conclude that the varying offset between the virtual and the physical tracking space makes the HTC Vive at present unsuitable for scientific experiments that require accurate visual stimulation of self-motion through a virtual world. It may however be suited for other experiments that do not have this requirement.
Article
Full-text available
Most ultrawideband (UWB) location systems already proposed for position estimation have only been individually evaluated for particular scenarios. For a fair performance comparison among different solutions, a common evaluation scenario would be desirable. In this paper, we compare three commercially available UWB systems (Ubisense, BeSpoon, and DecaWave) under the same experimental conditions, in order to do a critical performance analysis. We include the characterization of the quality of the estimated tag-to-sensor distances in an indoor industrial environment. This testing space includes areas under line-of-sight (LOS) and diverse non-LOS conditions caused by the reflection, propagation, and the diffraction of the UWB radio signals across different obstacles. The study also includes the analysis of the estimated azimuth and elevation angles for the Ubisense system, which is the only one that incorporates this feature using an array antenna at each sensor. Finally, we analyze the 3-D positioning estimation performance of the three UWB systems using a Bayesian filter implemented with a particle filter and a measurement model that takes into account bad range measurements and outliers. A final conclusion is drawn about which system performs better under these industrial conditions.
Conference Paper
Full-text available
Several UWB location systems have already been proposed for accurate position estimation. These UWB systems, some available at commercial level, and others implemented as laboratory test-beds, have been individually evaluated for particular applications and under different fusion strategies. In this paper we compare two commercially available UWB systems (Decawave and Bespoon) under exactly the same experimental conditions, in order to generate a critical analysis about their performances. The analysis includes the characterization of the range error in Line-Of-Sight (LOS) and Non-Line-Of-Sight (NLOS) conditions. The NLOS conditions include the propagation/difraction of radio signals across furniture, metallic cabinets and several brick walls in indoor scenarios. The analysis also includes the 2D/3D positioning performance of both UWB systems using a particle filter estimation approach that takes into account NLOS conditions.
Article
Full-text available
The combination of an aging population and nursing staff shortages implies the need for more advanced systems in the healthcare industry. Many key enablers for the optimization of healthcare systems require provisioning of location awareness for patients (e.g. with dementia), nurses, doctors, assets, etc. Therefore, many Indoor Positioning Systems (IPSs) will be indispensable in healthcare systems. However, although many IPSs have been proposed in literature, most of these have been evaluated in non-representative environments such as office buildings rather than in a hospital. To remedy this, the paper evaluates the performance of existing IPSs in an operational modern healthcare environment: the “Sint-Jozefs kliniek Izegem” hospital in Belgium. The evaluation (data-collecting and data-processing) is executed using a standardized methodology and evaluates the point accuracy, room accuracy and latency of multiple IPSs. To evaluate the solutions, the position of a stationary device was requested at 73 evaluation locations. By using the same evaluation locations for all IPSs the performance of all systems could objectively be compared. Several trends can be identified such as the fact that Wi-Fi based fingerprinting solutions have the best accuracy result (point accuracy of 1.21 m and room accuracy of 98 %) however it requires calibration before use and needs 5.43 s to estimate the location. On the other hand, proximity based solutions (based on sensor nodes) are significantly cheaper to install, do not require calibration and still obtain acceptable room accuracy results. As a conclusion of this paper, Wi-Fi based solutions have the most potential for an indoor positioning service in case when accuracy is the most important metric. Applying the fingerprinting approach with an anchor installed in every two rooms is the preferred solution for a hospital environment.
Conference Paper
Full-text available
During the last decade, research in indoor localization and navigation has focused on techniques, protocols, and algorithms. The first International Conference on Indoor Positioning and Indoor Navigation (IPIN) was held in 2010. Since then, this annual conference showed the progress of research and technology. The variations of evaluation methods are significant in this field: they range from none, to extensive simulations, and real-world experiments under non-lab conditions. We look at the articles published in the proceedings of IPIN by IEEE Xplore from 2010 to 2014, and analyze the development of evaluation methods. We categorized randomly selected papers, in respect to five different aspects. Namely: (1) the underlying system/technology in use, (2) the evaluation method for the proposed technique, (3) the method of ground truth data gathering, (4) the applied metrics, and (5) whether the authors establish a baseline for their work.
Conference Paper
We propose the very first non-intrusive measurement methodology for quantifying the performance of commodity Virtual Reality (VR) systems. Our methodology considers the VR system under test as a black-box and works with any VR applications. Multiple performance metrics on timing and positioning accuracy are considered, and detailed testbed setup and measurement steps are presented. We also apply our methodology to several VR systems in the market, and carefully analyze the experiment results. We make several observations: (i) 3D scene complexity affects the timing accuracy the most, (ii) most VR systems implement the dead reckoning algorithm, which incurs a non-trivial correction latency after incorrect predictions, and (iii) there exists an inherent trade-off between two positioning accuracy metrics: precision and sensitivity.
Conference Paper
The paper describes the design of a simple and robust navigation system based on odometry and global ultrasonic position system. The ultrasonic system precision was tested and the results are shown in this paper. The Extended Kalman Filter is used for data handling, which helps us to handle noise from sensor.
Article
The use of Ultra-Wideband (UWB) technology in reporting the real-time location of resources (workers and equipment) is shown to be effective in improving the current safety monitoring practices. Since many site accidents occur when workers are struck by moving equipment or enter hazard-prone areas, it is important to evaluate the accuracy of the UWB RTLS in estimating the location of dynamic resources on construction sites. In this paper, the effects of variables, such as "speed" and "heading", on the accuracy of the estimated location of dynamic tags are investigated. It is shown that the accuracy is inversely proportionate to the speed of the tag, the number of tags being tracked and the complexity of the path on which the tag is moving. A novel approach to defining "danger zones" on construction sites is also proposed through which the feasibility of using static tags to define the boundaries of forbidden areas on site is validated. The findings of this study indicate the applicability of UWB in locating dynamic resources on construction sites.