ArticlePDF Available

Linear barcode scanning system based on dynamic template matching for OOF blurred images

Authors:
  • Vellore Institute of Technology

Abstract and Figures

A Novel Linear Barcode scanning system based on a Dynamic template matching scheme. The proposed system works entirely in the Spatial domain and is capable of reading Linear Barcodes from low-resolution Images containing severe OOF blur. This paper treats Linear barcode scanning under the perspective of deformed Binary waveform analysis and classification. A directed graphical model is designed to characterize the relationship between the blurred barcode waveform and its corresponding symbol value at any specific blur level. A Dynamic programming-based inference algorithm is designed to retrieve the optimal state sequence, enabling real-time decoding on Mobile devices of limited processing power.
Block diagram of proposed system DYNAMIC TEMPLATE MATCHING Dynamic Template Matching (DTM) which can efficiently find the optimal state variable sequence and, therefore, the barcode value. Merits of the Proposed Systems are as .(i)It gives the capability to deal with OOF level.(ii)Its capability of real-time processing, which is made possible by directed graphical model.(iii)Similar to OOF blur any blur can able to handle by proposed techniques.(iv)Directed graphical model will help to generate closer scan line of original barcodes. MODULE DESCRIPTION The work presented in this paper consists of the following major modules such as  Barcode localization  Linear barcode scan line segmentation and observation sequence modelling  Standard reference waveform segments generation  A directed graphical model  Dynamic template matching RESULTS Figure 2 & 3 shows the Clear & Blurred Input Images .Figure 4 & 5 shows the Gray scale conversion of Clear & Blurred Input Images respectively .Figure 6 & 7 shows the Gradient Images .Figure 8 & 9 shows the Gaussian Motion Filtered Noise. Figure 10 & 11 is the Binarized Barcode. Figure 12 & 13 is Deformed Scanline.Figure 14 & 15 is Observation sequence. Figure 16 & 17 is Standard Deviation Waveform. FUTURE ENHANCEMENT This paper mainly addresses the analysis and classification of binary waveforms under OOF blur in the form of linear barcode scanning, the methodology presented can be extended to other Blurs such as moving Blur and other related domains, such as Document Analysis & Recognition, where Image blurs are also challenging issues and Deblurring is normally resorted for Character Segmentation and Word Recognition
… 
Content may be subject to copyright.
INTERNATIONAL CONFERENCE ON RECENT ADVANCEMENT IN MECHANICAL ENGINEERING &TECHNOLOGY
(ICRAMET’ 15)
Journal of Chemical and Pharmaceutical Sciences ISSN: 0974-2115
JCHPS Special Issue 9: April 2015 www.jchps.com Page 418
LINEAR BARCODE SCANNING SYSTEM BASED ON DYNAMIC TEMPLATE
MATCHING FOR OOF BLURRED IMAGES
D.Vijendra Babu, S.Shalini, P.T.Sarath, Enugula Niharika, Ismail Shurab
ECE Department, Aarupadai Veedu Institute of Technology, Vinayaka Missions University, Paiyanoor-603
104.Chennai.Tamil Nadu.
ABSTRACT
A Novel Linear Barcode scanning system based on a Dynamic template matching scheme. The proposed
system works entirely in the Spatial domain and is capable of reading Linear Barcodes from low-resolution Images
containing severe OOF blur. This paper treats Linear barcode scanning under the perspective of deformed Binary
waveform analysis and classification. A directed graphical model is designed to characterize the relationship
between the blurred barcode waveform and its corresponding symbol value at any specific blur level. A Dynamic
programming-based inference algorithm is designed to retrieve the optimal state sequence, enabling real-time
decoding on Mobile devices of limited processing power.
Key Words: Barcode, Dynamic Template Matching, Blurred Images
INTRODUCTION
Digital Image refers to processing of a 2 Dimensional picture by a Digital Computer. In a broader context,
it implies Digital processing of any two dimensional data. A Digital Image is an array of real or complex numbers
represented by a finite number of bits. An Image given in the form of a transparency, slide, photograph or an X-ray
is first digitized and stored as a matrix of binary digits in computer memory. This digitized image can then be
processed and/or displayed on a high-resolution television monitor. An Image Processor does the functions of
Image Acquisition, Storage, Pre-processing, Segmentation, Representation, Recognition and Interpretation and
finally displays or records the resulting image. Digital Image Processing has a broad spectrum of applications, such
as Remote Sensing, Medical Processing, RADAR, SONAR & Acoustic Image Processing, Robotics & Automated
inspection of Industrial parts.
This paper mainly addresses the analysis and classification of Binary waveforms under Out of Focus
(OOF) Blur in the form of Linear Barcode scanning, the methodology presented can be extended to other blurs
such as moving Blur and other related domains, such as Document Analysis and Recognition, where Image Blurs
are also challenging issues and Deblurring is normally resorted for Character Segmentation and Word Recognition
BARCODE
Barcode Technology has found its applications in many industries and has been playing an important part
in people’s daily lives. Multiple generations of barcode scanning systems ranging from earlier LASER Scanners to
more recent area Charge Coupled Device (CCD) scanners have been invented and developed. As the location/size
information of bars and spaces is of paramount importance for deciphering information embedded in barcodes,
modern barcode scanning systems generally request well-focused barcode signals, which help in the retrieval of
location/size-related features by confining the edge interaction between the code patterns. Depth-of-field (DOF),
the range of distance at which the scanned symbol is sufficiently in focus to be read without error, is an important
aspect of any specific barcode scanning system. Area CCD scanners have the advantage of reading both linear and
2D barcodes, but have less DOF than that of laser scanners, because the directional and coherent nature of laser
light permits expanded DOF. This DOF constraint has limited the availability of area CCD scanners on various
occasions. For example, linear barcode scanning based services are largely not available on mobile devices with
fixed-focus lenses because the barcode images captured by these devices contain excess edge interactions triggered
by out-of-focus (OOF) blur, which cannot be handled by current techniques.
Unfortunately, images taken by cell phone cameras are often of low quality. Many cell phone cameras on
the market are equipped with low-grade lenses, generally lacking focusing capability, which often produce blurred
images. Few cell phones have a flash and, therefore, motion blur and noise can be expected with low ambient light.
All of these factors, possibly combined with low image resolution, make barcode reading difficult in certain
situations. Indeed, all existing image-based barcode readers have limited performance when it comes to images
taken in difficult light conditions, or when the camera is not close enough to the barcode. In order to improve
accuracy, barcode reading apps usually prompt the user to precisely position the camera to ensure that the barcode
covers as much of the frame as possible. This operation can be somewhat bothersome, as it requires a certain
amount of interaction with the user, who needs to frame the barcode correctly using the viewfinder.
EXISTING SYSTEM
Existing system requires that the Barcode has been localized with fairly good precision. This operation is
facilitated by the fact that a Barcode is bordered to the side by a white area whose size is prescribed by the
standard. We propose a simple and fast algorithm for localization that assumes that the bars are approximately
INTERNATIONAL CONFERENCE ON RECENT ADVANCEMENT IN MECHANICAL ENGINEERING &TECHNOLOGY
(ICRAMET’ 15)
Journal of Chemical and Pharmaceutical Sciences ISSN: 0974-2115
JCHPS Special Issue 9: April 2015 www.jchps.com Page 419
vertical. The localization algorithm has no pretense of optimality but works reasonably well in existing method.
The disadvantages of the Existing methods are (i)OOF blur cannot be handled by current techniques,(ii)not feasible
for real-time barcode scanning in real-world situations,(iii)Template matching scheme only matches the scan lines
which are not affected by maximum noise & (iv) Its capability of real-time processing, which is made quite
impossible because sometimes resolution low images may need to find.
PROPOSED SYSTEM
The proposed approach is different in the aspects that it neither exploits Blur invariant features because
none of the currently popular features are robust to severe OOF blur, nor tries to reconstruct OOF free barcode
signal from the blurred images because Image Reconstruction is usually a mathematically ill-defined problem,
computationally difficult to be dealt with. One notable feature of the proposed system is that its Template Matching
scheme takes Image Blur and interactions of character templates into consideration by modelling the waveform of
Barcode characters and their interactions at any specific Blur level. This gives the proposed system the capability to
deal with severe OOF level. The maximum OOF blur level that can be handled by the current implementation of
the proposed system is up to seven times of the X-dimension of a Barcode. Another feature of the proposed system
is its capability of Real Time processing, which is needed in practical situations. This feature is made possible by
designing a directed graphical model, which not only establishes the relationship between the blurred barcode
waveform and its corresponding symbol value
Figure.1.Block diagram of proposed system
DYNAMIC TEMPLATE MATCHING
Dynamic Template Matching (DTM) which can efficiently find the optimal state variable sequence and,
therefore, the barcode value. Merits of the Proposed Systems are as .(i)It gives the capability to deal with OOF
level.(ii)Its capability of real-time processing, which is made possible by directed graphical model.(iii)Similar to
OOF blur any blur can able to handle by proposed techniques.(iv)Directed graphical model will help to generate
closer scan line of original barcodes.
MODULE DESCRIPTION
The work presented in this paper consists of the following major modules such as
Barcode localization
Linear barcode scan line segmentation and observation sequence modelling
Standard reference waveform segments generation
A directed graphical model
Dynamic template matching
RESULTS
Figure 2 & 3 shows the Clear & Blurred Input Images .Figure 4 & 5 shows the Gray scale conversion of
Clear & Blurred Input Images respectively .Figure 6 & 7 shows the Gradient Images .Figure 8 & 9 shows the
Gaussian Motion Filtered Noise. Figure 10 & 11 is the Binarized Barcode. Figure 12 & 13 is Deformed
Scanline.Figure 14 & 15 is Observation sequence. Figure 16 & 17 is Standard Deviation Waveform.
FUTURE ENHANCEMENT
This paper mainly addresses the analysis and classification of binary waveforms under OOF blur in the
form of linear barcode scanning, the methodology presented can be extended to other Blurs such as moving Blur
and other related domains, such as Document Analysis & Recognition, where Image blurs are also challenging
issues and Deblurring is normally resorted for Character Segmentation and Word Recognition
INTERNATIONAL CONFERENCE ON RECENT ADVANCEMENT IN MECHANICAL ENGINEERING &TECHNOLOGY
(ICRAMET’ 15)
Journal of Chemical and Pharmaceutical Sciences ISSN: 0974-2115
JCHPS Special Issue 9: April 2015 www.jchps.com Page 420
Figure 1
Figure 2
Figure3
Figure4
Figure5
Figure6
Figure7
Figure8
Figure9
Figure10
INTERNATIONAL CONFERENCE ON RECENT ADVANCEMENT IN MECHANICAL ENGINEERING &TECHNOLOGY
(ICRAMET’ 15)
Journal of Chemical and Pharmaceutical Sciences ISSN: 0974-2115
JCHPS Special Issue 9: April 2015 www.jchps.com Page 421
Figure11
Figure12
Figure13
Figure14
Figure15
Figure16
REFERENCES
A.Zamberletti, I. Gallo, M. Carullo, and E. Binaghi, Neural image restoration for decoding 1-D barcodes using
common camera phones, In Proc. 5th Int. Conf. Comput. Vision Theory and Appl., 2010, 511.
D. Kundur and D. Hatzinakos, Blind image deconvolution, IEEE Signal Process. Mag., 13(3), 4363, 1996.
Information TechnologyAutomatic Identification and Data Capture TechniquesBar Code Symbology
SpecificationEAN/UPC, ISO Standard IEC 15420, 2000.
J. Liang, D. Doermann, and H. Li, Camera-based analysis of text and documents: A survey, Int. J. Document Anal.
Recognit., 7(2-3), 2005, 84104.
J. Massieu, Autofocus barcode scanner and the like employing micro-fluidic lens, U.S. Patent 7 296 749, Nov. 20,
2007.
K. Wang, Y. Zou, and H. Wang, 1D bar code reading on camera phones, Int. J. Image Graph., vol. 7, no. 3, pp.
529550, 2007.
N. Dridi, Y. Delignon, W. Sawaya, and F. Septier, Blind detection of severely blurred 1D barcode, in Proc.
GLOBECOM, Dec. 2010, pp. 15.
O. Gallo and R. Manduchi, Reading 1D barcodes with mobile phones using deformable templates, IEEE Trans.
Pattern Anal. Mach. Intell, vol. 33, no. 9, pp. 18341843, Sep. 2011.
R. Choksi and Y. van Gennip, Deblurring of one dimensional bar codes via total variation energy minimization,
SIAM J. Imag.Sci., vol. 3, no. 4, pp. 735764, 2010.
R. Fischer, B. Tadic-Galeb, and P. Yoder, Optical System Design, 2nd ed. New York, NY, USA: McGraw-Hill,
Jan. 2008.
R. Shams and P. Sadeghi, Bar code recognition in highly distorted and low resolution images, in Proc. IEEE
ICASSP, vol. 1. Apr. 2007, pp. I-737I-740.
S. Esedoglu, Blind deconvolution of bar code signals, Inverse Problems, vol. 20, no. 1, pp. 121135, Feb. 2004.
T. Miwa and T. Matsushima, Bar code reading apparatus with multifocal length optical system, U.S. Patent 5 473
149, Dec. 5, 1995.
T. Wittman, Lost in the supermarket: Decoding blurry barcodes, SIAM News, 37(7), 2004, 56.
W. Turin and R. A. Boie, Bar code recovery via the EM algorithm, IEEE Trans. Signal Process, vol. 46, no. 2, pp.
354363, Feb. 1998.
... In present trend, biomedical research is using Artificial Intelligence for speeding up the results. A large number of applications, such as data classification, Image classification [43,45,47,49], segmentation are performed using the artificial intelligence, deep learning models [22,23]. The lung infections are found in most of the people affected with the novel virus as it affects the lungs of the patients. ...
Article
Full-text available
The whole world facing a huge crisis because of Corona virus also known as COVID-2019, identified first in December 2019 in the city of Wuhan located in China. The detection of persons infected with the virus is most important as it can be spread easily from him to others and also the person infected with the virus may not know that he is infected until a number of symptoms fallout from him. In this paper the virus detection is done using deep learning and machine learning algorithms using the X-ray images. A dataset is created with three classes consisting of normal, corona virus, and pneumonia images. The proposed method uses ResNet50 and SVM, deep learning features are extracted using ResNet50 and classification is done using SVM classifier. The classification accuracy obtained from the model is 100% when testing on the Corona virus and normal images, whereas the results obtained from the model is 94% when it is tested on the dataset consisting of normal, Corona virus and pneumonia images and performed well compared to VGG16.
Article
Full-text available
_________________________________________________________________________________ Environment disasters are unavoidable, but we can avoid loss of lives and some precious items if we are informed about the disaster before its occurrence. The objective of the paper is to design a system which is able to inform the disaster in advance. Nowadays everyone is connected with the internet and the mobile devices with internet can be utilized as alarm. It also be utilized as the monitoring device for the natural disaster, the device is connected with internet and communicating their data using the cloud through IoT.IoT cloud management system is utilized to communicate with the multiple devices by means of IVR, Messaging services, e-mail and emergency signaling etc.
Conference Paper
Full-text available
In this paper, we present a joint blind channel estimation and symbol detection for decoding a blurred and noisy 1D barcode captured image. From an information transmission point of view, we show that the channel impulse response, the noise power and the symbols can be efficiently estimated by taking into account the signal structure such as the cyclostationary property of the hidden Markov process to estimate. Based on the Expectation-Maximisation method, we show that the new algorithm offers significative performance gain compared to classical ones pushing back the frontiers of the barcode technology.
Conference Paper
Full-text available
The existing open-source libraries for 1-D barcodes recognition are not able to recognize the codes from images acquired using simple devices without autofocus or macro function. In this article we present an improvement of an existing algorithm for recognizing 1-D barcodes using camera phones with and without autofocus. The multilayer feedforward neural network based on backpropagation algorithm is used for image restoration in order to improve the selected algorithm. Performances of the proposed algorithm were compared with those obtained from available open-source libraries. The results show that our method makes possible the decoding of barcodes from images captured by mobile phones without autofocus.
Article
Linear barcodes—the ubiquitous alternating black and white stripes whose relative widths encode information—are used in shipping, tracking, and identification and come in more than 250 varieties. The most familiar is probably the UPC barcode used in supermarkets; based on their grocery-shopping experience, most readers probably consider the reading of barcodes a trivial problem. Indeed, when I presented a poster on this topic in May at the SIAM IS04 conference in Salt Lake City, the most common initial response was: "Huh. I didn't think this was a problem." Certainly, the problem as it appears in the checkout lane has been solved. The standard countertop laser scanner is equipped with mirrors that obtain signals from multiple angles. Handheld laser scanners are by necessity less powerful and less accurate—they are not capable of gathering multiple signals, and the optical devices cannot be as large and unwieldy as those of their countertop counterparts. Nevertheless, barcodes have found many applications outside the grocery store. Shipping companies like UPS and the US Postal Service have developed their own coding schemes for package identification and tracking. Many states issue driver's licenses with two-dimensional barcodes that encode information about the driver and a rough sketch of the photograph. Some hospitals place barcodes on every drug container, syringe, and even patient. Entomologists glue tiny barcodes to the backs of flying insects and strategically place scanners around hives to track insect flight patterns and mating habits. Some libraries and warehouses are experimenting with inventory robots, placing barcodes not only on the items but also on the walls, where they give the robots encoded directions for navigating obstacles. As the use of barcodes becomes more sophisticated, there is a need for smaller and more accurate barcode scanners, as well as superior decoding algorithms. In 1999, Ruben Muniz, Luis Junco, and Adolpho Otero described a striking example of the current limits of barcode decoding [1]. They looked into the large pharmaceutical warehouses that distribute drugs to local drugstores in most metropolitan areas; a pharmacy places a request to the warehouse by sending an order form with three barcodes, representing the patient, medicine, and price. The authors visited their local warehouse in the Spanish province of Asturias, which receives about 1.5 million orders every month. The order forms are usually printed on low-resolution dot-matrix printers; doctors' sprawling signatures frequently cover at least part of the barcodes. The automated scanner was able to decode only 50% of the orders, forcing human intervention 750,000 times a month. Using a Hough transform, the authors were able to improve the decoding rate to 85% of orders; even so, hundreds of thousands of unreadable order forms remained. Rather than trying to improve the scanner's optics, Fadil Santosa (my thesis adviser) suggested an alternative approach: Look for ways to improve the scanner's deblurring algorithms. I must admit that I was skeptical when he first proposed this research problem. Foreshadowing the response to my poster at IS04, I asked, "Is this really a problem?" Fortunately, his research instincts are far superior to mine, and my work on barcodes has uncovered several interesting avenues of research in signal and image processing. (This work also caught the attention of the R&D department at Symbol Technologies, the world's largest manufacturer of handheld barcode scanners. I am writing this article for SIAM News from Symbol's New York office, where, as a research intern, I am working on mathematical techniques for improving the resolution of imaging scanners. If a billion-dollar industry is willing to give money to a math grad student, it must be for a genuine research problem.) The ideal barcode signal u is a one-dimensional 0–1 step signal; the signal u 0 received by a scanner is a noisy, blurred version of u. The goal is to recover u, given u 0 . We model the blurring process by u 0 = G a,w * u + n, (1) where n is the noise and G a,w is a Gaussian of amplitude a and width scaled by a factor w: 2 , exp / . a w G x a x w (2) Because the parameters a and w are uncorrelated, G does not necessarily have unit area. The results of the convolution are similar in appearance to the signals actually encountered (see Figure 1). Each of the parameters in (1) describes a different noise process. The additive noise n can result from electrical noise in the scanner or from source defects, such as stray marks on the paper. The amplitude a is controlled by the intensity of the scanner and the ambient light. The blur factor w models the size of the laser spot relative to the size of the Figure 1. Top, synthetic image of a UPC barcode encoding 0123456789. Middle, the ideal signal u. Bottom, blurred signal u 0 ,with a = .05, w = .012, and a moderate amount of additive noise.
Article
The increasing availability of high-performance, low-priced, portable digital imaging devices has created a tremendous opportunity for supplementing traditional scanning for document image acquisition. Digital cameras attached to cellular phones, PDAs, or wearable computers, and standalone image or video devices are highly mobile and easy to use; they can capture images of thick books, historical manuscripts too fragile to touch, and text in scenes, making them much more versatile than desktop scanners. Should robust solutions to the analysis of documents captured with such devices become available, there will clearly be a demand in many domains. Traditional scanner-based document analysis techniques provide us with a good reference and starting point, but they cannot be used directly on camera-captured images. Camera-captured images can suffer from low resolution, blur, and perspective distortion, as well as complex layout and interaction of the content and background. In this paper we present a survey of application domains, technical challenges, and solutions for the analysis of documents captured by digital cameras. We begin by describing typical imaging devices and the imaging process. We discuss document analysis from a single camera-captured image as well as multiple frames and highlight some sample applications under development and feasible ideas for future development.
Conference Paper
In this paper, we present a novel approach to detection of one dimensional bar code images. Our algorithm is particularly designed to recognize bar codes, where the image may be of low resolution, low quality or suffer from substantial blurring, de-focusing, non-uniform illumination, noise and color saturation. The algorithm is accurate, fast, scalable and can be easily adjusted to search for a valid result within a specified time constraint. Our algorithm is particularly useful for real-time recognition of bar codes in portable hand-held devices with limited processing capability, such as mobile phones.
Article
The availability of camera phones provides people with a mobile platform for decoding bar codes, whereas conventional scanners lack mobility. However, using a normal camera phone in such applications is challenging due to the out-of-focus problem. In this paper, we present the research effort on the bar code reading algorithms using a VGA camera phone, NOKIA 7650. EAN-13, a widely used 1D bar code standard, is taken as an example to show the efficiency of the method. A wavelet-based bar code region location and knowledge-based bar code segmentation scheme is applied to extract bar code characters from poor-quality images. All the segmented bar code characters are input to the recognition engine, and based on the recognition distance, the bar code character string with the smallest total distance is output as the final recognition result of the bar code. In order to train an efficient recognition engine, the modified Generalized Learning Vector Quantization (GLVQ) method is designed for optimizing a feature extraction matrix and the class reference vectors. 19 584 samples segmented from more than 1000 bar code images captured by NOKIA 7650 are involved in the training process. Testing on 292 bar code images taken by the same phone, the correct recognition rate of the entire bar code set reaches 85.62%. We are confident that auto focus or macro modes on camera phones will bring the presented method into real world mobile use.
Article
Using total variation-based energy minimization we address the recovery of a blurred (convoluted) one dimensional (1D) bar code. We consider functionals defined over all possible bar codes with fidelity to a convoluted signal of a bar code and regularized by total variation. Our fidelity terms consist of the $L^2$ distance either directly to the measured signal or preceded by deconvolution. Key length scales and parameters are the $X$-dimension of the underlying bar code, the size of the supports of the convolution and deconvolution kernels, and the fidelity parameter. For all functionals, we establish parameter regimes (sufficient conditions) wherein the underlying bar code is the unique minimizer. We also present some numerical experiments suggesting that these sufficient conditions are not optimal and the energy methods are quite robust for significant blurring.
Article
The ubiquitous supermarket checkout scanner is indeed a well engineered and effective device. There is, nevertheless, demand for better devices. Existing scanners rely on simple and indeed low-cost signal processing to interpret bar code signals. These methods, nevertheless, fundamentally limit label reading and cannot be extended. A new method based on the deterministic EM algorithm is described. First results show a substantial improvement in label reading depth of field, which is an important performance parameter for bar code readers
Article
Bar code reconstruction involves recovering a clean signal from an observed one that is corrupted by convolution with a kernel and additive noise. The precise form of the convolution kernel is also unknown, making reconstruction harder than in the case of standard deblurring. On the other hand, bar codes are functions that have a very special form—this makes reconstruction feasible. We develop and analyse a total variation based variational model for the solution of this problem. This new technique models systematically the interaction of neighbouring bars in the bar code under convolution with a kernel, as well as the estimation of the unknown parameters of the kernel from global information contained in the observed signal.