Fig 12 - uploaded by Chinmay Manohar
Content may be subject to copyright.
(a) Fingerprint minutia points [21] (b) Minutia points extracted from branches of facial vasculature 

(a) Fingerprint minutia points [21] (b) Minutia points extracted from branches of facial vasculature 

Source publication
Article
Full-text available
The facial vascular network is highly characteristic to the individual, much like the way his fingerprint is. A non-obtrusive way to capture this informa-tion is through thermal imaging. The convective heat transfer effect from the flow of "hot" arterial blood in superficial vessels creates characteristic thermal imprints, which are at a gradient w...

Contexts in source publication

Context 1
... 15] Buddharaju et. al showed that the performance of the biometric identification system based on facial vasculature is very promising. This leaves the following two characteristics of facial vasculature to be addressed in order to be considered as a good biometric technology: 1. Uniqueness: is it possible for two persons to have same vascular structure on the face? 2. Repeatability: is facial vasculature invariant with time? In [21] Pankanti et. al studied intra-class and inter-class variations among fingerprints probabilistically using the minutia points extracted from fingerprint ridges. Recently Zhu et. al developed a stochastic model to capture variability among fingerprint minutia datasets [22]. Similar techniques can be applied to study the variability among facial vasculature of different individuals. Minutia points can be extracted from branching points of vessels similar to the way fingerprint minutia points are extracted at the bifurcations and endings of fingerprint ridges as shown in Figure 12. The pattern of the underlying blood vessels of the face(and the corresponding thermal imprints) is quite complex (see Figure 1). The question is if this complex pattern is characteristic to each individual and can serve as a useful biometric signature. In the area of medicine some very interesting work was conducted regard- ing the uniqueness of the facial vascular network. The primary motivation behind this line of research was the localization of anatomical features for reconstructive surgery purposes. For example Pinar and Govsa in [23] conducted extensive research on the anatomy of the Superficial Temporal Artery (STA) and its branches. They studied the STA anatomy in 27 subjects. Among other things they found that the bifurcation point of STA (see Figure 13) was above the zygomatic arch in only 20 out of the 27 samples. In 6 samples the bifurcation was exactly over the arch and in one sample there was no bifurcation at all. Further variability was observed in the STA branches. Specifically, in one sample double parietal branches were observed. In 21 samples zygomatico- orbital arteries ran towards the face, parallel to zygomatic arch and distributed in the orbicularis oculi muscle. One has to take into account that STA is only one major facial vessel among many. Assuming that such variability is typical to other facial vessels and branches, their combination is bound to produce a very characteristic pattern for each individual. In another study, medical researchers found implicit evidence of uniqueness of the cutaneous vasculature in the high variability of reflex drives [24]. In addition, one has to take into account that the proposed face recognition method does not depend only on the topology of the facial vascular network but also on the fat depositions and skin complexion. The reason is that im- agery is formed by the thermal imprints of the vessels and not the vessels directly. Even if the vessel topology was absolutely the same across individuals, still the thermal imprints would differ due to variable absorption from different fat padding (skinny faces versus puffy faces) [25] and variable heat conductance from different skin complexion (dark skin is less conductive). Besides the medical evidence that appears to be strong and the support- ing heat transfer principles, “uniqueness” of the facial vascular network is also reinforced by experimental investigation we presented in our previous efforts [14, 15]. Such experimental investigations constitute the main “proof of uniqueness” in other biometric modalities (e.g., fingerprint recognition [21]) and of course they gain more weight as the size of the databases increases. In the case of thermal facial vessel imprints, the size of the databases is still relatively small, yet statistically significant (several hundred samples). One particular example that makes a very strong case for “uniqueness” is the dis- covery of different thermal facial vessel imprints even in identical twins [13]. In the last few years one relevant biometric that has gained acceptance is the venous structure at the back of the hand. It is imaged typically with active near-infrared light and the image is formed due to back-scattering. The claim of “uniqueness” is based primarily on experimental evidence from database classification efforts. No substantial medical research was pursued on the uniqueness of the hand’s venous structure, as reconstructive hand surgery is not as prevalent as facial surgery. In addition, the venous network at the back of the hand is not nearly as complicated as the facial vessel network (see Figure 1). Yet, it is increasingly accepted as a legitimate biometric [26] and it is used in practice [27] based mainly on experimental evidence from database classification efforts. Hence, evidence from medical research and reasoning based on heat transfer principles suggest that the facial vessel network is characteristic to each individual. As shown in Figure 12, minutia points can be extracted from the branches of blood vessel contours in ways similar to those used for fingerprint minutia extraction. Numerous methods have been proposed for matching fingerprint minutiae, most of which try to simulate the way forensic experts compare fingerprints [28]. Similar techniques can be employed to match thermal minutia points of two subjects. We first reported the complete matching algorithm and experimental results on University of Houston database in [14, 15], where the interested reader may find more details. A major challenge associated with thermal face recognition is the recognition performance over time [29]. Facial thermograms may change depending on the physical condition of the subject. This renders difficult the task of acquiring similar features for the same person over time. Previous face recognition methods in thermal infrared that use direct temperature data reported degraded performance over time [10, 30]. However, our method attempts to solve this problem by extracting facial physiological information to build its feature space. This information is not only characteristic to each person but also remains relatively invariant to physical conditions. Although, the thermal facial maps of the same subject appear to shift, the vascular network is more resistant to change. In imaging terms, the contrast between the temperatures in the vascular pixels and the surrounding pixels is relatively invariant, albeit the absolute temperature values shift appreciably. This is a direct consequence of the thermoregulatory mechanism of the human body. Our morphological image processing simply capitalizes upon this phenomenon and extracts the invariant vascular contours out of the variable facial thermal maps. Due to the small number of subjects in the University of Houston database for whom we had images spread over several months, no statistically significant quantification of the low permanence problem was possible. For this reason, we obtained permission to apply the method on the database of the University of Notre Dame [31]. This database has a large collection of facial images acquired from both visible and long-wave infrared cameras. They held acquisitions weekly and most of the subjects in the database participated multiple times. In more detail, the database consists of 2294 images acquired from 63 subjects during 9 different sessions under specific lighting and expression conditions. The spatial resolution of the images is 312 × 239 pixels (about half of that featured in the UH database). They used three lights during data collection, one located in the center approximately 8ft in front of the subject, one located at 4ft to the right, and the other 4ft to the left of the subject. The subjects were asked to provide two expressions during acquisition - “neutral” and “smiling”. The database is divided into four different gallery and probe sets using FERET style naming convention [32]: 1. LF (central light turned off) + FA (neutral expression) 2. LF (central light turned off) + FB (smiling expression) 3. LM (all three lights on) + FA (neutral expression) 4. LM (all three lights on) + FB (smiling expression) The database also contains an exclusive training set (different from the gallery and probe sets) with samples collected from several subjects, from which a face space can be constructed for the PCA recognition algorithm. We did not use this training set since our algorithm is feature-based and hence does not require any explicit training. However, each of the gallery sets (say LF—FA) can be tested against the other three probe sets (say LF—FB, LM—FA, and LM—FB). This way we tested our algorithm on 12 different pairs of gallery and probe sets. In each of these experiments, the gallery set had one image per subject, and the probe set had several disjoint images per subject depending on how many different acquisition sessions did the subject attend. Figure 14 shows a sample of the gallery and probe images of a subject from the University of Notre Dame ...
Context 2
... a and b are points of sets A and B respectively, and d ( a, b ) is any metric between these points ; for simplicity, we’ll take d ( a, b ) as the Euclidean distance between a and b . The algorithm to find out the Hausdorff distance is: Figure 11 shows the Hausdorff distance calculated between our manual segmented data and the original data. The low Hausdorff distance values indicate that the two sets in our case are close to each other. In other words, the automatically segmented vessel curves are very close to the expertly drawn ones. If a human physiological or behavioral characteristic has to be considered as a biometric feature, it should satisfy certain desirable characteristics such as universality , uniqueness , repeatability , collectability , performance , accept- ability , and circumvention [1]. Every living and non-living object at a finite temperature emits radiations, which are captured by infrared cameras. The temperature data can be universally extracted by applying Planck’s equation on the radiations captured from the face, which on further analysis yields vascular structure. The main advantage of face recognition among other biometric technologies is that it is completely non-contact and allows for on-the-fly identification. Minimal or no cooperation is demanded from a person in order to extract his/her facial vasculature. Hence, this technology is easily collectable and is highly acceptable . Since the vascular network lies below the skin and is imaged through its function (blood flow), it is almost impossible to be forged making it very hard to circumvent . In [14, 15] Buddharaju et. al showed that the performance of the biometric identification system based on facial vasculature is very promising. This leaves the following two characteristics of facial vasculature to be addressed in order to be considered as a good biometric technology: 1. Uniqueness: is it possible for two persons to have same vascular structure on the face? 2. Repeatability: is facial vasculature invariant with time? In [21] Pankanti et. al studied intra-class and inter-class variations among fingerprints probabilistically using the minutia points extracted from fingerprint ridges. Recently Zhu et. al developed a stochastic model to capture variability among fingerprint minutia datasets [22]. Similar techniques can be applied to study the variability among facial vasculature of different individuals. Minutia points can be extracted from branching points of vessels similar to the way fingerprint minutia points are extracted at the bifurcations and endings of fingerprint ridges as shown in Figure 12. The pattern of the underlying blood vessels of the face(and the corresponding thermal imprints) is quite complex (see Figure 1). The question is if this complex pattern is characteristic to each individual and can serve as a useful biometric signature. In the area of medicine some very interesting work was conducted regard- ing the uniqueness of the facial vascular network. The primary motivation behind this line of research was the localization of anatomical features for reconstructive surgery purposes. For example Pinar and Govsa in [23] conducted extensive research on the anatomy of the Superficial Temporal Artery (STA) and its branches. They studied the STA anatomy in 27 subjects. Among other things they found that the bifurcation point of STA (see Figure 13) was above the zygomatic arch in only 20 out of the 27 samples. In 6 samples the bifurcation was exactly over the arch and in one sample there was no bifurcation at all. Further variability was observed in the STA branches. Specifically, in one sample double parietal branches were observed. In 21 samples zygomatico- orbital arteries ran towards the face, parallel to zygomatic arch and distributed in the orbicularis oculi muscle. One has to take into account that STA is only one major facial vessel among many. Assuming that such variability is typical to other facial vessels and branches, their combination is bound to produce a very characteristic pattern for each individual. In another study, medical researchers found implicit evidence of uniqueness of the cutaneous vasculature in the high variability of reflex drives [24]. In addition, one has to take into account that the proposed face recognition method does not depend only on the topology of the facial vascular network but also on the fat depositions and skin complexion. The reason is that im- agery is formed by the thermal imprints of the vessels and not the vessels directly. Even if the vessel topology was absolutely the same across individuals, still the thermal imprints would differ due to variable absorption from different fat padding (skinny faces versus puffy faces) [25] and variable heat conductance from different skin complexion (dark skin is less conductive). Besides the medical evidence that appears to be strong and the support- ing heat transfer principles, “uniqueness” of the facial vascular network is also reinforced by experimental investigation we presented in our previous efforts [14, 15]. Such experimental investigations constitute the main “proof of uniqueness” in other biometric modalities (e.g., fingerprint recognition [21]) and of course they gain more weight as the size of the databases increases. In the case of thermal facial vessel imprints, the size of the databases is still relatively small, yet statistically significant (several hundred samples). One particular example that makes a very strong case for “uniqueness” is the dis- covery of different thermal facial vessel imprints even in identical twins [13]. In the last few years one relevant biometric that has gained acceptance is the venous structure at the back of the hand. It is imaged typically with active near-infrared light and the image is formed due to back-scattering. The claim of “uniqueness” is based primarily on experimental evidence from database classification efforts. No substantial medical research was pursued on the uniqueness of the hand’s venous structure, as reconstructive hand surgery is not as prevalent as facial surgery. In addition, the venous network at the back of the hand is not nearly as complicated as the facial vessel network (see Figure 1). Yet, it is increasingly accepted as a legitimate biometric [26] and it is used in practice [27] based mainly on experimental evidence from database classification efforts. Hence, evidence from medical research and reasoning based on heat transfer principles suggest that the facial vessel network is characteristic to each individual. As shown in Figure 12, minutia points can be extracted from the branches of blood vessel contours in ways similar to those used for fingerprint minutia extraction. Numerous methods have been proposed for matching fingerprint minutiae, most of which try to simulate the way forensic experts compare fingerprints [28]. Similar techniques can be employed to match thermal minutia points of two subjects. We first reported the complete matching algorithm and experimental results on University of Houston database in [14, 15], where the interested reader may find more details. A major challenge associated with thermal face recognition is the recognition performance over time [29]. Facial thermograms may change depending on the physical condition of the subject. This renders difficult the task of acquiring similar features for the same person over time. Previous face recognition methods in thermal infrared that use direct temperature data reported degraded performance over time [10, 30]. However, our method attempts to ...

Similar publications

Conference Paper
Full-text available
Synthetic fingerprint generation has two major advantages. First, it is possible to create arbitrarily large databases for research purposes e.g. of a million or a billion fingerprints at virtually no cost and without legal constraints. Secondly, together with the generated fingerprint images comes additional ground truth information for free such...
Article
Full-text available
We propose a fully automatic minutiae extractor, called MinutiaeNet, based on deep neural networks with compact feature representation for fast comparison of minutiae sets. Specifically, first a network, called CoarseNet, estimates the minutiae score map and minutiae orientation based on convolutional neural network and fingerprint domain knowledge...
Article
Full-text available
Measuring the performance of forensic evaluation methods that compute likelihood ratios (LRs) is relevant for both the development and the validation of such methods. A framework of performance characteristics categorized as primary and secondary is introduced in this study to help achieve such development and validation. Ground-truth labelled fing...
Conference Paper
Full-text available
We propose a fully automatic minutiae extractor, called MinutiaeNet, based on deep neural networks with compact feature representation for fast comparison of minutiae sets. Specifically, first a network, called CoarseNet, estimates the minutiae score map and minutiae orientation based on convolutional neural network and fingerprint domain knowledge...
Article
Full-text available
Fingerprint verification and identification algorithms based on minutiae features are used in many biometric systems today (e.g., governmental e-ID programs, border control, AFIS, personal authentication for portable devices). Researchers in industry/academia are now able to utilize many publicly available fingerprint databases (e.g., Fingerprint V...

Citations

... The major drawback with the Thermal sensor is that as it uses infrared technology, it cannot capture data behind glass as glass is opaque in infrared; it gets reflected when it hits a material made of glass [137]. Also, the hair present on the face (mainly facial hair like beard or mustache) blocks infrared radiation. ...
Article
Full-text available
In this modern era, user authentication has become vital regarding security and privacy in keeping their information and valuables safe. Password or pin-based authentication systems are insufficient to protect the security of individuals. People now anticipate more dependable and secure biometric authentication systems as a result of virtualization in both academics and industry. In this study, we discussed biometrics, various biometric authentication methods, and the work in each biometric system. We summarised and emphasised the significant contribution made by several researchers in this field. Our goal is to present a thorough analysis that may throw light on the important contributions and aid researchers looking to contribute their work to biometrics.
... Another significant challenge of biometrics includes a scenario whereby, should the user be involved in an accident and lose an eye, finger or facial changes occur because of scratches or cuts, the biometric system will not recognise the user and will reject the user as a result of the physical changes or damages (Aly et al. 2008;Buddharaju, Pavlidis & Manohar 2008). ...
Article
Full-text available
Background: Over the years, attention has been focused on digital banking and financial technology with little or no attention being paid to biometric banking technology. Objective: The study aimed to investigate the need for security and simplicity in the authentication of retail payments, digital banking and financial technology through the application of biometric systems. Method: The study employed quantitative research methodology and a response rate of 52% was achieved. A set of questionnaires was distributed for data collection. Results: The study’s findings indicated it is imperative for all businesses that participate in financial businesses to fully implement the best possible security measures or systems to ensure or enhance security for financial business activities. Conclusion: Based on the findings of the study, it is recommended that businesses must adopt the new innovative and secured mechanisms of financial dealings to enhance innovation, security and flexibility.
... The identification of drunk people has its basis in biology, medicine, and toxicology. Alcohol causes motor disturbances and disturbances in the psychic system, resulting in abnormal behaviour on a biological level, such as dilation of blood vessels [2][3][4][5][6] and increased blood pressure. In the case of the human face, there is a temperature increase in capillary density, such as around the nose, forehead, and eyes. ...
... In [9], it is concluded that alcohol causes an increase in the temperature of the eyes, which could be useful for classification. In [8], the extraction of the vascular network is proposed based on the works of Buddharaju et al. [3][4][5][6]. When analysing the total area in pixels of the vascular network of a sober subject compared to a drunk subject, it may be possible to obtain an indicator (feature) to identify whether the subject has consumed alcohol. ...
Article
Full-text available
The aim of this study is to propose a system that is capable of recognising the identity of a person, indicating whether the person is drunk using only information extracted from thermal face images. The proposed system is divided into two stages, face recognition and classification. In the face recognition stage, test images are recognised using robust face recognition algorithms: Weber local descriptor (WLD) and local binary pattern (LBP). The classification stage uses Fisher linear discriminant to reduce the dimensionality of the features, and those features are classified using a classifier based on a Gaussian mixture model, creating a classification space for each person, extending the state-of-the-art concept of a “DrunkSpace Classifier.” The system was validated using a new drunk person database, which was specially designed for this work. The main results show that the performance of the face recognition stage was 100% with both algorithms, while the drunk identification saw a performance of 86.96%, which is a very promising result considering 46 individuals for our database in comparison with others that can be found in the literature.
... Another technique is FM RIB Linear Image Registration Tool (FLIRT). This technique is a much better technique from other techniques for registering the thermal image [6] [10] [58] [70]. After registering the thermal image we have performed the thermal signature extraction process. ...
Article
Full-text available
—Identification of people among each other has always been a tough and challenging task for the researchers. There are many techniques which are used for identifying a person but bio-metric technique is the standard one which allows us for online identification of individuals on the basis of their physiological and behavioral features. The veins based systems include finger veins, face veins, palm veins, head veins, heart veins, iris, palatal veins of the rogue etc. The multi-veins based systems use the veins of different physiological traits for identifying a person. This paper illustrates an overview of veins based personal identification systems. The performance of different single and multi-veins based identification systems are analyzed in this paper. The features like reliability, security, accuracy, robustness and long term stability along with the strengths and weaknesses of various veins based bio-metric approaches were taken into considerations while analyzing the results of existing research papers published so far. At last the future research directions in the field of veins based identification systems have also been outlined.
... Currently, new methodologies for thermal face recognition based on vascular information [5][6][7] and fusion of visible and thermal spectrum images have been b The Equinox thermal database is available at http://www.equinoxsensors.com/products/HID.html. ...
Article
Full-text available
This paper shows a comparative study among di®erent local matching-based methods for thermal infrared face recognition. The principal assumption of this work is that the thermal face corresponds to the di®use energy emission captured by an infrared camera, where the thermal signature is unique for each subject and it can be addressed as a texture descriptor with thermal images. Local matching-based methods ¯nd inter-class di®erences that improve the face recognition rate in thermal spectrum. Speci¯cally, this work considers four methods: Local Binary Pattern (LBP), Local Derivative Pattern (LDP), Weber Linear Descriptor (WLD) and Histograms of Oriented Gradients Descriptors (HOG). The methods are evaluated and compared using the UCHThermalFace database, that considers real-world conditions and unconstrained environments, such as indoor and outdoor setups, natural variations in illumination, facial expression, pose, accessories, occlusions, and background. Results indicate that HOG variants followed by LBP method achieved the best recognition rates for face recognition systems
... Face veins based identification is an advanced technique which is used for personal identification. In the face veins based techniques, the thermal image of a person is taken with the help of IR camera [3] [9]. Only IR cameras are eligible for showing the structures of face veins and blood vessels that carry the warm blood in all body parts, and it is the ultimate reason due to which the human skin is warm in nature. ...
... Buddharaju Pradeep et al. used thermal image for extracting the vessels and blood perfusion for showing the face veins just like a finger veins with the help of facial vasculature structure [3]. Arandjelovic Ognegen et al. proposed a technique in which they first took visual images and then took thermal images and these images were compared with the help of principle of angle and data processing [2]. ...
... P1={ (1,3), (2,4), (3,13), (4,28), (5,26), (6,18), (7,24), (8,29), (9,24), (10,11), (11,17), (12,33), (13,47), (14,50), (15,51), (16,57), (17,53), (18,45), (19,26), (20,53), (21,43), (22,53), (23,3), (24,1), (25,12), (26,20), (27,30), (28,53), (29, 61), (30,68), (31,71), (32,79), (33,62), In the figure 17, vertices and edge lengths between two vertices are represented with the help of integer values. In fig. ...
Article
Full-text available
Face veins based personal identification is a challenging task in the field of identity verification of a person. It is because many other techniques are not identifying the uniqueness of a person in the universe. This research paper finds the uniqueness of a person on the basis of face veins based technique. In this paper five different persons face veins images have been used with different rotation angles (left/right 90 0 to 270 0 and 315 0 ). For each person , eight different images at different rotations were used and for each of these images the same minimum cost minutiae tree (MCMT) is obtained . Here, Prim‟s or Kruskal‟s algorithm is used for finding the MCMT from a minutiae graph. The MCMT is traversed in pre -order to generate the unique string of vertices and edge lengths. We deviated the edge lengths of each MCMT by five pixels in positive and negative directions for robustness testing. It is observed in our experiments that the traversed string which consists of vertices and edge lengths of MCMT is unique for each person and this unique sequence is correctly identifying a person with an accuracy of above 95%. Further, we have compared the performance of our proposed technique with other standard techniques and it is observed that the proposed technique is giving the promising result.
... These problems encouraged the interest in the use of thermal images for face recognition because of the great resistance to forgery it can achieve and their high immunity to illumination changes and several other sources of variability in the acquisition of images that enables these systems to operate in real non-controlled environments [8] [9]. Face recognition systems using thermal images use techniques adapted from visible-spectrum image face recognition [8]- [10], and new techniques that are specific for thermal images [18] [19]. A comparison of several techniques for thermal faces is shown in [20]. ...
Conference Paper
Full-text available
In this article a robust thermal face recognition methodology based on the use of local interest points and descriptors, is proposed. The methodology consists of the following stages: face segmentation, vascular network detection, wide baseline matching using local interest points and descriptors, and classification. The main contribution of this work is the use of a standard wide baseline matching methodology for the comparison of vascular networks from thermal face images. The proposed methodology is validated using a database of thermal images. This work could be of high interest for HRI applications related with the visual recognition of humans, as the ones included in the RoboCup @Home league, because the use of thermal images may overcome limitations such as dependency on illumination conditions and facial expressions.
... The authors have presented a physiological facial recognition method that promotes a different way of thinking about face recognition in thermal infrared [5,6,3]. This work has shown that facial physiological information, extracted in the form of superficial vascular network, can serve as good and time-invariant feature vector for face recognition. ...
Conference Paper
The previous work of the authors has shown that physiological information on the face can be extracted from thermal infrared imagery and can be used as a biometric. Although, that work has proved the feasibility of physiological face recognition, the experimental results revealed high false acceptance rates due to methodological weaknesses in the feature extraction and matching algorithms. This paper, presents a new methodology that corrects these problems and yields high recognition rates. Specifically, a post-processing algorithm removes fake vascular contours, which degraded performance. Also, a new vascular network matching algorithm copes with deformations caused by varying facial pose and expressions. First, it estimates the facial pose in the test image and then calculates the deformation of the vascular network in the database image. Next, it registers test and database vascular networks using the dual bootstrap iterative closest point (ICP) matching algorithm. Finally, it computes a matching score between the vascular networks, which is a function of overlapping vessel pixels. Extensive experiments have been undertaken to test the new method. The results highlight its superiority.
... Known techniques used in visible face image recognition are also used with infrared images, like Eigenfaces or Fisherfaces [4]. More recently in [5] and [6], the authors propose a face recognition technique based on the extraction of physiological information from high temperature regions in thermal face images. The extracted physiological information is related to the network of blood vessels under the skin. ...
... In this work we extend the physiological extraction approach proposed in [5] and [6]. We present a new approach for face recognition in the infrared spectrum using a rich network of physiological features. ...
Article
Full-text available
In this work we present an efficient approach for face recognition in the infrared spectrum. In the proposed approach physiological features are extracted from thermal images in order to build a unique thermal faceprint. Then, a distance transform is used to get an invariant representation for face recognition. The obtained physiological features are related to the distribution of blood vessels under the face skin. This blood network is unique to each individual and can be used in infrared face recognition. The obtained results are promising and show the effectiveness of the proposed scheme. Keywords—Face recognition, biometrics, infrared imaging. I. INTRODUCTION