ArticlePDF Available

Why do you attract me but not others? Retrieval of person knowledge and its generalization bring diverse judgments of facial attractiveness

Authors:

Abstract and Figures

Judgments of facial attractiveness play an important role in social interactions. However, it still remains unclear why these judgments are malleable. The present study aimed to understand whether the retrieval of person knowledge leads to different judgments of attractiveness of the same face. Event-related potentials and learning-recognition tasks were used to investigate the effects of person knowledge on facial attractiveness. The results showed that compared with familiar faces that were matched with negative person knowledge, those matched with positive person knowledge were evaluated as more attractive and evoked a larger early posterior negativity (EPN) and late positive complex (LPC). Additionally, positive similar faces had the same behavioral results and evoked large LPC, while unfamiliar faces did not have any significant effects. These results indicate that the effect of person knowledge on facial attractiveness occurs from early to late stage of facial attractiveness processing, and this effect could be generalized based on the similarity of the face structure, which occurred at the late stage. This mechanism may explain why individuals form different judgments of facial attractiveness.
Content may be subject to copyright.
Full Terms & Conditions of access and use can be found at
https://www.tandfonline.com/action/journalInformation?journalCode=psns20
Social Neuroscience
ISSN: (Print) (Online) Journal homepage: https://www.tandfonline.com/loi/psns20
Why do you attract me but not others? Retrieval
of person knowledge and its generalization bring
diverse judgments of facial attractiveness
Shangfeng Han , Shen Liu , Yue Li , Wanyue Li , Xiujuan Wang , Yetong Gan ,
Qiang Xu & Lin Zhang
To cite this article: Shangfeng Han , Shen Liu , Yue Li , Wanyue Li , Xiujuan Wang , Yetong
Gan , Qiang Xu & Lin Zhang (2020): Why do you attract me but not others? Retrieval of person
knowledge and its generalization bring diverse judgments of facial attractiveness, Social
Neuroscience, DOI: 10.1080/17470919.2020.1787223
To link to this article: https://doi.org/10.1080/17470919.2020.1787223
Accepted author version posted online: 30
Jun 2020.
Published online: 09 Jul 2020.
Submit your article to this journal
Article views: 5
View related articles
View Crossmark data
Why do you attract me but not others? Retrieval of person knowledge and its
generalization bring diverse judgments of facial attractiveness
Shangfeng Han
a,b,c,d
, Shen Liu
e
, Yue Li
a,f
, Wanyue Li
a
, Xiujuan Wang
a
, Yetong Gan
a
, Qiang Xu
a
and Lin Zhang
a
a
Department and Institute of Psychology, Ningbo University, Ningbo, China;
b
Shenzhen Key Laboratory of Affective and Social Neuroscience,
Shenzhen University, Shenzhen, China;
c
Center for Brain Disorders and Cognitive Sciences, Shenzhen University, Shenzhen, China;
d
Center for
Neuroimaging, Shenzhen Institute of Neuroscience, Shenzhen, China;
e
School of Humanities and Social Sciences, University of Science and
Technology of China, Hefei, China;
f
KunMing Health Vocational College, KunMing, China
ABSTRACT
Judgments of facial attractiveness play an important role in social interactions. However, it still
remains unclear why these judgments are malleable. The present study aimed to understand
whether the retrieval of person knowledge leads to dierent judgments of attractiveness of the
same face. Event-related potentials and learning-recognition tasks were used to investigate the
eects of person knowledge on facial attractiveness. The results showed that compared with
familiar faces that were matched with negative person knowledge, those matched with positive
person knowledge were evaluated as more attractive and evoked a larger early posterior negativity
(EPN) and late positive complex (LPC). Additionally, positive similar faces had the same behavioral
results and evoked large LPC, while unfamiliar faces did not have any signicant eects. These
results indicate that the eect of person knowledge on facial attractiveness occurs from early to
late stage of facial attractiveness processing, and this eect could be generalized based on the
similarity of the face structure, which occurred at the late stage. This mechanism may explain why
individuals form dierent judgments of facial attractiveness.
ARTICLE HISTORY
Received 19 July 2019
Revised 22 April 2020
Published online 11 July
2020
KEYWORDS
Person knowledge;
generalization; facial
attractiveness; late positive
complex; early posterior
negativity
1. Introduction
Although the love of beauty is part of human nature,
individual dierences exist in esthetic tastes. When dif-
ferent individuals meet the same stranger, the impres-
sions of the stranger are not the same on everyone.
Numerous studies have indicated that individuals spon-
taneously form impressions of newly encountered indi-
viduals based on their facial appearance (Ritchie et al.,
2017; Vernon et al., 2014). Facial attractiveness is not
only a key social preference and an important dimension
of rst impressions, inuencing mate choice and social
assessments of age and health (C. A. M. Sutherland et al.,
2016; C. A. Sutherland et al., 2013; Vernon et al., 2014),
but it also has a signicant impact on subsequent social
interactions (Olivola et al., 2014; Todorov et al., 2015).
Therefore, it attracts widespread attention from
researchers across diverse elds. Previous studies have
found that judgments of facial attractiveness are stable
and that they show cross-cultural consistency (Chen
et al., 1997; Rhodes et al., 2001). On the other hand,
recent studies have reported that this judgment is malle-
able and that dierent individuals judge the same face
dierently (Y. Q. Wang et al., 2015; Thiruchselvam et al.,
2016; Zhang et al., 2014). However, extant studies have
not yet been able to explain why judgments of facial
attractiveness are both stable and malleable. It can be
proposed that dierences in perception may lead to
dierences in judgment. The present study aimed to
explain the reason for the dierences in facial attractive-
ness judgments from the perspective of perceptual
processing.
Observers not only see the conguration of the eyes,
nose, etc., on the face, but they also extract relevant
person knowledge, such as trait, biographical memory,
and so on from faces (Jack & Schyns, 2015, 2017). The
classic face-processing model proposed by Bruce and
Young (1986) also points out that face recognition con-
tains both congural and identity-related information.
They proposed that the rst step in this process involves
the encoding of the structure of the face, which is
a bottom-up process. This is followed by two indepen-
dent and parallel processing stages involving the per-
ception of idiosyncratic (e.g., identity-specic) and
generic (e.g., identity-nonspecic) aspects of faces,
CONTACT Lin Zhang zhanglin1@nbu.edu.cn Department and Institute of Psychology, Social Cognition and Behavior Laboratory, Ningbo University,
Ningbo City 315211, China; Shen Liu liushenpsy@ustc.edu.cn School of Humanities and Social Sciences, University of Science and Technology of China,
No. 96, Jinzhai Road, Baohe District, Hefei City 230022, China
Supplemental data for this article can be accessed here.
SOCIAL NEUROSCIENCE
https://doi.org/10.1080/17470919.2020.1787223
© 2020 Informa UK Limited, trading as Taylor & Francis Group
which is a top-down process. Thus, according to the
perceptual processing approach, the process of face
recognition includes both a bottom-up processing of
facial structure information and a top-down processing
of person knowledge related to the face (Bruce & Young,
1986). Quinn and Macrae (2011), aligned with Bruce and
Young’s model, but further emphasized the role of social
cognition. They suggested that the bottom-up con-
straints of visual processing and the top-down inu-
ences of semantic knowledge would contribute to
a more comprehensive understanding of face percep-
tion. In line with this viewpoint, previous studies found
that facial attractiveness is determined by various objec-
tive characteristics of the stimulus (Rhodes, 2006).
Generally, when a face is similar to the average face,
more symmetrical, and more in line with the facial char-
acteristics of one’s own gender, it is appraised as more
attractive (Trujillo et al., 2014; Vingilis-jaremko & Maurer,
2013; T. Yang et al., 2015). Thus, the eect of the struc-
tural information of the face on facial attractiveness is
relatively stable. However, questions about the storage
and extraction of social knowledge are not clearly
answered by the face recognition model and related
research.
According to the associative learning theory, the sto-
rage and extraction of person knowledge can be divided
into the associative learning stage and the generalized
stage (Feldmanhall et al., 2018). Dierent valences of
person knowledge are used as unconditioned stimuli
and faces as conditioned stimuli. After learning to
match faces with person knowledge of dierent
valences, faces would carry the same valence as the
information provided through the matched person
knowledge. Furthermore, the person knowledge of
faces is stored in individuals’ long-term memory system.
Therefore, the establishment of facial attractiveness
should originate from the experience of real-life social
interactions (Kocsor & Bereczkei, 2016, 2017). However,
as individuals can have dierent experiences from dif-
ferent social interactions with the same person, the per-
son knowledge of the same face stored in their memory
could vary. For example, Han et al. (2018) found that,
when faces were matched with dierent person knowl-
edge, the judgment of faces that were previously equally
attractive became dierent. Therefore, the extraction of
person knowledge related to faces may account for the
malleable attractiveness perception of faces.
Associative learning theory may bring a new perspec-
tive to facial processing, as Fiske et al. oer insights on
the content of processing. These researchers proposed
that there are two universal dimensions of social cogni-
tion, including warmth and competence (Fiske et al.,
2008), which are also used for describing and judging
people (Han et al., 2018). Therefore, in the present study,
behavior statements containing messages of warmth
and competence were used to let participants form
impressions of faces (Quist et al., 2012; Watkins, 2017).
In most studies, participants are asked to learn face and
behavior sentence pairs to obtain person knowledge
about faces (Y. Q. Wang et al., 2015; Zhang et al., 2014).
Previous studies have shown that person knowledge
about faces impacts facial attractiveness in a top–down
manner, and that faces that are paired with positive
descriptions are perceived as more attractive
(Y. Q. Wang et al., 2015; Zhang et al., 2014). Zhang
et al. (2014) paired positive, neutral, and negative traits
with faces and found that the faces paired with positive
traits were reported as being more attractive than those
matched with negative traits.
However, these studies cannot fully account for the
divergent behavioral responses, owing to other inu-
ences on attractiveness judgment, such as the response
bias. Specically, previous studies using behavioral judg-
ment have attribute divergent behavior responses to
post-perceptual changes, which may bring the response
bias (Otten et al., 2016). For example, highly attractive
same-sex targets were regarded as a threat by percei-
vers. Therefore, even though they perceive others’ facial
attractiveness as high, they are reluctant to give high
scores to them. Event-related potentials (ERPs), as
a powerful tool for probing the temporal dynamics of
neural processes (Amodio et al., 2013), can explain how
high-level social knowledge, such as person knowledge
inuences facial attractiveness processing.
Electrophysiological data can oer explanations regard-
ing whether person knowledge can indeed change per-
ceptual processes and their time course.
Previous studies reveal that face evaluation is fast
(Todorov et al., 2015) and faces can be accurately eval-
uated in less than 100 ms (Olson & Marshuetz, 2005;
D. Yang et al., 2011). In addition, face-related person
knowledge regulates the processing of face perception
and person knowledge related to traits aects face pro-
cessing from the early stage to the late stage (Luo et al.,
2016). For example, Zhao et al. (2017) found that face-
related information inuenced face perception and that
faces matched with high competence sentences evoked
larger early posterior negativity (EPN) than those with
neutral sentences. EPN is typically interpreted as reect-
ing enhanced perceptual processing of aective stimuli;
it is also an early component in facial attractiveness
processing (Werheid et al., 2007). Studies on facial attrac-
tiveness have shown that attractive faces evoke greater
early negative EPN than unattractive faces (Rellecke
et al., 2011; Werheid et al., 2007), and evoke the late
positive component (LPC; Rellecke et al., 2011; Schacht
2S. HAN ET AL.
et al., 2008; Zhang & Deng, 2012). LPC, which is a late
component in facial attractiveness processing (Werheid
et al., 2007), is mainly inuenced by intrinsic motivation
(Lu et al., 2014) and is considered to be related to a more
rened aective stimulation processing (Schacht &
Sommer, 2009). In addition, some studies found that
the perceiver’s person knowledge could aect facial
perception, which occurred in the early stage of percep-
tion (Luo et al., 2016; Thiruchselvam et al., 2016).
Repetition and expectation of a face could regulate the
perception of facial attraction through top-down proces-
sing, and this regulation occurs in the early stage of
perception, which evokes a larger EPN (Thiruchselvam
et al., 2016). Therefore, the person knowledge of the
observer could regulate the perception of facial attrac-
tiveness through top-down processing, which might
occur in the early stage of perception. Based on the
above-mentioned ndings, we proposed the following
hypothesis: Person knowledge eects on perception of
facial attractiveness occur in the early stage of proces-
sing and last until the late stage. Faces with positive
person knowledge are judged as more attractive and
evoke larger EPN and LPC amplitudes than those with
negative person knowledge.
Person knowledge may also inuence impressions
evoked by unfamiliar faces due to generalization.
Verosky and Todorov (2010) rst found that the general-
ization eect would appear when individuals perceive
similar faces. In other words, having learnt the associa-
tion between faces and dierent valence statements, the
participants evaluated faces that were similar to “posi-
tive” faces more positively. Several subsequent studies
found that the impressions of warmth and competence
evoked by familiar faces could be generalized by their
resemblance to unfamiliar faces, which may lead to the
impression that unfamiliar faces were consistent with
familiar faces (Richter et al., 2016; Von et al., 2014). The
generalization eect is based on facial similarity, and the
degree of similarity regulates the eect of aective
learning generalization. For example, using faces with
20% and 35% similarity, Verosky and Todorov (2010)
found that the generalization eect became stronger
with the increase in similarity. However, Gawronski and
Quinn (2013) found that there was no signicant change
in the generalization eect when the similarity increased
from 50% to 100%. Most researchers have used 50%
similarity to investigate the generalization eect of
faces (Gawronski & Quinn, 2013; Günaydin et al., 2012).
They found that, when the similarity was 50%, partici-
pants still tended to judge the similar faces as unfamiliar
faces (Verosky & Todorov, 2013). Based on the above-
mentioned ndings, we proposed the following hypoth-
esis: The inuence of person knowledge on facial
attractiveness would generalize based on the facial
structure, similar faces that have the same structure as
the familiar faces. Specically, the facial attractiveness of
similar faces might be aected by the person knowledge
related to familiar faces, producing amplitude dier-
ences consistent with those observed for familiar faces.
However, completely unfamiliar faces would not be
inuenced by familiar person knowledge because of
their low familiarity.
In summary, individuals’ extraction of person knowl-
edge about familiar faces may explain the dierences in
the attractiveness perception of novel faces. However, the
dierences in the electrophysiological time course of
facial attractiveness processing remain unclear. In the
present study, ERPs were used to explore the eect of
person knowledge on facial attractiveness and to discover
the time processing relationship between congural
information and person knowledge. A learning-
recognition task was adopted to address the problem
(Spironelli & Angrilli, 2017). In the learning stage, partici-
pants were asked to choose statements with dierent
valences to form impressions about faces. In the recogni-
tion task, participants were asked to judge whether a face
had ever appeared in the learning stage. Finally, partici-
pants were asked to rate familiar and completely unfami-
liar faces based on warmth, competence, and
attractiveness. The present study will help us understand
the individual dierences in face attractiveness judgment.
2. Material and method
2.1. Participants
Twenty-six college students were randomly recruited
(mean age: 22.05 years; range: 19–25 years; 13 females).
All participants had normal or corrected-to-normal visual
acuity. All were right-handed and heterosexual. The par-
ticipants were informed that they could quit at any time
during the experiment. There were 22 valid participants
(10 males and 12 females) after eliminating 4 partici-
pants whose EEG artifact trials comprised more than
half of the total trials. The present study was approved
by the Ethics Committee of the local institution, in accor-
dance with the ethical principles of the Declaration of
Helsinki. All participants provided written informed con-
sent for the study.
2.2. Stimuli
Sentence materials: In total, 100 sentences created by
Fuhrman et al. (1989) were selected. The degree to
which the behavior sentences reected warmth and
competence was evaluated, using a 9-point rating
SOCIAL NEUROSCIENCE 3
scale, by 14 males and 17 females who did not partici-
pate in the nal experiment. Six sentences each repre-
sented positive (M= 8.12, SD =.68) and negative warmth
traits (M= 2.27, SD = .81). There were signicant dier-
ences in the valence of positive and negative warmth
trait sentences (t (30) = 25.44, p< .001, d= 7.82).
Specically, the score of positive warmth sentences
was higher than that of negative ones (ps <.001).
Further, six sentences each, reecting positive
(M= 8.45, SD = .68) and negative competence traits
(M= 2.77, SD = 1.23) were selected. Signicant dier-
ences were observed in the valence of positive and
negative competence trait sentences (t (30) = 20.39,
p< .001, d= 5.72). The score of positive competence
trait sentences was signicantly higher than that of
negative ones (ps <.001).
Face materials: In total, 16 female and 16 male facial
stimuli with a neutral expression were used. They were
selected from the Chinese Aective Picture System
(Gong et al., 2011). Further, 37 college students (15
males and 22 females, all of whom did not participate
in the nal experiment) were asked to rate the warmth,
competence, attractiveness, and skin texture of the faces
using a 9-point scale. Based on their ratings, four female
and four male faces with moderate warmth (M= 5.25,
SD = .38), competence (M= 5.23, SD = .27), attractiveness
(M= 5.03, SD = .30), and skin texture (M= 5.46, SD = .69)
were selected. Additionally, two male and two female
faces were randomly selected to match the sentence
materials, which were used as familiar faces. One familiar
male and one familiar female face were randomly
selected to match the positive sentences, which formed
the positive group. The other two familiar faces matched
with negative sentences formed the negative group. The
remaining faces were unfamiliar faces; they were divided
into the positive groups if they morphed with the posi-
tive group faces or the negative group if they morphed
with the negative group faces. The same is true for
negative unfamiliar faces. Similar faces were made by
morphing familiar faces with same sex unfamiliar faces
at the level of 50% similarity (Verosky & Todorov, 2013).
Similar faces were assigned to the positive group if they
were similar to positive familiar faces; the others were
assigned to the negative group.
2.3. Procedure
The experiment was divided into the learning, recog-
nition, and evaluation stages. In the learning stage,
each familiar face was matched with a sentence
describing traits of warmth and competence.
Warmth sentences had the same valence as the com-
petence sentences, and participants were asked to
visualize and remember the face according to the
behavioral description to form a corresponding facial
impression. After the participants memorized the
impression of a face, they could move on to the
next face and continue to learn. The time for learning
the face and sentence pairs was controlled by the
participants themselves. At the end of the learning
stage, all the learned faces and two unlearned faces
were presented again, and the participants were
instructed to judge whether the face was “positive”
or “negative.” In order to ensure that the participants
had already formed a face impression, if the partici-
pants made a wrong judgment, they were required to
return to the learning stage and re-study until the
judgment was completely correct before entering the
face recognition stage. In the face recognition stage
(ERPs were analyzed for this stage), the gaze point
“+” was rst presented for 500 ms. in the center of
the screen, followed by a face that was presented for
1000 ms. The faces could be familiar, similar, or unfa-
miliar. Each face was repeated 50 times randomly to
obtain a stable waveform. A black screen for 500 ms
followed this, and the reaction screen was presented
at the end. The participants were required to respond
to the presentation of the face by pressing the “P”
and “Q” keys to indicate that they had or had not
seen the face in the learning stage. The background
of the reaction screen was white. Participants rst
completed 10 trials to ensure that they had under-
stood the experimental process. In the evaluation
stage, the learned familiar faces, similar unfamiliar
faces, and completely unfamiliar faces were pre-
sented in a random order. The participants were
asked to judge their warmth (“How warm, friendly,
or sincere do you think this person is?”), competence
(“How smart, ecient, or competent do you think this
person is?”), and attractiveness (“How attractive do
you think this person is?”) using the number keys 1
(very inconsistent) to 7 (very compliant). Judgments
paired with faces appeared separately at random. The
procedure is presented in Figure 1.
2.4. EEG recording
EEGs were recorded from 62 Ag/AgCl electrodes, accord-
ing to the extended 10–20 system, referenced to a nose
electrode. Additional electrodes were placed above and
below the left eye and on the outer canthus of each eye
to record vertical and horizontal eye movements.
Impedances for all electrodes were kept below 5kΩ.
The EEGs were amplied with a band pass of 0.01–-
100 Hz, and they were digitized online with a sampling
rate of 500 Hz.
4S. HAN ET AL.
2.5. Data analysis
Oine EEGs were performed with EEGLAB v14.01, run-
ning on MATLAB 2015b (Mathworks, Inc., Natick, MA,
USA). The signals were referenced to the nose electrode.
ERPs were additionally ltered with a 30 Hz low pass
lter. Eye-blink artifacts were mathematically corrected
(Gratton et al., 1983). The epoch interval was 1000 ms,
from 200 ms before the onset of the critical faces to
800 ms after it. Analysis of epochs for face presentation
was 1000 ms, from 200 ms before the onset of the critical
faces in the recognition stage. A 200-ms pre-stimulus
was used as the baseline. The artifacts of ±100 μV were
removed and the EEG was superposed under each
experimental condition; percentage of rejection was
less than 10%. According to the characteristics of the
grand average waveforms of the ERP (see Figure 2), the
aim of the present study, and the related literature on
face recognition, two components of the ERP waveforms
in dierent region of interest (ROI) were analyzed: the
P7, PO7 (ROI: left posterior), P8, PO8 (ROI: right posterior)
were chosen for EPN (230–280 ms) and the Cz and CPz
(ROI: middle posterior) were chosen for LPC (400–-
800 ms). The data were analyzed using the repeated
measures analysis of variance (ANOVA). When the
Mauchlly’s test was signicant, the results were sub-
jected to Greenhouse-Geisser correction. A 3 (facial simi-
larity: familiar, similar, and unfamiliar) × 2 (valence of
face matched sentences: positive and negative)
repeated measures ANOVA was used to examine the
behavioral data. ANOVAs for ERP data contained the
within-subjects factor ROI. We used the SIDAK test for
post hoc analyses and False Discovery Rate (FDR) was
used when multiple comparisons emerged.
3. Results
3.1. Behavioral data
3.1.1. Influence of person knowledge on warmth
evaluation of faces
Main eects of facial similarity were found, (F(2,
42) = 18.56, p< .01, η
2p
= .47). Familiar (4.34 ± .16) and
similar faces (4.56 ± .16) were evaluated as warmer than
unfamiliar faces (3.46 ± .15), but there was no signicant
dierence between familiar and similar faces. A main
eect of the valence of face-matched sentences was
also found, (F(1, 21) = 6.08, p= .022, η
2p
= .22). Faces
that matched with positive sentences (4.40 ± .13) were
evaluated as warmer than those that matched with
negative sentences (3.83 ± .18). Importantly, an interac-
tion eect was observed (F(2, 42) = 7.91, p< .01, η
2p
= .27). Further, simple eect analysis revealed that parti-
cipants evaluated positive familiar and similar faces as
warmer than the negative ones. There was no signicant
dierence between the warmth judgment of positive
and negative unfamiliar faces (see Table 1).
3.1.2. Influence of person knowledge on the
competence evaluation of faces
Main eects of facial similarity were found (F(2,
42) = 26.93, p< .01, η
2p
= .56). Familiar faces (4.56 ± .14)
and similar faces (4.66 ± .16) were evaluated as more
competent than unfamiliar faces (3.47 ± .15), but there
was no signicant dierence between familiar and simi-
lar faces. A main eect of the valence of face-matched
sentences was also found (F(1, 21) = 7.11, p= .014, η
2p
= .25). Faces that were matched with positive sentences
(4.52 ± .14) were evaluated as more competent than
those matched with negative sentences (3.94 ± .16).
Figure 1. Overview of the study design.
SOCIAL NEUROSCIENCE 5
Figure 2. Grand-averaged event-related potential waveforms are shown for familiar (first column), similar (second column), and
unfamiliar faces (third column). (A) P7, P8, PO7, and PO8 were selected for EPN (shaded 230–280 ms time window) waveforms to
compare positive and negative conditions and (B) Cz and CPz were selected for LPC (shaded 400–800 ms time window) waveforms. (C)
Scalp topographies of familiar faces, similar faces, and unfamiliar faces in positive and negative conditions were selected at a time
window of 230–280 ms for EPN (two columns on the left) and 400–800 ms for LPC.
6S. HAN ET AL.
There was an interaction between facial similarity and
the valence of face-matched sentences (F(2, 42) = 9.27,
p< .01, η
2p
= .31). Further, simple eect analysis revealed
that participants evaluated positive, familiar, and similar
faces as more competent than negative ones. There
were no dierences in the competence judgment of
positive and negative unfamiliar faces (see Table 1).
3.1.3. Influence of person knowledge on the
attractiveness evaluation of faces
Main eects of facial similarity were found (F(2,
42) = 28.37, p< .01, η
2p
= .56). Similar faces (4.59 ± .17)
were evaluated as more attractive than familiar faces
(3.88 ± .16) and unfamiliar faces (3.27 ± .13). Familiar
faces were judged as more attractive than unfamiliar
faces. A main eect of the valence of face-matched sen-
tences was also found (F(1, 21) = 8.01, p= .01, η
2p
= .28).
Faces that were matched with positive sentences
(4.21 ± .16) were evaluated as warmer than those
matched with negative sentences (3.62 ± .16).
A marginal signicant interaction was observed (F(2,
42) = 5.31, p= .01, η
2p
= .20). Further, simple eect analysis
revealed that participants evaluated positive familiar and
similar faces as more attractive than negative ones. There
were no dierences in the attractiveness judgments of
positive and negative unfamiliar faces (see Table 1).
3.2. ERP data
3.2.1. EPN (230–280 ms)
A 3 (facial similarity: familiar, similar, and unfamiliar) × 2
(valence of face matched sentences: positive and nega-
tive) × 2 (ROI: left posterior and right posterior) repeated
measures ANOVA showed that the main eect of facial
similarity was not signicant (F(2, 42) = 1.00, p= .38).
A main eect of valence was found (F(1, 21) = 9.41,
p< .001, η
2p
= .31). A main eect of ROI was also found
(F(1, 21) = 7.32, p< .01, η
2p
= .26). Left posterior evoked
larger EPN than right posterior. While there were no
interactions among the three factors, (F(2, 42) = 1.60,
p= .21), a signicant interaction between facial similarity
and valence of face matched sentences was obtained (F(2,
42) = 3.30, p= .047, η
2p
= .14). Specically, positive familiar
faces evoked larger EPNs (2.69 ± .62 µV) than negative
familiar faces (3.37 ± .66 µV). We did not nd signicant
dierences in valence of both similar and unfamiliar faces
(see Table 2).
3.2.2. LPC (400–800 ms)
Middle posterior ERP data were chosen for a 3 (facial
similarity: familiar, similar, and unfamiliar) × 2 (valence of
face matched sentences: positive and negative) repeated
measures ANOVA, which showed a main eect of facial
similarity, (F(2, 42) = 17.04, p< .001, η
2p
= .45). The ampli-
tude of familiar faces (3.05 ± .37 µV) was greater than
similar (2.13 ± .36 µV) and unfamiliar faces (2.33 ± .41 µV).
The amplitude between similar and unfamiliar faces was
not signicantly dierent. The main eect of valence was
signicant (F(1, 21) = 6.09, p< .05, η
2p
= .23). Specically,
the amplitude of the positive condition (2.64 ± .37 µV) was
signicantly higher than that of the negative condition
(2.36 ± .38 µV). The interaction of the two factors was also
signicant (F(2, 42) = 4.04, p< .05, η
2p
= .16). Positive
familiar faces elicited larger LPC than negative familiar
faces. Interestingly, similar faces had mirrored these
results. The amplitude of the positive similar faces was
signicantly larger than that of the negative similar faces.
However, this dierence was not found between positive
unfamiliar faces and negative unfamiliar faces (see
Table 2).
4. Discussion
The present study explored the eect of person knowl-
edge on facial attractiveness. Findings revealed that the
person knowledge of familiar faces had a signicant
Table 1. Mean judgment of different types of faces (M ± SE).
Valence
Warmth Competence Attractiveness
Familiar face Similar face Unfamiliar face Familiar face Similar face Unfamiliar face Familiar face Similar face Unfamiliar face
Positive
Negative
5.00 ± 0.25 4.82 ± 0.16 3.39 ± 0.18
3.68 ± 0.28 4.30 ± 0.23 3.52 ± 0.20
5.25 ± 0.24 4.92 ± 0.19 3.36 ± 0.20
3.86 ± 0.25 4.39 ± 0.19 3.57 ± 0.20
4.44 ± 0.25 4.89 ± 0.17 3.30 ± 0.06
3.32 ± 0.25 4.29 ± 0.24 3.25 ± 0.17
Table 2. Mean ERP waveforms of different types of faces (M ± SE).
EPN LPC
Left posterior Right posterior Middle posterior
Valence Familiar face Similar face Unfamiliar face Familiar face Similar face Unfamiliar face Familiar face Similar face Unfamiliar face
Positive
Negative
2.25 ± 0.62 2.71 ± 0.62 2.60 ± 0.65
2.92 ± 0.65 2.86 ± 0.64 2.70 ± 0.65
3.14 ± 0.67 3.57 ± 0.66 3.33 ± 0.65
3.81 ± 0.71 3.78 ± 0.63 3.64 ± 0.64
3.27 ± 0.38 2.41 ± 0.38 2.25 ± 0.40
2.83 ± 0.39 1.85 ± 0.36 2.40 ± 0.43
SOCIAL NEUROSCIENCE 7
eect on the evaluation of facial attractiveness.
Specically, familiar faces with positive impressions
were considered more attractive. Furthermore, attrac-
tiveness evaluations of morphed faces that were similar
to positive familiar faces were signicantly higher than
of those that were similar to negative familiar faces,
while there were no signicant dierences among com-
pletely unfamiliar faces. ERP results showed that person
knowledge aected the familiar faces from the early to
the late stage. EPN and LPC elicited by positive familiar
faces were larger; while similar faces matched with posi-
tive information elicited larger LPC, but not EPN.
This study found that familiar and similar faces
matched with positive information evoked larger LPC
amplitude than those matched with negative informa-
tion. Bobes et al. (2019) found that person knowledge
extraction for familiar faces began, at the earliest, at
around 150 ms, while that related to dierences in facial
attractiveness occurred at about 400–800 ms, indicating
that people process the person knowledge of faces after
extracting such information. When judging similar faces,
participants not only need to recognize the facial struc-
ture but also to retrieval person knowledge from long-
term memory. Similar faces were not easy to recognize
compared with familiar and unfamiliar faces (Carr et al.,
2017); the brain has to use more energy to nish the
processing. This may reveal that the generalization inu-
ence on facial attractiveness judgments is not an auto-
matic processing but a controlled processing. In
addition, LPC is mainly inuenced by intrinsic motivation
(Lu et al., 2014) and is considered to be related to a more
rened aective stimulation processing (Schacht &
Sommer, 2009). The activation of the emotion and moti-
vation system in the brain may play an important role in
the process of generalization, which needs to be further
explored. These results contribute in clarifying the
potential mechanisms of the generalization eect in
face attractiveness judgments.
EPN was inuenced when processing familiar faces,
but not while processing similar and unfamiliar faces. It
means that the inuence of person knowledge for famil-
iar face attractiveness is automated, whereas not for
similar faces, which may reect the relationship between
facial structure and memory intensity. Familiar faces and
learned faces are better structurally matched; therefore,
familiar faces can be extracted quicker. Similar faces can
only be extracted and matched in the late processing
stage. Moreover, identifying similar faces may consume
more cognitive resources, which inhibit the automatic
extraction of person knowledge. Previous studies failed
to nd remarkably dierent EPN results in the semantic
emotion-unrelated analysis task (Bayer et al., 2010) and
concreteness decision (Laura et al., 2013) because of the
diculty of the tasks. In the present study, it may have
been hard for the participants to constantly distinguish
whether or not they had seen the similar faces. As
a result, we could hardly nd any dierences in early
processing of similar faces on EPN.
Most studies have explored the factors aecting the
attractiveness of faces from the point of view of the
observer and the face owner. The face owner hypothesis
is based on the concept of evolutionism, and it purports
that facial attractiveness is mainly inuenced by face
conguration and its symmetry (Fink & Penton-Voak,
2002). On the other hand, the face observer hypothesis
is based on the perspective of social culture. It is
believed that the attractiveness of faces is inuenced
by the characteristics of the observer, that is, beauty is
in the eyes of the observer (Little, 2014). Therefore, the
evaluation of facial attraction is variable. From the per-
spective of face processing, the present study revealed
the reasons for the variability in facial attractiveness
perception, that is, it contains both, a bottom-up proces-
sing of congural information (similarity) and a top-
down processing of person knowledge. Face attractive-
ness evaluation is the result of the comprehensive pro-
cessing of face congural information and person
knowledge. In the late stage of perception, the extrac-
tion of person knowledge related to the face may be the
reason for the dierences in facial attractiveness
perception.
The dierences in facial attractiveness judgments and
their generalization may reect a special evolutionary
functional signicance. The present study oered
a new understanding of why facial judgments are malle-
able from the perspective of processing, as it aimed to
explore the mental and neural mechanisms involved in
facial attractiveness perception. The key contribution of
this work is that it provides an explanation for the foun-
dation of the process of attraction in the rst impression.
Additionally, it helps us to understand why the same
individual inspires dierent facial impressions and pro-
duces diverse esthetic experiences.
However, the present study has some limitations that
need to be addressed in future research. First, the pre-
sent study only analyzed moderately attractive faces.
Previous studies have found that the sexual dimorphism
cues of faces are also regulated by person knowledge
and that masculine male faces with positive person
knowledge are perceived as more attractive. However,
this dierence was not signicant in negative social
conditions (Quist et al., 2012). Further, creativity can
promote the attractiveness of less attractive faces
(Watkins, 2017). Therefore, the role of person knowledge
in regulating dierent face structures may dier. More
research is needed to explore the integration of face
8S. HAN ET AL.
structure information (such as average, symmetry, facial
width-to-height ratio) with person knowledge, to further
reveal the process of integration of perceptual informa-
tion and social knowledge during face perception.
Second, person knowledge not only aects the percep-
tion of familiar faces, but also generalizes based on the
similarity of face structure. However, the mechanism of
this generalization eect is not very clear. The familiarity
evoked by similarity may be the cause of this general-
ization eect. The perceptual sense of familiarity with
similar physical characteristics in memory was signi-
cantly higher for similar rather than dissimilar stimuli
(Han et al., 2018). Carr et al. (2017) found that similarity
between faces activates familiarity and promotes the
processing of stimuli, thus enhancing attractiveness.
Other researchers have argued that the generalization
eect could be attributed to classical conditioning (Y.
Wang et al., 2017). When faces and behaviors were con-
nected through social interaction and faces had struc-
tural similarities, the generalization eect occurred even
if individuals did not perceive this similarity (Kocsor &
Bereczkei, 2016, 2017). Therefore, future studies need to
explore the role played by changes in similarity in the
integration of perceptual information and person knowl-
edge, and its eects on the evaluation of facial attrac-
tiveness. Third, this study focused on the inuence of the
similarity of facial structure on the facial attractiveness
judgment, while previous studies have found that the
context (e.g., age and type of relationship) also inuence
facial attractiveness. How the context factors modulate
the eect we found still remains to be further investi-
gated. Forth, we used a relatively small sample size for
this study; it is necessary to explore the law of facial
attraction processing with larger samples in the future.
Finally, the present study only considered the behavioral
and ERP dierences elicited by the contrast between
positive and negative sentences, which may be more
related to valence but not arousal of the sentences. To
better understand the inuence of arousal of the sen-
tences on the generalization eect, the limitation should
be addressed in future studies employing both emotion-
ally positive, negative and neutral sentences.
To summarize, the main purpose of this study was to
develop an understanding of individual dierences in
judgments of facial attractiveness. Familiar faces with
positive person knowledge received higher attractiveness
appraisals and evoked larger EPN and LPC. Similar faces
had the same behavioral results and evoked a larger LPC.
The results indicate that when people evaluate others’
facial attractiveness, the retrieval of social information
stored in our memory, especially person knowledge,
drives people’s diverse attractiveness judgments of the
same person. Importantly, the eect would be
generalized based on the facial structure; faces that are
similar to familiar faces had a similar processing mode.
These ndings suggest that the retrieval of person knowl-
edge and its generalization is one of the reasons for the
diversity in judgments of facial attractiveness.
Disclosure statement
The authors declare that they have no competing interests.
Funding
The National Social Science Fund of China (BHA190150), the
National Natural Science Foundation of China (31540024,
71874170), the Science Foundation of Ministry of Education
of China (18YJC190027), the Fundamental Research Funds for
the Central Universities (YD2110002004), the K.C. Wong Magna
Fund at Ningbo University and Scientic Research Foundation
of Graduate School of Ningbo University (G18044) supported
this paper.
ORCID
Shen Liu http://orcid.org/0000-0002-6900-8831
References
Amodio, D. M., Bartholow, B. D., & Ito, T. A. (2013). Tracking the
dynamics of the social brain: ERP approaches for social
cognitive and aective neuroscience. Social Cognitive and
Aective Neuroscience, 9(3), 385–393. https://doi.org/10.
1093/scan/nst177
Bayer, M., Sommer, W., & Schacht, A. (2010). Reading emotional
words within sentences: The impact of arousal and valence
on event-related potentials. International Journal of
Psychophysiology, 78(3), 299–307. https://doi.org/10.1016/j.
ijpsycho.2010.09.004
Bobes, M. A., Lage-Castellanos, A., Olivares, E. I., Hidalgo-Gato, J.
P., Iglesias, J., Castro-Laguardia, A. M., & Valdes-Sosa, P.
(2019). ERP source analysis guided by fMRI during familiar
face processing. Brain Topography, 32(4),720–740.
doi:10.1007/s10548-018-0619-x
Bruce, V., & Young, A. (1986). Understanding face recognition.
British Journal of Psychology, 77(3), 305–327. https://doi.org/
10.1111/j.2044-8295.1986.tb02199.x
Carr, E. W., Huber, D. E., Pecher, D., Zeelenberg, R.,
Halberstadt, J., & Winkielman, P. (2017). The ugliness-in-
averageness eect: Tempering the warm glow of
familiarity. Journal of Personality and Social Psychology, 112
(6), 787–812. https://doi.org/10.1037/pspa0000083
Chen, A. C., German, C., & Zaidel, D. W. (1997). Brain asymmetry
and facial attractiveness: Facial beauty is not simply in the
eye of the beholder. Neuropsychologia, 35(4), 471–476.
https://doi.org/10.1016/S0028-3932(96)00065-6
Feldmanhall, O., Dunsmoor, J. E., Tompary, A., Hunter, L. E.,
Todorov, A., & Phelps, E. A. (2018). Stimulus generalization
as a mechanism for learning to trust. Proceedings of the
SOCIAL NEUROSCIENCE 9
National Academy of Sciences, 115(7), E1690–E1697. https://
doi.org/10.1073/pnas.1715227115
Fink, B., & Penton-Voak, I. (2002). Evolutionary psychology of
facial attractiveness. Current Directions in Psychological
Science, 11(5), 154–158. https://doi.org/10.1111/1467-8721.
00190
Fiske, S. T., Cuddy, A. J. C., & Glick, P. (2008). Universal dimen-
sions of social cognition: Warmth and competence. Trends in
Cognitive Science, 11(2), 77–83. https://doi.org/10.1016/j.tics.
2006.11.005
Fuhrman, R. W., Bodenhausen, G. V., & Lichtenstein, M. (1989).
On the trait implications of social behaviors: Kindness, intel-
ligence, goodness, and normality ratings for 400 behavior
statements. Behavior Research Methods, 21(6), 587–597.
https://doi.org/10.3758/bf03210581
Gawronski, B., & Quinn, K. A. (2013). Guilty by mere similarity:
Assimilative eects of facial resemblance on automatic
evaluation. Journal of Experimental Social Psychology, 49(1),
120–125. https://doi.org/10.1016/j.jesp.2012.07.016
Gong, X., Huang, Y. X., Wang, Y., & Luo, Y. J. (2011). Revision of
the Chinese facial aective picture system. Chinese Mental
Health Journal, 25(1), 40–46. https://doi.org/10.3969/j..1000-
6729.2011.01.011
Gratton, G., Coles, M. G., & Donchin, E. (1983). A new method
for o- line removal of ocular artifact.
Electroencephalography and Clinical Neurophysiology, 55(4),
468–484. https://doi.org/10.1016/0013-4694(83)90135-9
Günaydin, G., Zayas, V., Selcuk, E., & Hazan, C. (2012). I like you
but I don’t know why: Objective facial resemblance to sig-
nicant others inuences snap judgments. Journal of
Experimental Social Psychology, 48(1), 350–353. https://doi.
org/10.1016/j.jesp.2011.06.001
Han, S. F., Li, Y., Liu, S., XU, Q., TAN, Q., & ZHANG, L. (2018).
Beauty is in the eye of the beholder: The halo eect and
generalization eect in the facial attractiveness evaluation.
Acta Psychologica Sinica, 50(4), 363–376. https://doi.org/10.
3724/SP.J.1041.2018.00363
Jack, R. E., & Schyns, P. G. (2015). The human face as a dynamic
tool for social communication. Current Biology, 25(14),
621–634. https://doi.org/10.1016/j.cub.2015.05.052
Jack, R. E., & Schyns, P. G. (2017). Toward a social psychophysics
of face communication. Annual Review of Psychology, 68(1),
269–297. https://doi.org/10.1146/annurev-psych-010416-
044242
Kocsor, F., & Bereczkei, T. (2016). First impressions of strangers
rely on generalization of behavioral traits associated with
previously seen facial features. Current Psychology, 36(3),
385-391. https://doi.org/10.1007/s12144-016-9427-1
Kocsor, F., & Bereczkei, T. (2017). Evaluative conditioning leads
to dierences in the social evaluation of prototypical faces.
Personality and Individual Dierences, 104, 215–219. https://
doi.org/10.1016/j.paid.2016.08.007
Kaltwasser, L., Ries, S., Sommer, W., Knight, R., & Willems, R.
M. (2013). Independence of valence and reward in emo-
tional word processing: Electrophysiological evidence.
Frontiers in Psychology, 4, Article Number: 168, https://doi.
org/10.3389/fpsyg.2013.00168
Little, A. C. (2014). Facial attractiveness. Cognitive Science, 5(6),
621–634. https://doi.org/10.1002/wcs.1316
Lu, Y., Wang, J., Wang, L., Wang, J., & Qin, J. (2014). Neural
responses to cartoon facial attractiveness: An event-related
potential study. Neuroscience Bulletin, 30(3), 441–450.
https://doi.org/10.1007/s12264-013-1401-4
Luo, Q. L., Wang, H. L., Dzhelyova, M., Huang, P., & Mo, L. (2016).
Eect of aective personality information on face proces-
sing: Evidence from ERPs. Frontiers in Psychology, 7, Article
Number: 810. https://doi.org/10.3389/fpsyg.2016.00810
Olivola, C. Y., Funk, F., & Todorov, A. (2014). Social attributions
from faces bias human choices. Trends in Cognitive Sciences,
18(11), 566–570. https://doi.org/10.1016/j.tics.2014.09.007
Olson, I. R., & Marshuetz, C. (2005). Facial attractiveness is
appraised in a glance. Emotion, 5(4), 498–502. https://doi.
org/10.1037/1528-3542.5.4.498
Otten, M., Seth, A. K., & Pinto, Y. A. (2016). Social Bayesian brain:
How social knowledge can shape visual perception. Brain
and Cognition, 112, 69–77. https://doi.org/10.1016/j.bandc.
2016.05.002
Quinn, K. A., & Macrae, C. N. (2011). The face and person
perception: Insights from social cognition. British Journal of
Psychology, 102(4), 849–867. https://doi.org/10.1111/j.2044-
8295.2011.02030.x
Quist, M. C., Debruine, L. M., Little, A. C., & Jones, B. C. (2012).
Integrating social knowledge and physical cues when jud-
ging the attractiveness of potential mates. Journal of
Experimental Social Psychology, 48(3), 770–773. https://doi.
org/10.1016/j.jesp.2011.12.018
Rellecke, J., Bakirtas, A. M., Sommer, W., & Schacht, A. (2011).
Automaticity in attractive face processing: Brain potentials
from a dual task. NeuroReport, 22(14), 706–710. https://doi.
org/10.1097/WNR.0b013e32834a89ad
Rhodes, G. (2006). The evolutionary psychology of facial
beauty. Annual Review of Psychology, 57(1), 199–226.
https://doi.org/10.1146/annurev.psych.57.102904.190208
Rhodes, G., Yoshikawa, S., Clark, A., Lee, K., McKay, R., &
Akamatsu, S. (2001). Attractiveness of facial averageness
and symmetry in non-Western cultures: In search of biolo-
gically based standards of beauty. Perception, 30(5),
611–625. https://doi.org/10.1068/p3123
Richter, N., Tiddeman, B., & Haun, D. B. (2016). Social preference
in preschoolers: Eects of morphological self-similarity and
familiarity. PloS One, 11(1), e0145443. https://doi.org/10.
1371/journal.pone.0145443
Ritchie, K. L., Palermo, R., & Rhodes, G. (2017). Forming impres-
sions of facial attractiveness is mandatory. Scientic Reports,
7Article Number(1), 469. https://doi.org/10.1038/s41598-
017-00526-9
Schacht, A., & Sommer, W. (2009). Emotions in word and face
processing: Early and late cortical responses. Brain and
Cognition, 69(3), 538–550. https://doi.org/10.1016/j.bandc.
2008.11.005
Schacht, A., Werheid, K., & Sommer, W. (2008). The appraisal of
facial beauty is rapid but not mandatory. Cognitive, Aective
& Behavioral Neuroscience, 8(2), 132–142. https://doi.org/10.
3758/CABN.8.2.132
Spironelli, C., & Angrilli, A. (2017). Supine posture aects cor-
tical plasticity in elderly but not young women during
a word learning-recognition task. Biological Psychology,
127, 180–190. https://doi.org/127.10.1016/j.biopsycho.2017.
05.014
Sutherland, C. A., Oldmeadow, J., Santos, I. M., Towler, J.,
Michael Burt, D., & Young, A. W. (2013). Social inferences
from faces: Ambient images generate a three-dimensional
10 S. HAN ET AL.
model. Cognition, 127(1), 105–118. https://doi.org/10.1016/j.
cognition.2012.12.001
Sutherland, C. A. M., Young, A. W., & Rhodes, G. (2016). Facial
rst impressions from another angle: How social judge-
ments are inuenced by changeable and invariant facial
properties. British Journal of Psychology, 108(2), 397–415.
https://doi.org/10.1111/bjop.12206
Thiruchselvam, R., Harper, J., & Homer, A. L. (2016). Beauty is in
the belief of the beholder: Cognitive inuences on the
neural response to facial attractiveness. Social Cognitive
and Aective Neuroscience, 11(12), 1999–2008. https://doi.
org/10.1093/scan/nsw115
Todorov, A., Olivola, C. Y., Dotsch, R., & Mendesiedlecki, P.
(2015). Social Attributions from Faces: Determinants, conse-
quences, accuracy, and functional signicance. Annual
Review of Psychology, 66(1), 519–545. https://doi.org/10.
1146/annurev-psych-113011-143831
Trujillo, L. T., Jankowitsch, J. M., & Langlois, J. H. (2014). Beauty
is in the ease of the beholding: A neurophysiological test of
the averageness theory of facial attractiveness. Cognitive,
Aective & Behavioral Neuroscience, 14(3), 1061–1076.
https://doi.org/10.3758/s13415-013-0230-2
Vernon, R. J., Sutherland, C. A., Young, A. W., & Hartley, T. (2014).
Modeling rst impressions from highly variable facial
images. Proceedings of the National Academy of Sciences of
the United States of America, 111(32), E3353–E3361. https://
doi.org/10.1073/pnas.1409860111
Verosky, S. C., & Todorov, A. (2010). Generalization of aective
learning about faces to perceptually similar faces.
Psychological Science, 21(6), 779–785. https://doi.org/10.
1177/0956797610371965
Verosky, S. C., & Todorov, A. (2013). When physical similarity
matters: Mechanisms underlying aective learning general-
ization to the evaluation of novel faces. Journal of
Experimental Social Psychology, 49(4), 661–669. https://doi.
org/10.1016/j.jesp.2013.02.004
Vingilis-jaremko, L., & Maurer, D. (2013). The inuence of sym-
metry on children’s judgments of facial attractiveness.
Perception, 42(3), 302–320. https://doi.org/10.1068/p7371
Von, H. B., Herzog, S. M., & Rieskamp, J. (2014). Haunted by
a doppelgänger: Irrelevant facial similarity aects rule-based
judgments. Experimental Psychology, 61(1), 12–22. https://
doi.org/10.1027/1618-3169/a000221
Wang, Y., Collins, J., Koski, J. E., Nugiel, T., Metoki, A., &
Olson, I. R. (2017). Dynamic neural architecture for
social knowledge retrieval. Proceedings of the National
Academy of Sciences, 114(16), E3305–E3314. https://doi.
org/10.1073/pnas.1621234114
Wang, Y. Q., Yao, P. F., & Zhou, G. M. (2015). The inuence
of facial attractiveness and personality labels on men
and women’s mate preference. Acta Psychologica Sinica,
47(1), 108–118. https://doi.org/10.3724/SP.J.1041.2015.
00108
Watkins, C. D. (2017). Creating beauty: Creativity compen-
sates for low physical attractiveness when individuals
assess the attractiveness of social and romantic
partners. Royal Society Open Science, 4(4), 160955.
https://doi.org/10.1098/rsos.160955
Werheid, K., Schacht, A., & Sommer, W. (2007). Facial attractive-
ness modulates early and late event-related brain potentials.
Biological Psychology, 76(1–2), 100–108. https://doi.org/10.
1016/j.biopsycho.2007.06.008
Yang, D., Qi, S., Ding, C., & Song, Y. (2011). An ERP study on the
time course of facial trustworthiness appraisal. Neuroscience
Letters, 496(3), 147–151. https://doi.org/10.1016/j.neulet.
2011.03.066
Yang, T., Chen, H., Hu, Y., Zheng, Y., & Wang, W. (2015).
Preferences for sexual dimorphism on attractiveness levels:
An eye-tracking study. Personality and Individual Dierences,
77, 179–185. https://doi.org/10.1016/j.paid.2014.12.005
Zhang, Y., Kong, F., Zhong, Y., & Kou, H. (2014). Personality
manipulations: Do they modulate facial attractiveness
ratings? Personality and Individual Dierences, 70, 80–84.
https://doi.org/10.1016/j.paid.2014.06.033
Zhang, Z., & Deng, Z. (2012). Gender, facial attractiveness, and
early and late event-related potential components. Journal
of Integrative Neuroscience, 11(4), 477–487. https://doi.org/
10.1142/S0219635212500306
Zhao, S., Xiang, Y., Xie, J., Ye, Y., Li, T., & Mo, L. (2017). The
positivity bias phenomenon in face perception given dier-
ent information on ability. Frontiers in Psychology, 8,Article
Number, 570. https://doi.org/10.3389/fpsyg.2017.00570
SOCIAL NEUROSCIENCE 11
... The enhancement in facial attractiveness is due to familiarity (Carr et al., 2017), emotion (Han et al., 2022;Han, Liu, et al., 2020), good traits , and generalization to similar faces (Han, Hu, et al., 2020). We found the influence of arousal on the judgment of facial attractiveness, namely, men with high arousal rate female faces as more attractive, thereby supporting the misattribution of arousal hypothesis, which suggests individual misattributed arousal due to attractive features (White et al., 1981). ...
Article
Full-text available
Introduction Individuals differ in how they judge facial attractiveness. However, little is known about the role of arousal level and gender differences in individuals’ facial attractiveness judgments. Methods We used resting‐state electroencephalogram (EEG) to investigate this issue. A total of 48 men (aged 22.5 ± 3.03 years [mean ± SD], range: 18–30 years) and 27 women (aged 20.3 ± 2.03 years [mean ± SD], range: 18–25 years) participated in the experiment. After the EEG was collected, participants were instructed to complete a facial attractiveness judgment task. Connectome‐based predictive modeling was used to predict individual judgment of facial attractiveness. Results Men with high arousal judged female faces as more attractive (M = 3.85, SE = 0.81) than did men with low arousal (M = 3.33, SE = 0.81) and women (M = 3.24, SE = 1.02). Functional connectivity of the alpha band predicted judgment of female facial attractiveness in men but not in women. After controlling for the age and variability, the prediction effect was still significant. Conclusion Our results provide neural evidence for the enhancement of the judgment of facial attractiveness in men with high arousal levels, which supports the hypothesis that individuals’ spontaneous arousal contributes to variations in facial attractiveness preferences.
... Different aesthetic judgments of human faces are one of the most common manifestations of human visual psychology, which is an important source of social emotion generation and plays a role in human social interaction and communication (Han et al., 2020). In daily life, most people think that beauty is a subjective feeling, however, scientists have broken the longheld belief that beauty lacks objectivity and found a high degree of consistency in human perception of facial beauty across race, age, gender, social class, and cultural background. ...
Article
Full-text available
Most of the current development of artificial intelligence is based on brain cognition, however, this replication of biology cannot simulate the subjective emotional and mental state changes of human beings. Due to the imperfections of existing artificial intelligence, this manuscript summarizes and clarifies that artificial intelligence system combined with cognitive psychology is the research direction of artificial intelligence. It aims to promote the development of artificial intelligence and give computers human advanced cognitive abilities, so that computers can recognize emotions, understand human feelings, and eventually achieve dialog and empathy with humans and other artificial intelligence. This paper emphasizes the development potential and importance of artificial intelligence to understand, possess and discriminate human mental states, and argues its application value with three typical application examples of human–computer interaction: face attraction, affective computing, and music emotion, which is conducive to the further and higher level of artificial intelligence research.
Article
Full-text available
Although previous studies have found that repeated exposure has an influence on the judgment of facial attractiveness, how this effect occurs remains unclear. Two experiments were conducted to explore the impact of repeated exposure on facial attractiveness and the processing mechanism. The results of Experiment 1 showed that in the case of large number of exposures, the facial attractiveness judgment for faces with high, moderate, and low attractiveness increased after repeated exposure. The increase in familiarity and liking mediated the relationship between repeated exposure and faces with high attractiveness, while the increase in liking mediated the relationship between repeated exposure and faces with low attractiveness. The results of Experiment 2 showed that in the case of small number of exposures, the facial attractiveness rating of faces with high and moderate attractiveness increased after repeated exposure. The increase in familiarity and liking mediated the relationship between repeated exposure and faces with high attractiveness, while the increase in familiarity mediated the relationship between repeated exposure and faces with moderate attractiveness. The results indicate that both the fluency of cognitive processing and change of affective attitude play an important role when people judge the facial attractiveness during repeated exposure. The present study illustrates the change rule of the evaluation of facial attractiveness, and lays a solid theoretical foundation for further investigation of the dynamic relationship between social characteristics of faces and behavioral decision-making.
Chapter
The middle-of-the-road nowadays brain cognition is based on artificial intelligence however human subjective emotional and mental state changes cannot simulate the replication of biology. Currently, artificial intelligence does not meet all of our needs due to its limitations, this study's focus on the combination of cognitive psychology and artificial intelligence system would be the research trend of artificial intelligence. The aim of this research is to promote artificial intelligence development and cognitive psychology in terms of emotion, recognition, understanding of human behavior, empathy, and eventually conversion with human being and other artificial intelligence. This research emphasises the importance of possessing the understanding of artificial intelligence, human mental state discrimination, and two typical human interaction system including effective computing and face attraction which is further useful for higher levels of artificial intelligence research. This research also discusses how artificial intelligence is beneficial in the field of psychology and how machine learning techniques have been used to predict the developmental risks of mental health disorders and also detect the level of depression.KeywordsCognitive psychologyArtificial intelligenceHuman–computer interactionFace attractionAffective computing
Article
Full-text available
Face attractiveness has been found to play an important role in human evolution, possibly because highly attractive faces were more likely to be associated with good health and reproductive ability. It is important to explore the association between athletic performance and face attractiveness of the world-class elite athletes to further understand the dominance of physical fitness of facial features in competitive sporting events environment. In this study, Experiment 1, Experiment 2, and Experiment 3 investigated the association between facial attractiveness scores and athletic performance in the conditions of absence of sports information, with sports information, and real-time measurement during the Tokyo Olympics, respectively. Experiment 4 further explored the variations in facial features of athletes in different sports through the sport judgment task. It was found that athletes with better performance were considered more attractive, demonstrating the existence of the good performance-high attractiveness effect. Female athletes showed a good performance-high attractiveness effect in the 3-meter diving and floor exercises, which emphasised fine control and aesthetics. Male athletes had the similar effect in the 100-meter sprint, although it was not so robust as the female athletes. Compared with triathlon, high attractiveness was considered to be the facial feature that floor exercise athletes should have. In conclusion, this study found that sports performance can be reflected in face attractiveness, and that different skill related physical fitness requirements have different performance patterns in face attractiveness, providing new evidence for the evolutionary theory of facial attractiveness.
Article
Full-text available
Although previous studies have found that repeated exposure has an influence on the judgment of facial attractiveness, how this effect occurs remains unclear. Two experiments were conducted to explore the impact of repeated exposure on facial attractiveness and the processing mechanism. The results of Experiment 1 showed that in the case of large number of exposures, the facial attractiveness judgment for faces with high, moderate, and low attractiveness increased after repeated exposure. The increase in familiarity and liking mediated the relationship between repeated exposure and faces with high attractiveness, while the increase in liking mediated the relationship between repeated exposure and faces with low attractiveness. The results of Experiment 2 showed that in the case of small number of exposures, the facial attractiveness rating of faces with high and moderate attractiveness increased after repeated exposure. The increase in familiarity and liking mediated the relationship between repeated exposure and faces with high attractiveness, while the increase in familiarity mediated the relationship between repeated exposure and faces with moderate attractiveness. The results indicate that both the fluency of cognitive processing and change of affective attitude play an important role when people judge the facial attractiveness during repeated exposure. The present study illustrates the change rule of the evaluation of facial attractiveness, and lays a solid theoretical foundation for further investigation of the dynamic relationship between social characteristics of faces and behavioral decision-making.
Article
Full-text available
Few studies have been done on the effects of video games on social perception, especially on the faces of players. The present study investigated how people’s gaming skill influences their perceived facial attractiveness, and also how sexual dimorphism features (masculine and feminine) interplayed with displayed gaming skill. We asked players (N = 147) and non-players (N = 167) to evaluate the attractiveness of masculinized and feminized facial images, along with perception of gaming skills (high gaming skill or low gaming skill). The results indicated that game players perceived facial images accompanied by higher gaming skill information were more attractive than facial images accompanied by lower gaming skill information. However, for participants without gaming experience (i.e., non-players), gaming skill information did not influence their evaluation of attractiveness. We believe players might consider higher gaming skills as social knowledge which can positively influence people’s perception of their attractiveness; on the other hand, non-players did not perceive gaming skills as important social knowledge, hence attractiveness ratings were unaffected. We did not find any interactions between sexual dimorphism features and gaming skill information. To our surprise, only non-players exhibited classic sexual dimorphism effects in facial evaluations, whereas for players, the sexual dimorphism effect disappeared completely. We speculate that players rely more on social knowledge and less on configuration cues during facial evaluation, hence the effects of sexual dimorphism were obscured.
Article
Full-text available
Facial attractiveness judgment largely depends on the characteristics of the facial structure and the personality of the observer. However, little is known about the influence of contextual variations on facial attractiveness. In this electroencephalogram study, participants judged the attractiveness of faces presented individually or in pairs with either a higher‐attractive face (HAF) or lower‐attractive face (LAF). The attractiveness judgment rating of the target face was significantly higher when presented in pairs with HAFs or LAFs than when presented individually and was accompanied by a larger late positive complex. These results suggest that contextual faces enhance the attractiveness judgment of target faces. Microstate analyses revealed that the global field power (GFP) of state 3 was significantly correlated with the attractiveness judgment in the HAF condition whereas the GFP of state 2 was significantly correlated with the attractiveness judgment in the LAF condition. Interestingly, the GFP of state 2 mediated the relationship between narcissism and facial attractiveness judgment in the context of LAFs. Source location analyses showed that states 3 and 2 activated the superior and middle frontal gyrus, which are involved in emotion processing. Our findings suggest that facial attractiveness can be enhanced by contextual comparison with other faces, subject to personality of the observer. By using the electroencephalogram (EEG), the spatiotemporal dynamics of the brain were measured when faces were paired with high and low attractiveness faces. Our results show that the face was judged more attractive than it presents alone when it appears with others faces. Our findings contribute to the understanding of neurocognitive mechanisms and processes of facial attractiveness.
Article
Full-text available
Event related potentials (ERPs) provide precise temporal information about cognitive processing, but with poor spatial resolution, while functional magnetic resonance imaging (fMRI) reliably identifies brain areas involved, but with poor temporal resolution. Here we use fMRI to guide source localization of the ERPs at different times for studying the temporal dynamics of the neural system for recognizing familiar faces. fMRI activation areas were defined in a previous experiment applying the same paradigm used for ERPs. The Bayesian model averaging (BMA) method was used to estimate the generators of the ERPs to unfamiliar, visually familiar, and personally-familiar faces constraining the model by fMRI activation results. For this, higher prior probabilities in the solution space were assigned to the fMRI-defined regions, which included face-selective areas and other areas related to “person knowledge” retrieval. Source analysis was carried out in three-time windows: early (150–210 ms), middle (300–380 ms) and late (460–580 ms). The early and middle responses were generated in fMRI-defined areas for all face categories, while these areas do not contribute to the late response. Different areas contributed to the generation of the early and middle ERPs elicited by unfamiliar faces: fusiform (Fus), inferior occipital, superior temporal sulcus and the posterior cingulate (PC) cortices. For familiar faces, the contributing areas were Fus, PC and anterior temporal areas for visually familiar faces, with the addition of the medial orbitofrontal areas and other frontal structures for personally-significant faces. For both unfamiliar and familiar faces, more extended and reliable involvement of contributing areas were obtained for the middle compare with early time window. Our fMRI guide ERP source analysis suggested the recruitment of person-knowledge processing areas as early as 150–210 ms after stimulus onset during recognition of personally-familiar faces. We concluded that fMRI-constrained BMA source analysis provide information regarding the temporal-dynamics in the neural system for cognitive processsing.
Article
Full-text available
Significance Humans can learn to trust through direct social experiences. In our everyday lives, however, we constantly meet new people where judgments of trustworthiness are blind to reputation. In these cases, what drives decisions to trust? We find a simple learning mechanism observed across species—stimulus generalization—is deployed in complex social learning environments: Individuals distrust strangers who implicitly resemble those known to be untrustworthy. These behavioral findings were mirrored at the neural level, revealing that the amygdala and caudate selectively encode the transfer of social value during moral learning. The results demonstrate a mechanism that draws on prior learning to reduce the uncertainty associated with strangers, ultimately facilitating potentially adaptive decisions to trust, or withhold trust from, unfamiliar others.
Article
Full-text available
Even though people usually agreed that ”a book should not be judged by its cover”, researches had repeatedly demonstrated that individuals spontaneously and very swiftly formed impression on others based merely on the appearance of their faces. Facial attractiveness is an important content in the first perception. Which had been linked to outcomes as diverse as mate choice, job hunting, and cooperation. Given these real world consequences of the first impressions, it is important to understand how these impressions are formed. Some studies found that facial physical characteristics, such as symmetry, averageness and sexual dimorphism, had a great impact on facial attractiveness. While different individuals have different experience, when faced with the same face in the same context, different individuals have different evaluations on facial attractiveness. Some researchers put forward a new theory, namely, the observer hypothesis, which demonstrated that beauty is in the eye of the beholder. However, the processing of unfamiliar facial attractiveness remained unclear. The goal of the current study was to explore how we processed the impression of unfamiliar facial attractiveness. 19 males and 27 females took part in the experiment one and 16 males and 22 females participated in the experiment two, each experiment contained two phases that were learning tasks and evaluation tasks In the learning phase, participants firstly learned to associate faces with negative, neutral, or positive trait words or imaged the behavior of the individuals to form different impression, which was contribute to the same valence between the neutral face and trait words or sentence. When participants could evaluate the valence of the face correctly, they could proceed to the next phase. In the experiment one, 13 males and 25 females had passed learning phase and evaluated the original faces and the unfamiliar faces. In the experiment two, 12 males and 17 females had done the learning task and evaluation task successfully. And in the evaluation phase, extend of warmth, competence and facial attractiveness of the unfamiliar faces, which had 50% similarity with the learned faces, were evaluated. Both of the two experiments had the same results, which showed that there are two ways to form unfamiliar facial attractiveness: (1)the first one is that generalization effect occurred after halo effect, compared with negative familiar faces, positive familiar faces were evaluated more attractive, so did the unfamiliar faces that were familiar with positive familiar faces;(2) the second one is that halo effect occurred after generalization effect, unfamiliar faces which were similar with positive familiar faces were not only evaluated more positive but also more attractive. The results suggested that generalization effect occurred after halo effect and halo effect occurred after generalization effect were the two ways to form unfamiliar facial attractiveness. In conclusion, halo effect and generalization effect play an important role in the processing of unfamiliar facial attractiveness.
Article
Full-text available
The negativity bias has been shown in many fields, including in face processing. We assume that this bias stems from the potential threat inlayed in the stimuli (e.g., negative moral behaviors) in previous studies. In the present study, we conducted one behavioral and one event-related potentials (ERPs) experiments to test whether the positivity bias rather than negativity bias will arise when participants process information whose negative aspect involves no threat, i.e., the ability information. In both experiments, participants first completed a valence rating (negative-to-positive) of neutral facial expressions. Further, in the learning period, participants associated the neutral faces with high-ability, low-ability, or control sentences. Finally, participants rated these facial expressions again. Results of the behavioral experiment showed that compared with pre-learning, the expressions of the faces associated with high ability sentences were classified as more positive in the post-learning expression rating task, and the faces associated with low ability sentences were evaluated as more negative. Meanwhile, the change in the high-ability group was greater than that of the low-ability group. The ERP data showed that the faces associated with high-ability sentences elicited a larger early posterior negativity, an ERP component considered to reflect early sensory processing of the emotional stimuli, than the faces associated with control sentences. However, no such effect was found in faces associated with low-ability sentences. To conclude, high ability sentences exerted stronger influence on expression perception than did low ability ones. Thus, we found a positivity bias in this ability-related facial perceptual task. Our findings demonstrate an effect of valenced ability information on face perception, thereby adding to the evidence on the opinion that person-related knowledge can influence face processing. What’s more, the positivity bias in non-threatening surroundings increases scope for studies on processing bias.
Article
Full-text available
Although creativity is attractive in a potential mate, it is unclear (i) whether the effects of creativity on attractiveness generalize to other social contexts and (ii) whether creativity has equivalent effects on men's and women's attractiveness. As social knowledge of creativity may either enhance or ‘offset’ the appeal of social partners who differ in physical attractiveness, three repeated measures experiments were conducted to directly address these issues. Here, participants rated a series of face–text pairs for attractiveness on trials that differed in one of four combinations of facial attractiveness (attractive and less attractive) and creativity (creative and less creative), rating story-tellers in two experiments (short interpretations of an identical painting) and creative ideas in a further experiment (alternative uses for an everyday object). Regardless of the sex of the judge, creativity and facial attractiveness had independent effects on men's overall attractiveness (initial experiment) and, in further experiments, more substantial effects on the attractiveness of men with less attractive faces than men with attractive faces (when using a different measure of creativity) and specific effects on the attractiveness of individuals with less attractive faces (when using different face stimuli). Collectively, across three experiments, these findings suggest that creativity may compensate for putative cues to lower biological ‘quality’ and that the benefits of creativity to social groups more generally enhance attraction to creative men (in two experiments) and creative men and women (one experiment). More broadly, the data suggest that species can integrate knowledge of cognitive intelligence with visual cues to biological ‘quality’ to facilitate mate and/or ally choice.
Article
Full-text available
Mere exposure (i.e., stimulus repetition) and blending (i.e., stimulus averaging) are classic ways to increase social preferences, including facial attractiveness. In both effects, increases in preference involve enhanced familiarity. Prominent memory theories assume that familiarity depends on a match between the target and similar items in memory. These theories predict that when individual items are weakly learned, their blends (morphs) should be relatively familiar, and thus liked-a beauty-in-averageness effect (BiA). However, when individual items are strongly learned, they are also more distinguishable. This "differentiation" hypothesis predicts that with strongly encoded items, familiarity (and thus, preference) for the blend will be relatively lower than individual items-an ugliness-in-averageness effect (UiA). We tested this novel theoretical prediction in 5 experiments. Experiment 1 showed that with weak learning, facial morphs were more attractive than contributing individuals (BiA effect). Experiments 2A and 2B demonstrated that when participants first strongly learned a subset of individual faces (either in a face-name memory task or perceptual-tracking task), morphs of trained individuals were less attractive than the trained individuals (UiA effect). Experiment 3 showed that changes in familiarity for the trained morph (rather than interstimulus conflict) drove the UiA effect. Using a within-subjects design, Experiment 4 mapped out the transition from BiA to UiA solely as a function of memory training. Finally, computational modeling using a well-known memory framework (REM) illustrated the familiarity transition observed in Experiment 4. Overall, these results highlight how memory processes illuminate classic and modern social preference phenomena. (PsycINFO Database Record
Article
Full-text available
First impressions of social traits, such as attractiveness, from faces are often claimed to be made automatically, given their speed and reliability. However, speed of processing is only one aspect of automaticity. Here we address a further aspect, asking whether impression formation is mandatory. Mandatory formation requires that impressions are formed about social traits even when this is task-irrelevant, and that once formed, these impressions are difficult to inhibit. In two experiments, participants learned what new people looked like for the purpose of future identification, from sets of images high or low in attractiveness. They then rated middle-attractiveness images of each person, for attractiveness. Even though instructed to rate the specific images, not the people, their ratings were biased by the attractiveness of the learned images. A third control experiment, with participants rating names, demonstrated that participants in Experiments 1 and 2 were not simply rating the people, rather than the specific images as instructed. These results show that the formation of attractiveness impressions from faces is mandatory, thus broadening the evidence for automaticity of facial impressions. The mandatory formation of impressions is likely to have an important impact in real-world situations such as online dating sites.
Article
Full-text available
Significance Knowledge about other people is critical for group survival and may have unique cognitive processing demands. Here, we investigate how person knowledge is represented, organized, and retrieved in the brain. We show that the anterior temporal lobe (ATL) stores abstract person identity representation that is commonly embedded in multiple sources (e.g. face, name, scene, and personal object). We also found the ATL serves as a “neural switchboard,” coordinating with a network of other brain regions in a rapid and need-specific way to retrieve different aspects of biographical information (e.g., occupation and personality traits). Our findings endorse the ATL as a central hub for representing and retrieving person knowledge.
Article
Judging other people is a common and important task. Every day professionals make decisions that affect the lives of other people when they diagnose medical conditions, grant parole, or hire new employees. To prevent discrimination, professional standards require that decision makers render accurate and unbiased judgments solely based on relevant information. Facial similarity to previously encountered persons can be a potential source of bias. Psychological research suggests that people only rely on similarity-based judgment strategies if the provided information does not allow them to make accurate rule-based judgments. Our study shows, however, that facial similarity to previously encountered persons influences judgment even in situations in which relevant information is available for making accurate rule-based judgments and where similarity is irrelevant for the task and relying on similarity is detrimental. In two experiments in an employment context we show that applicants who looked similar to high-performing former employees were judged as more suitable than applicants who looked similar to low-performing former employees. This similarity effect was found despite the fact that the participants used the relevant résumé information about the applicants by following a rule-based judgment strategy. These findings suggest that similarity-based and rule-based processes simultaneously underlie human judgment.
Article
The present research investigated the hypothesis that elderly and horizontal body position contribute to impair learning capacity. To this aim, 30 young (mean age: 23.2 years) and 20 elderly women (mean age: 82.8 years) were split in two equal groups, one assigned to the Seated Position (SP), and the other to the horizontal Bed Rest position (hBR). In the Learning Phase, participants were shown 60 words randomly distributed, and in the subsequent Recognition Phase they had to recognize them mixed with a sample of 60 new words. Behavioral analyses showed age-group effects, with young women exhibiting faster response times and higher accuracy rates than elderly women, but no interaction of body position with age group was found. Analysis of the RP component (250–270 ms) revealed greater negativity in the left Occipital gyrus/Cuneus of both sitting age-groups, but significantly left-lateralized RP in left Lingual gyrus only in young bedridden women. Elderly hBR women showed a lack of left RP lateralization, the main generator being located in the right Cuneus. Young participants had the typical old/new effect (450–800 ms) in different portions of left Frontal gyri/Uncus, whereas elderly women showed no differences in stimulus processing and its location. EEG alpha activity analyzed during a 3 min resting state, soon after the recognition task, revealed greater alpha amplitude (i.e., cortical inhibition) in posterior sites of hBR elderly women, a result in line with their inhibited posterior RP. In elderly women the left asymmetry of RP was positively correlated with both greater accuracy and faster responses, thus pointing to a dysfunctional role, rather than a compensatory shift, of the observed right RP asymmetry in this group. This finding may have important clinical implications, with particular regard to the long-term side-effects of forced Bed Rest on elderly patients.