Figure - available from: Journal of Business and Psychology
This content is subject to copyright. Terms and conditions apply.
Source publication
The proper estimation of age, period, and cohort (APC) effects is a pervasive concern for the
study of a variety of psychological and social phenomena, inside and outside of organizations. One analytic technique that has been used to estimate APC effects is cross-temporal meta- analysis (CTMA). While CTMA has some appealing qualities (e.g., ease of...
Citations
... Specifically, they draw on her use of large data sets and argument that by looking at data patterns and conclusions about multiple generations across time (a method known as Cross Temporal Meta Analysis; CTMA), generation and age contributions can be unraveled. Broadly speaking, CTMA assumes that after holding chronological age more-or-less constant, birth cohort effects are stronger than period effects, and therefore, year-by-outcome effects are more plausibly attributable to cohort membership than contemporaneous period influences (Rudolph et al., 2020). Others disagree. ...
... Others disagree. In their conceptual and empirical critique, Rudolph et al. (2020) argued that CTMA is not able to clearly disentangle age, period, and cohort effects. Moreover, they claim that the results of a Monte Carlo study they conducted showed that, even if CTMA was able to disentangle these developmental influences, it is likely to systematically overestimate confounded period-cohort effects. ...
... Finally, on a methodological level, the current study presents an innovative way to meta-analyze complex subordinate ratings, which can represent both individual and aggregated ratings. The proposed methodology can therefore serve as a blueprint for future meta-analyses examining changes in leadership (or any other construct typically relying on multiple raters) over time, thereby also allowing for non-linear changes (Rudolph et al., 2020). ...
Scholars have suggested that leaders’ ethical failures at the beginning of the twenty-first century have raised awareness about the importance of ethical leadership (EL). Yet, there has been no systematic effort to evaluate whether this awareness indeed led to changes in EL or how followers react to this leadership style over time. To address this gap, we examine the evolution in EL means, variability, and its associations with follower outcomes between 2004 and 2019. Our cross-temporal meta-analysis included 359 independent samples from 314 studies published between 2005 and 2020 and focused on followers’ ratings of their leaders using the Ethical Leadership Scale (ELS; Brown et al., in Organizational Behavior and Human Decision Processes, 97(2), 117–134, 2005). Using cubic spline meta-regressions, our results indicated no global changes in EL mean levels and variability across the 15-year period. Nevertheless, country-level comparisons revealed different EL-trends in China (i.e. decrease) versus the United States (i.e. stable), and further moderation analyses highlighted the role of cultural value dimensions and national corruption rates. Finally, we also found that the relationship between EL and desirable follower outcomes (e.g. organizational citizenship behavior) became gradually stronger over time on a global level. These results provide a solid empirical basis to evaluate cross-temporal trends in EL and its (changing) impact on follower outcomes across the globe.
... However, previous studies on the moral distress of nurses mostly used a cross-sectional design, although the in uencing factors can be examined, it was impossible to accurately capture the changes in the moral distress of Chinese nurses over time from the perspective of a large longitudinal sample. Crosstemporal meta-analysis (CMTA) often use a cross-sectional "design" to explore psychological differences or changes related to long time-spans and historical developments [21]. Therefore, this study conducted a CTMA to explore the changes in moral distress of Chinese nurses from 2012 to 2021 and to analyze the factors. ...
... CTMA was rst used by Twenge [26] to examine the changes in people's attitude toward women along with historical developments. Compared with traditional analysis, CTMA does not need to calculate the effect size of each study, the primary interest of CTMA is the relationship between moral distress's score and year of data collection [21], then we introduce the instrument, inclusion and exclusion criteria, literature search and data coding and analysis. CTMA was introduced to China in 2008 by Xin et al [27], he used CTMA in studies on coping styles and mental health. ...
Aims: To examine how moral distress among Chinese nurses changed between 2012 and 2021, and its relationship with regions and departments.
Methods: We examined this question using a cross-temporal meta-analysis (CTMA). The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) were used as a guide for reporting the results.
Results: A total of 25 studies were included (N=7438). The results showed that nurses’ mean score of total moral distress and dimensions of individual responsibility, not in the patient’s best interest and damage patients’ interests increased significantly over year, but the trend of conflict of values was no significant. The scores of not in the patient’s best interest of nurses in other regions increased significantly. The conflict of values’ scores of ICU nurses and total moral distress and not in the patient’s best interest scores of oncology nurses showed increased significantly over time.
Conclusion: Results reveal that moral distress level of Chinese nurses increased over time, which might be due to ethics climate, international relationships, and burnout. It also shows the associations changes in nurses’ moral distress over years with region and department.
... That our findings age-out is such a common phenomenon so we should expect what was once a dependable relationship may be no more. We have a sufficient body of research that longitudinal investigation should be routine, often called cross-temporal meta-analysis (Rudolph et al., 2020). ...
... Second, the causal relationship between social changes and marital satisfaction needs to be further examined by longitudinal studies, and its internal impact mechanism also needs to be explored. Finally, the effectiveness of the cross-temporal meta-analysis method in reducing ecological fallacy was challenged by some researchers (Trzesniewski and Donnellan, 2010), and it has also been criticized for systematically overestimating effect sizes (Rudolph et al., 2020). Thus, we recommend that future research verify the reliability of these results of the present study using the method proposed by Trzesniewski and Donnellan (2010) and Rudolph et al. (2020). ...
... Finally, the effectiveness of the cross-temporal meta-analysis method in reducing ecological fallacy was challenged by some researchers (Trzesniewski and Donnellan, 2010), and it has also been criticized for systematically overestimating effect sizes (Rudolph et al., 2020). Thus, we recommend that future research verify the reliability of these results of the present study using the method proposed by Trzesniewski and Donnellan (2010) and Rudolph et al. (2020). ...
Objective
To investigate the changing trend of Chinese couples' marital satisfaction and its relationship with social changes.
Methods
A cross-temporal meta-analysis was performed on 118 original studies (n = 31,909) reporting marital satisfaction of Chinese couples from 1994 to 2020, primarily using correlation analysis and regression analysis.
Results
(1) Overall, the marital satisfaction of Chinese couples showed a downward trend over time. (2) Men's marital satisfaction displayed almost no change, while women's marital satisfaction had a more obvious downward trend. (3) Changes in macrosocial factors (per capita consumption expenditure, housing prices, old-age dependency ratio, and divorce rate) could significantly predict the downward trend of marital satisfaction, especially for women.
Conclusion
In the past 27 years, the overall marital satisfaction level of Chinese couples has shown a downward trend, and there are gendered differences, which may be related to changes in the socioeconomic and cultural environments.
... Still, analyses were run removing the poorest performing item from the security-related causes scale-failure to report suspicious activity-and the societal-related causes scale-a culture that promotes and rewards violence, with substantially similar results obtained between the full scales and the reduced scales. 3 Finally, there are some individuals who criticize generational research on both theoretical and methodological grounds (e.g., Costanza et al., 2017;Rudolph et al., 2019;Rudolph & Zacher, 2017;Terracciano, 2010;Trzesniewski & Donnellan, 2010). For example, Rudolph et al. (2019) suggest that "the separation of period and cohort effects is an intractable problem even in the population" [emphasis in original] because each of these three factors is entirely determined by the other two. ...
... 3 Finally, there are some individuals who criticize generational research on both theoretical and methodological grounds (e.g., Costanza et al., 2017;Rudolph et al., 2019;Rudolph & Zacher, 2017;Terracciano, 2010;Trzesniewski & Donnellan, 2010). For example, Rudolph et al. (2019) suggest that "the separation of period and cohort effects is an intractable problem even in the population" [emphasis in original] because each of these three factors is entirely determined by the other two. Although not a perfect remedy, studies have employed statistical techniques using longitudinal data (e.g., cross-temporal meta-analysis, cross-classified hierarchical linear modeling) to mitigate the concerns (for a review, see Lee, 2020). ...
Following a school shooting, the public and media search to understand what factors led to such tragedy. Faced with grief, fear, and confusion, people often seek to make sense of traumatic events. As such, this study uses a 2020 Amazon Mechanical Turk survey ( N = 739) to examine the impact of generational cohort on the blameworthiness of various perceived causes of school shootings. Findings support some generational differences. Baby Boomers were more likely to believe in societal-related causes of school shootings compared to Millennials and Generation Z. Conversely, Millennials and Generation Z were more likely than Baby Boomers to attribute the cause of school shootings to bullying, mental health, and school security. These findings suggest that future school shooting policies will seek to address bullying, mental health, and school security, while policies surrounding societal factors may be phased out.
... First were some methodological concerns regarding the cross-temporal meta-analysis. For example, environmental concern, an individuallevel measure, was treated as a study-level measure (i.e., mean NEP score) by assuming that the individual-level environmental concern within a study was homologous (Rudolph et al., 2020). The temporal trend was calculated based on the correlations between the year and study-level statistics, which may be biased compared with correlations derived from individual-level data points (Trzesniewski and Donnellan, 2010). ...
Public environmental concern is important for social transformations to sustainability. Previous findings regarding the temporal trend of environmental concern yielded inconsistent results. Their methodological divergence, however, prevented further result integration or moderation analyses. This cross-temporal meta-analysis used the New Environmental Paradigm of human thinking (reflecting the perceived relationship between humans and the environment) as an indicator of environmental concern to examine its temporal trend and the factors moderating this trend. We analyzed 184 independent study samples using the original or revised New Environmental Paradigm Scale (n = 73,645 participants) from 47 countries/regions between 1994 and 2017. Results showed that the New Environmental Paradigm of thinking decreased over time. No reliable evidence supported that the study sample characteristics (i.e., student vs. nonstudent sample type, sample mean age, and gender ratio) or societal characteristics (i.e., geographical location, societal education, and societal wealth) moderated the declining trend. Despite limitations of including only convenience samples in the analysis, the findings imply a global decreasing trend of environmental concern. The findings highlight the urgent need for new, effective campaigns or interventions to reverse this trend.
... Future research should extend this study to include such variables. As well, cross-temporal meta-analyses can confound period (contemporaneous time) and cohort (birth year) effects and so this analytic approach is not without practical problems in the absence of rich theory (Rudolph et al., 2020). ...
Recent evidence demonstrates rising self-oriented, other-oriented, and socially prescribed perfectionism among young people from the United States, United Kingdom, and Canada (Curran & Hill, 2019). One reason why perfectionism is increasing may be that rising competitiveness and individualism are requiring parents to engage in anxious, overly involved, and/or overly controlling forms of parenting. Yet, data to support this claim are limited and contested. In two meta-analyses, we expanded upon and tested this claim by examining whether excessive parental expectations and harsh parental criticism are correlated with perfectionism (Study 1) and whether these perceived practices are changing over time among American, Canadian, and British college students (Study 2). In Study 1, meta-analyses found small-to-moderate positive mean weighted effects of parental expectations and parental criticism on self-oriented and other-oriented perfectionism, and large positive mean weighted effects of parental expectations and parental criticism on socially prescribed perfectionism. In Study 2, using cross-temporal meta-analysis, we found that mean levels of parental expectations and parental criticism had linearly increased between 1989 and 2019 among college students. With rising competitiveness, individualism, economic inequality, and pressure to excel at school and college as the societal background, increases in parental expectations and parental criticism offer the most plausible explanation for rising perfectionism to date. (PsycInfo Database Record (c) 2022 APA, all rights reserved).
... In the present meta-analysis, we addressed this issue by including not only samples explicitly described as college student samples but also other samples that include emerging adults within the age range of 18-29 years. Further, Rudolph et al. (2019) have criticized cross-temporal meta-analyses for ignoring the dependence of effect sizes that occurs because studies are nested in years of data collection. To address this issue, we used robust variance estimation (RVE; Hedges et al., 2010;Tanner-Smith et al., 2016) in the present study as this method adjusts the standard errors of the effect sizes to account for dependency (Tanner-Smith et al., 2016;Tanner-Smith & Tipton, 2014). ...
Judged by the sheer amount of global media coverage, loneliness rates seem to be an increasingly urgent societal concern. From the late 1970s onward, the life experiences of emerging adults have been changing massively due to societal developments such as increased fragmentation of social relationships, greater mobility opportunities, and changes in communication due to technological innovations. These societal developments might have coincided with an increase in loneliness in emerging adults. In the present preregistered cross-temporal meta-analysis, we examined whether loneliness levels in emerging adults have changed over the last 43 years. Our analysis is based on 449 means from 345 studies with 437 independent samples and a total of 124,855 emerging adults who completed the University of California Los Angeles (UCLA) Loneliness Scale between 1976 and 2019. Averaged across all studies, loneliness levels linearly increased with increasing calendar years (β = .224, 95% CI [.138, .309]). This increase corresponds to 0.56 standard deviations on the UCLA Loneliness Scale over the 43-year studied period. Overall, the results imply that loneliness can be a rising concern in emerging adulthood. Although the frequently used term “loneliness epidemic” seems exaggerated, emerging adults should therefore not be overlooked when designing interventions against loneliness.
... Although research employing CTMA has argued that generations are more likely than period effects to explain observed differences, such work also recognizes that period effects are equally likely explanations for any results derived therefrom (e.g., Twenge & Campbell, 2010). Furthermore, a recent paper by Rudolph, Costanza, Wright, and Zacher (2019) used Monte Carlo simulations to test the underlying assumptions of CTMA, finding that it may misestimate cohort effects by a factor of three to eight times, raising questions about both the source and magnitude of any differences identified. ...
Talk about generations is everywhere and particularly so in organizational science and practice. Recognizing and exploring the ubiquity of generations is important, especially because evidence for their existence is, at best, scant. In this article, we aim to achieve two goals that are targeted at answering the broad question: “What accounts for the ubiquity of generations despite a lack of evidence for their existence and impact?” First, we explore and “bust” ten common myths about the science and practice of generations and generational differences. Second, with these debunked myths as a backdrop, we focus on two alternative and complementary frameworks— the social constructionist perspective and the lifespan development perspective—with promise for changing the way we think about age, aging, and generations at work. We argue that the social constructionist perspective offers important opportunities for understanding the persistence and pervasiveness of generations, and that, as an alternative to studying generations, the lifespan perspective represents a better model for understanding how age operates and development unfolds at work. Overall, we urge stakeholders in organizational science and practice (e.g., students, researchers, consultants, managers) to adopt more nuanced perspectives grounded in these models, rather than a generational perspective, to understand the influence of age and aging at work.
