Question
Asked 16th Aug, 2018

How do I calculate effect size for mixed model regression (run using MIXED in SPSS) when there's only one group? So I can report the effect of time?

I have one group of people who completed measures at 3 time points and I'd like to calculate the effect size of change over time.

Most recent answer

Ali Gholamrezaei
The University of Sydney
David Morse Jimmy Y. Zhong why then running mixed model for the main analysis? the question here is how to calculate effect size based on the mixed model outputs?!

All Answers (5)

Kosta Sotiroski
University "St. Kliment Ohridski" - Bitola
For that purpose, use one of the non-parametric aunts in the SPSS in the case of a single sample.
1 Recommendation
David Eugene Booth
Kent State University
See the notes at this link. Marie Davidian is a real expert.
Best, David Booth
1 Recommendation
David Morse
Mississippi State University (Emeritus)
Hello Josephine,
A very simple way to proceed would be to compute mean (M) and standard deviation (SD) for each of the three time periods. Then, using time 1 as the baseline, define a Cohen's d ES estimate as (M_t1 - M_tx) / SD_t1 where "tx" means either time 2 or time 3, as desired. That statistic will give you the difference, in baseline SDs (and that is your ersatz common scale), from time 1 to time 2 (or time 3).
There are plenty of other schemes as well. Just enter "effect size" in YouTube or on the Amazon web sites to get a variety of explanations.
Good luck with your work.
2 Recommendations
Jimmy Y. Zhong
Georgia Institute of Technology
You can simply apply three one-sample tests, one for each time point. The baseline mean will the total mean from all time-points. For each time-point, you deduct this total mean from each time-point's mean to get the mean difference and you divide this over the pooled SD. In this case, you would derive three effect size values. For the predictor of time, you can code them into two dummy variables and regress the effect size values against the two temporal regressors. With time-point 1 (or another) set as the reference time-point, you will get two beta coefficients, for instance, beta1 showing the change in effect size from time-point 1 to 2, and beta2 showing the change in effect size from time-point 1 to 3.
1 Recommendation
Ali Gholamrezaei
The University of Sydney
David Morse Jimmy Y. Zhong why then running mixed model for the main analysis? the question here is how to calculate effect size based on the mixed model outputs?!

Similar questions and discussions

Interpreting Linear Mixed Model (SPSS): Test of Fixed Effects or Estimates of Fixed Effects? They offer conflicting results (?)
Question
14 answers
  • Julia NolteJulia Nolte
Dear all,
After having researched this question for days (ResearchGate, books, youtube, the general WWW....), I'm none the the wiser, even though it's probably an easy question. I'm new to linear mixed models, so my understanding is still very limited.
I'm running a 2-level linear mixed model in SPSS, where participants' search behavior in 2 different decision domains is nested within each individual (you could also imagine it as a repeated measure). I use a random intercept, and random effects for subjects. Other than that, I'm looking at age group (young, old), experimental condition (2 different types of information),health status (healthy, sick), and of course decision domain (health-related, not health-related) as "predictors" / factors. The DV is the amount of information participants have reviewed.
I have run my model but now I don't know how to interpret and report the results. It seems some sources I have consulted look at the Type III Test for Fixed Effects, which offers omnibus tests (F statistic) for main effects and interactions. I assume you can report these in writing, like I would with an ANOVA. However, some other people only report a table with Estimates for Fixed Effects, which offers t-tests. Some of the results in these tables "conflict" (maybe they don't, I just don't understand the difference yet), so I am unsure what to rely on and whether to report both.
To provide an example: My hypothesis was, among other things, that information seeking does not differ between age groups (i.e., no main effect). The F-test supports this, saying there is no overall effect of age group on information seeking. However, the estimates table lists age group as significant at p = .009, with information seeking as DV. The same is true for a couple more effects and interactions. Now I am very confused. There are not a lot of videos or texts covering both. One summary I found that addressed both types of tables did not provide insight into what to do if results differ. (Some people on ResearchGate and elsewhere also seem to refer to this t-test table as pairwise comparisons. If that is the case, does that mean that while age groups were significantly different in their search behavior when compared to each other, search behavior did not rely on age?)
I would be grateful for whatever insight you can share! Thank you.
How do I report the results of a linear mixed models analysis?
Question
47 answers
  • Subina SainiSubina Saini
1) Because I am a novice when it comes to reporting the results of a linear mixed models analysis, how do I report the fixed effect, including including the estimate, confidence interval, and p-value in addition to the size of the random effects. I am not sure how to report these in writing. For example, how do I report the confidence interval in APA format and how do I report the size of the random effects?
2) How do you determine the significance of the size of the random effects (i.e. how do you determine if the size of the random effects is too large and how do you determine the implications of that size)?
3) Our study consisted of 16 participants, 8 of which were assigned a technology with a privacy setting and 8 of which were not assigned a technology with a privacy setting. Survey data was collected weekly. Our fixed effect was whether or not participants were assigned the technology. Our random effects were week (for the 8-week study) and participant. How do I justify using a linear mixed model for this study design? Is it accurate to say that we used a linear mixed model to account for missing data (i.e. non-response; technology issues) and participant-level effects (i.e. how frequently each participant used the technology; differences in technology experience; high variability in each individual participant's responses to survey questions across the 8-week period). Is this a sufficient justification? 
I am very new to mixed models analyses, and I would appreciate some guidance. 

Related Publications

Data
Table S1. Statistical output of mixed model analysis with indicated effect size for significant factors
Article
Full-text available
GRD is a popular tool to genenrate random data on the fly. It is most useful in statistic classes where the students can generate with a single short syntax, or using a graphical interface, random data that differs on every run but yet can implement effect sizes, outliers, etc. With the new versions of SPSS (version 27 and above) which is now using...
Article
A new model is proposed for spatial dependence that includes separate parameters for overdispersion and the strength of spatial dependence. The new dependence structure is incorporated into a generalized linear mixed model useful for the estimation of disease incidence rates in small geographic regions. The mixed model allows for log-linear covaria...
Got a technical question?
Get high-quality answers from experts.