Projects per year
Abstract
Background
Universal school-based social and emotional learning (USB SEL) interventions may not benefit all students equally. Credible subgroup analyses are needed to understand differential effects and equity implications. This scoping review examined how subgroups are defined, analysed, reported, and prespecified in primary/elementary USB SEL trials.
Methods
Seven databases and trial registries were searched for reports dated from 2000 to August 2024. Eligible reports evaluated a USB SEL intervention using comparison/control-group designs reporting at least one subgroup analysis. Data were extracted on subgroup definitions and rationales, analytic and reporting practices, and trial registrations and protocols. Findings were narratively synthesised.
Results
Of 2,579 records, 118 reports representing 99 trials of 66 interventions were included. Gender and baseline difficulties were the most commonly examined moderators; other sociodemographic characteristics were examined less often, and analyses that considered multiple characteristics jointly were rare. Main-effect models accounted for clustering in 67.8% of reports; interaction-based tests were the most common subgroup approach (also 67.8%), but only two reports described adequate subgroup-analysis power and 16.1% adjusted for multiple comparisons. Subgroup effect sizes were reported in 72.9% and confidence intervals in 24.6%. Most analyses were described as planned and justified but 22.0% had a registration, 10.2% a protocol, and 11.9% prespecified all subgroup analyses in a located registration or protocol.
Conclusions
Although subgroup-analysis practice in USB SEL is improving, limited power, prespecification, demographic reporting, and transparency constrain inferences about differential effects. More consistent, theory-driven, prospectively documented, and adequately powered analyses are needed to determine whether benefits are equitably distributed.
Impact statement
• This scoping review synthesises how subgroup analyses are defined, conducted, reported, and prospectively documented in universal primary/elementary school-based SEL trials.
• Across 118 reports, subgroup analyses most often examined gender and baseline levels of difficulty or skill, whereas differential effects for students from socioeconomically disadvantaged, ethnic minority, or different language backgrounds, students with special educational needs, and students with intersecting characteristics were examined comparatively rarely.
•Although use of interaction-based and cluster-adjusted models has increased, subgroup analyses are rarely reported as adequately powered, adjustment for multiple comparisons is uncommon, and prospective documentation in registrations or protocols is limited.
•The review offers practical recommendations to improve the transparency, statistical rigour, and equity relevance of subgroup analyses, supporting more credible conclusions about who benefits from universal SEL interventions.
Universal school-based social and emotional learning (USB SEL) interventions may not benefit all students equally. Credible subgroup analyses are needed to understand differential effects and equity implications. This scoping review examined how subgroups are defined, analysed, reported, and prespecified in primary/elementary USB SEL trials.
Methods
Seven databases and trial registries were searched for reports dated from 2000 to August 2024. Eligible reports evaluated a USB SEL intervention using comparison/control-group designs reporting at least one subgroup analysis. Data were extracted on subgroup definitions and rationales, analytic and reporting practices, and trial registrations and protocols. Findings were narratively synthesised.
Results
Of 2,579 records, 118 reports representing 99 trials of 66 interventions were included. Gender and baseline difficulties were the most commonly examined moderators; other sociodemographic characteristics were examined less often, and analyses that considered multiple characteristics jointly were rare. Main-effect models accounted for clustering in 67.8% of reports; interaction-based tests were the most common subgroup approach (also 67.8%), but only two reports described adequate subgroup-analysis power and 16.1% adjusted for multiple comparisons. Subgroup effect sizes were reported in 72.9% and confidence intervals in 24.6%. Most analyses were described as planned and justified but 22.0% had a registration, 10.2% a protocol, and 11.9% prespecified all subgroup analyses in a located registration or protocol.
Conclusions
Although subgroup-analysis practice in USB SEL is improving, limited power, prespecification, demographic reporting, and transparency constrain inferences about differential effects. More consistent, theory-driven, prospectively documented, and adequately powered analyses are needed to determine whether benefits are equitably distributed.
Impact statement
• This scoping review synthesises how subgroup analyses are defined, conducted, reported, and prospectively documented in universal primary/elementary school-based SEL trials.
• Across 118 reports, subgroup analyses most often examined gender and baseline levels of difficulty or skill, whereas differential effects for students from socioeconomically disadvantaged, ethnic minority, or different language backgrounds, students with special educational needs, and students with intersecting characteristics were examined comparatively rarely.
•Although use of interaction-based and cluster-adjusted models has increased, subgroup analyses are rarely reported as adequately powered, adjustment for multiple comparisons is uncommon, and prospective documentation in registrations or protocols is limited.
•The review offers practical recommendations to improve the transparency, statistical rigour, and equity relevance of subgroup analyses, supporting more credible conclusions about who benefits from universal SEL interventions.
| Original language | English |
|---|---|
| Pages (from-to) | 100233 |
| Journal | Social and Emotional Learning: Research, Practice, and Policy |
| DOIs | |
| Publication status | Published - 1 Sept 2026 |
UN SDGs
This output contributes to the following UN Sustainable Development Goals (SDGs)
-
SDG 3 Good Health and Well-being
-
SDG 4 Quality Education
ASJC Scopus subject areas
- Education
- Health(social science)
- Public Health, Environmental and Occupational Health
- Pediatrics, Perinatology, and Child Health
Fingerprint
Dive into the research topics of 'A systematic scoping review of the methodological characteristics relating to subgroup analyses within universal school-based social and emotional learning interventions: a critical appraisal of the evidence and recommendations for the field'. Together they form a unique fingerprint.Projects
- 1 Finished
-
Evaluating A Universal Social-Emotional Learning Intervention ("Passport"), Kavli Trust (joint with lead institute Manchester University)
Boehnke, J. (Investigator)
1/10/22 → 31/12/25
Project: Research
Research output
- 1 Article
-
The effect of a universal, school-based social and emotional learning intervention (passport: Skills for life) on internalizing symptoms and related outcomes during the transition from childhood to adolescence: A cluster-randomized controlled trial
Humphrey, N. (Lead / Corresponding author), Boehnke, J. R., Santos, J., Alemdar, M., Panayiotou, M., O'Brien, A., Burke, L., Hamilton, S., Qualter, P., Demkowicz, O., Lu, Y. & Thompson, A., 21 Aug 2025, In: Journal of Educational Psychology. 21 p.Research output: Contribution to journal › Article › peer-review
Open AccessFile83 Downloads (Pure)
-
From study to target populations: addressing external validity through the Lens of Transportability and Generalisability
Kanaan, M. (Chair), Tipton, E. (Speaker), Dahabreh, I. (Speaker), Carpenter, J. R. (Speaker) & Boehnke, J. (Speaker)
3 Sept 2025Activity: Talk or presentation types › Oral presentation
-
A primer for planning randomised studies of psychotherapeutic interventions
Boehnke, J. (Speaker)
25 Jun 2025Activity: Talk or presentation types › Oral presentation
-
Contemporary Evaluation of Interventions: Mobile, Digital, and Pragmatic
Boehnke, J. (Keynote/plenary speaker)
4 Jun 2025Activity: Participating in or organising an event types › Participation in workshop, seminar, course
Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver