metricas
covid
Buscar en
International Journal of Clinical and Health Psychology
Toda la web
Inicio International Journal of Clinical and Health Psychology Interventions for psychiatric disorders among university students: An umbrella r...
Journal Information
Vol. 24. Issue 1.
(January - March 2024)
Share
Share
Download PDF
More article options
Visits
936
Vol. 24. Issue 1.
(January - March 2024)
Original article
Full text access
Interventions for psychiatric disorders among university students: An umbrella review of systematic reviews and meta-analyses
Visits
936
Huan Huanga,, Shaofen Huangb,, Shiyun Chenc, Xuping Gaoc,d, Jun Caic, Yonghui Fengc, Jiazi Liuc, Xin Suc, Jiamin Qiuc, Shiwen Zhangc, Ying Xue, Zheng Liue,
Corresponding author
liuzheng8411@126.com

Corresponding authors.
, Ting Wangf,
Corresponding author
wangtingjnu@126.com

Corresponding authors.
, Fangfang Zengc,
Corresponding author
zengffjnu@126.com

Corresponding authors.
a Political Security Department of the Party Committee/People's Armed Forces Department, Jinan University, No.601 Huangpu Road West, Guangzhou 510632, Guangdong, PR China
b Shenzhen Qianhai Shekou Free Zone Hospital, 36 Gongye 7th Road, Shekou, Shenzhen 518067, Guangdong, PR China
c Department of Public Health and Preventive Medicine, School of Medicine, Jinan University, No.601 Huangpu Road West, Guangzhou 510632, Guangdong, PR China
d Peking University Sixth Hospital (Institute of Mental Health), National Clinical Research Center for Mental Disorders & Key Laboratory of Mental Health, Ministry of Health (Peking University), 51 Huayuan Bei Road, Beijing 100191, PR China
e Baoan Center for Chronic Diseases Control, 332 Yu'an 2nd Road, Bao'an District, Shenzhen 518101, Guangdong, PR China
f School of Management, Jinan University, No.601 Huangpu Road West, Guangzhou 510632, Guangdong, PR China
This item has received
Article information
Abstract
Full Text
Bibliography
Download PDF
Statistics
Figures (2)
Tables (1)
Table 1. Characterization and quality assessment of a qualified meta-analysis assessing the relationship between mental disorders and interventions for college students.
Additional material (1)
Abstract
Background

Mental disorders are considered to be the main reason for the increase of the disease burden. College students seem to be more vulnerable to the adverse effects of stress, which makes them more at risk of suffering from mental disorders. This umbrella review aimed to evaluate the credibility of published evidence regarding the effects of interventions on mental disorders among university students.

Methods

To identify systematic reviews and meta-analyses investigating the effects of interventions on mental disorders in the university student population, extensive searches were carried out in databases including PubMed, Embase, and the Cochrane Database, spanning from inception to July 21, 2023. Subsequently, a thorough reanalysis of crucial parameters such as summary effect estimates, 95 % confidence intervals, heterogeneity I2 statistic, 95 % prediction intervals, small-study effects, and excess significance bias was performed for each meta-analysis found.

Results

Nineteen articles involving 74 meta-analyses were included. Our grading of the current evidence showed that interventions based on exercise, Cognitive-behavioural Intervention (CBI), mindfulness-based interventions (MBI), and other interventions like mood and anxiety interventions (MAI) were effective whereas exercise intervention had the highest effect size for both depression and anxiety among university students. However, the credibility of the evidence was weak for most studies. Besides, suggestive evidence was observed for the positive effects of CBI on sleep disturbance(SMD: -0.603, 95 % CI: -0.916, -0.290; P-random effects<0.01) and MAI on anxiety (Hedges'g = -0.198, 95 % CI: -0.302, -0.094; P-random effects<0.01).

Conclusion

Based on our findings, it appears that exercise interventions, CBI, and MAI have the potential to alleviate symptoms related to mental disorders. Despite the overall weak credibility of the evidence and the strength of the associations, these interventions offer a promising avenue for further exploration and research in the future. More high-quality randomized controlled trials should be taken into account to verify the effects of these interventions on various mental disorders.

Keywords:
Mental disorders
Exercise interventions
Cognitive behavioural interventions
Umbrella review
Meta-analysis
Full Text
Introduction

Mental disorders are increasingly considered the major driver of the growth of disease burden and a worldwide public health concern ("Global, regional & national burden of 12 mental disorders in 204 countries & territories, 1990–2019: a systematic analysis for the Global Burden of Disease Study 2019,", 2022). The global burden of diseases study (GBD) 2019 finds that depression and anxiety are rated as the 13th and 24th leading causes of DALYs, respectively, with prevalence estimates and disability significantly higher than other diseases ("Global, regional & national burden of 12 mental disorders in 204 countries & territories, 1990–2019: a systematic analysis for the Global Burden of Disease Study 2019,", 2022).

Mental illness can negatively affect many people throughout their entire lives in different forms and degrees (Vigo, Thornicroft & Atun, 2016). It is suggested that students are vulnerable populations because they are often susceptible to the impacts of stress (Auerbach et al., 2016). To be specific, post-secondary students are at a high risk of developing mental health problems and university students may suffer from mental diseases in any given year (Auerbach et al., 2018; Ibrahim, Kelly, Adams & Glazebrook, 2013). Mental disorders can lead to various longstanding negative impacts, including poor academic performance, increased dropout rates, lowered life satisfaction, and even increased suicide risk (Gong et al., 2023; Sheldon et al., 2021).

Despite the Lancet Commission on global mental health and sustainable development advocating for paying more attention to mental health and emphasizing more investment in mental health services, global decision-makers and funders fail to realize the importance of treatment and support of people with mental diseases to some extent (Saxena, Thornicroft, Knapp & Whiteford, 2007; Sheldon et al., 2021). Given the imbalance between the increasing global burden of mental disorders and insufficient attention to mental health, evaluating and determining an effective intervention for people with mental illness is necessary.

To date, a great variety of mental health promotion interventions have been developed for people with common mental illnesses. Although methodological approaches differed between existing studies, the main promising ways include physical exercise, cognitive behavioural therapy, mindfulness-based intervention, art intervention, educational intervention, support groups, etc. totally(Sun et al., 2022). Such interventions might exert a positive effect in alleviating mental disorders. However, limited reviews systematically evaluate the effectiveness of various interventions for mental disorders, in which many of them are focused on a single topic. As such, the existing evidence is prone to occur bias like publication bias and excess significance bias, leading to an overestimated result(Jüni, Altman & Egger, 2001).

Umbrella reviews are increasingly taken into account as a methodological way to consolidate the highest quality level of evidence by merging and assessing the systematic reviews and meta-analyses (Kim et al., 2021; Papatheodorou, 2019). Compared with conventional meta-analyses examining the same treatment comparison, umbrella reviews give a more comprehensive overview of different treatments on the given question. It enables researchers to re-assess the risk of bias and hierarchies of evidence of published studies, allowing decision-makers to develop an objective guideline (Ioannidis, 2009).

Therefore, we aimed to perform an umbrella review of systematic reviews with meta-analyses to assess the effects of interventions for mental disorders in university students and evaluate the certainty of the evidence.

Method

This umbrella review was conducted by Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) guidelines (Page et al., 2021). The study was registered on the International Prospective Register of Systematic Reviews (PROSPERO) under the registration number CRD42023450905.

Search strategy and study selection

We systematically searched the electronic databases PubMed, Embase, and Cochrane from inception to 21 July 2023. The full search strategy is available in the Supplemental Methods. There were no language restrictions. To identify potentially eligible studies, two reviewers (HH and HSF) independently screened titles and abstracts followed by full-text screening. We also hand-searched the references list of eligible studies to identify further relevant articles. All discrepancies were resolved by consensus through discussion with a third reviewer (ZFF). If 2 or more published meta-analyses examined an identical theme, we included the most recent meta-analysis with the largest number of individual studies and high-quality studies to avoid overlaps (Ioannidis, 2009).

Inclusion and exclusion criteria

The identified studies were independently reviewed by two authors based on the following inclusion criteria: 1) published ‘meta-analysis’ or ‘systematic review and meta-analysis’ focused on randomized controlled trials (RCTs) or non-randomized intervention studies; 2) mental health conditions (i.e., mental disorders and related symptoms) should be assessed using structured psychiatric diagnostic interviews, as well as validated or commonly used rating scales; 3) the research targeted university students; and 5) reported the summary effect size with 95 % confidence intervals (CI). In addition, studies that did not clearly describe the intervention were excluded. All disagreements between the two authors were discussed and resolved consistently. In addition, if several articles used the same population (from the same original study), only the most recent, complete, or largest study would be included in the review. However, if different meta-analyses report different results for that population, all of those results will be included in the omnibus review(Ioannidis, 2009).

Data extraction and quality assessment

Two investigators (HH and HSF) independently extracted data from the studies, including the title, first author, publication year, number of included studies and participants, intervention, comparison, outcomes, and specific effect metrics (i.e., standardized mean difference (SMD; including Hedge's g and Cohen's d)) with 95 % CIs. Interventions in this umbrella review were classified into 4 categories: 1) mindfulness-based interventions; 2) exercise interventions; 3) cognitive and behavioural-related interventions; 4) other interventions (e.g., educational interventions, aromatherapy, animal-assisted interventions, and internet-based interventions).

The methodological quality of each included meta-analysis was assessed by applying AMSTAR 2. This 16-item tool rated the overall confidence of systematic review into 4 categories (high, moderate, low, and critically low) rather than deriving an overall score(Shea et al., 2017).

Data analysis

The summary effect estimate, its corresponding 95 % CIs and P value were recalculated using the random effects model of DerSimonian and Laird, as in previous umbrella reviews (Barbui et al., 2020; Kim et al., 2020). We conducted Cochran's Q tests and calculated the I2 statistic to detect heterogeneity between studies. P value<0.10 was considered significant for Cochran's Q test and I2>50 % indicated high heterogeneity (Ioannidis, Patsopoulos & Evangelou, 2007; WG, 1954). We also estimated the 95 % prediction interval, suggesting the range in which the effect estimate of a future study examining the same research question is expected to lie (Riley, Higgins & Deeks, 2011). Egger's regression asymmetry test was applied to assess publication bias (Egger, Davey Smith, Schneider & Minder, 1997). An Egger's P value<0.10 indicated the presence of small-study effects, which meant the small studies were more likely to give high-risk estimates and the effects estimate of large studies tended to be more conservative (Papadimitriou et al., 2021). The potential excess significance bias was evaluated to investigate whether the observed number of studies (O) with nominally statistically significant results (P<0.05) of each meta-analysis was different from the expected (E) (Ioannidis & Trikalinos, 2007). The expected number of significant results was calculated based on the sum of the statistical power estimates, with an algorithm from a non-central t distribution and a plausible effect size for the tested association, which was defined as the estimate of the largest study in each meta-analysis (J, 2013). P value<0.10 was considered as a statistical threshold of excess significance. All statistical analyses were performed using R Statistical Software (http://www.R-project.org, The R Foundation). The statistical tests were all two-tailed.

Certainty of evidence

We determined the strength of evidence for each outcome included in the umbrella review in line with previous umbrella reviews (Gao et al., 2022; Papatheodorou, 2019). The approach categorized evidence from systematic reviews and meta-analyses into 5 classes: convincing evidence (class I), highly suggestive evidence (class II), suggestive evidence (class III), weak evidence (class IV), and no significant evidence (class V). Criteria for each level of evidence were as follows (Hermelink et al., 2022): 1) P values<10−6 under a random effects model, >1000 cases, I2<50 %, 95 % prediction interval excluding the null value, no small-study effect and no excess significance bias, 2) P values<10−6 under a random effects model, largest study with a statistically significant effect and criteria of class I not met, 3) >1000 cases, P values<10−3 under a random effects model and criteria of class I-II not met, 4) P value<0.05 under random-effects and criteria of class I-III not met, 5) P value≥0.05 under random-effects.

Results

The flowchart of the study selection process was shown in Fig. 1. The systematic search resulted in a total of 776 records. After the removal of duplicates and scanning of the titles and abstracts, 525 articles were excluded: 387 inappropriate intervention, 51 traditional reviews, 87 others (editorial and non-human studies, etc.), and 37 full-text articles were assessed for potential eligibility. Finally, 19 articles involving 74 meta-analyses met the umbrella review inclusion criteria and were eventually included for reanalysis. Table 1 shows the details of the included systematic reviews. The included reviews analysed intervention effects on university students with anxiety, depression or stress, respectively. Among these systematic reviews, 15 meta-analyses examined the effect of exercise-based interventions, 15 meta-analyses examined the effect of cognitive and behavioural-related interventions, 20meta-analyses assessed the effect of mindfulness-based interventions, and 24 meta-analyses assessed the effect of other interventions including educational-based interventions, Aromatherapy, animal-assisted interventions and international-based interventions.

Fig. 1.

Study selection profile.

(0.48MB).
Table 1.

Characterization and quality assessment of a qualified meta-analysis assessing the relationship between mental disorders and interventions for college students.

First-author, year  No. of participants  Intervention  Comparison  Mental disorders  Outcomes  Effect metrics  OverallRating 
Gong et al., 2023(Gong et al., 2023)  447/461  MBCT  Inactive (waitlist)  Depression, anxiety, stress  Depression, anxiety, stress  SMD  Moderate 
Oliveira Silva et al., 2023(Oliveira Silva et al., 2023)  609/574  Simulation; compared conventional educational strategies with simulation  Conventional educational interventions  Stress, anxiety  Stress, anxiety  SMD  High 
Chandler et al., 2022(Chandler et al., 2022)  6558/6356  CBT-I-based interventions  Waitlist or treatment as usual (passive)Alternative intervention (active)  Sleep disturbance, anxiety, depression  Sleep, anxiety, depression  SMD  Low 
Du et al., 2022(Du et al., 2022)  369/332  Taijiquan intervention  Regular physical activity group  Depression, anxiety  Depression, anxiety  SMD  Low 
Huber et al., 2022(Huber et al., 2022)  320/312  Active intervention  Active animal controlActive other controlNo-treatment control  Acute anxiety, acute self-perceived stress, negative affect  Acute anxiety, acute self-perceived stress, negative affect  SMD  High 
Lin et al., 2022(Lin et al., 2022)  712/714  Qigong exercise  Original sports exercise practices, relaxation training or maintaining the original lifestyle without any intervention  Depression, anxiety, mood  Depression, anxiety, mood  SMD  High 
Luan et al., 2022(Luan et al., 2022)  151/139  Aromatherapy  No intervention or placebo intervention  Anxiety  Test anxiety  SMD  Low 
Luo et al., 2022(Luo et al., 2022)  295/292  Physical activity  Not doing regular exercise trainingLearning health knowledge and CBT intervention  Anxiety disorder, depression  Anxiety disorder, depression  SMD  High 
Yang et al., 2022(Yang et al., 2022)  45/45  Traditional Chinese fitness exercises  Routine lifestyle  Anxiety, depression, sleep disorder  Anxiety, depression, sleep disorder  SMD  Moderate 
Zhang et al., 2022(Zhang et al., 2022)  257/257  Exercise  Blank, non-exercise intervention group  Anxiety  Test anxiety  SMD  Critically low 
Chen et al., 2021(Chen et al., 2021)  481/460  Mindfulness meditation; acceptance and commitment training  Physical exercise, waitlist  Depression, anxiety, stress  Depression scores, anxiety scores, stress scores  SMD  Low 
Song et al., 2021(Song et al., 2021)  2910/2627  Aerobic exercise; traditional Chinese exercises; meditation  Nr  Depressive, anxiety  Depressive symptoms, anxiety  SMD  Low 
Bolinski et al., 2020(Bolinski et al., 2020)  1433/1346  Mood and anxiety intervention  Assessment only waitlist  Depression, anxiety  Depression, anxiety  Hedges'g  High 
Harrer et al., 2019(Harrer et al., 2019)  1039/891  Internet interventions  Wait list, Mental health education website, psychoeducation, Expressive writing, No treatment and Placebo  Depression, anxiety, stress  Depression, anxiety, stress  Hedges'g  Moderate 
Huntley et al., 2019(Huntley et al., 2019)  1362/847  BT; CBT; SST; combined  Attentional control, instructional control, no treatment control, self-help, supportive counselling, and waitlist control  Anxiety  Test anxiety  Hedges'g  Moderate 
Ma et al., 2019(Ma et al., 2019)  120/119  Mindfulness-based intervention  No intervention, waiting list  Depression  Depression  SMD  Moderate 
Huang et al., 2018(Huang et al., 2018)  2306/2356  Cognitive and behavioural related interventions; mindfulness-based interventions; attention/perception modifications; other interventions  No treatment, waitlist or placebo control  Depression, anxiety  Depression, anxiety  SMD  Low 
Lo et al., 2018(Lo et al., 2018)  1128/1198  Cognitive-behavioural; mindfulness; psychoeducational; relaxation  Waitlist, non-meditating activity, placebo, education control  Anxiety, depression, stress  Anxiety, depression, stress  SMD  Low 
Regehr et al., 2013(Regehr et al., 2013)  831/734  Cognitive behavioural, mindfulness-based interventions  NR  Depression, anxiety  Depression, anxiety  SMD  Critically low 

Abbreviation. MBCT, Mindfulness-based cognitive therapy; CBT-I, cognitive behavioural therapy for insomnia; BT, behavior therapy; CBT, cognitive-behavioural therapy; SST, study skill training; NR, not reported; SMD, standardized mean difference.

Of the 19 included systematic reviews, 26 % (n = 5) (Bolinski et al., 2020; Huber et al., 2022; Lin et al., 2022; Luo, Zhang, Liu, Ma & Jennings, 2022; Oliveira Silva et al., 2023) studies were rated as “high”, 26 % (n = 5) (Gong et al., 2023) (Yang, Guo, Cheng & Zhang, 2022) (Harrer et al., 2019; Huntley et al., 2019; Ma, Zhang & Cui, 2019) as “moderate”, 37 % (n = 7) (Chandler et al., 2022; Du et al., 2022) (Chen et al., 2021; Lo et al., 2018; Luan et al., 2022) (Huang, Nigatu, Smail-Crevier, Zhang & Wang, 2018; Song, Liu, Huang, Wu & Tao, 2021) as “low” and 11 % (n = 2) (Regehr, Glancy & Pitts, 2013; Zhang, Li & Wang, 2022) as “critically low” quality with the AMSTAR2 scoring system. Supplementary Table 1 presented the details of the quality of each included study evaluated using the AMSTAR2 tool. The most frequent flaws for the low methodological quality reviews were as follows: the protocol of the systematic overview was not mentioned, no description of the study selection process and the data extraction process, the potential impact of risk of bias (RoB) was not assessed and the literature was not accounted for the RoB in individual studies when interpreting the results of the review, and publication bias was not examined or discussed.

Exercise intervention

A total of 15 meta-analyses assessed the effects of exercise interventions including Baduanjin, Taichi, Wuqinxi, traditional Chinese exercises, and aerobic exercise on mental illness, of which 7 (Du et al., 2022; Lin et al., 2022; Song et al., 2021; Yang et al., 2022) meta-analyses related to depression, 7(Du et al., 2022; Lin et al., 2022; Luo et al., 2022; Song et al., 2021; Zhang et al., 2022) related to anxiety and 1(Lin et al., 2022) related to mood changes. 10 re-analyses were nominally statistically significant under random effects models (P<0.05), however, only one 95 % prediction interval excluded the null value. 73 % (n = 11) of the included meta-analyses had high heterogeneity (I2>50 %). Evidence of small-study effects bias was observed in 3 meta-analyses, and excess significance bias was detected in 10 meta-analyses. However, 8 meta-analyses consisted of less than 5 studies, in which case the power of the test would be reduced (Fig. 2 and Supplemental Table 2).

As for the strength of evidence, there is no meta-analysis presented convincing, highly suggestive, or suggestive evidence. 10 meta-analyses had weak evidence, indicating that exercise intervention could alleviate depression, including one meta-analyses item about Baduanjin (SMD: −0.718, P-random effects:<0.01) (Lin et al., 2022), one about Wuqinxi (SMD: −1.455, P-random effects: 0.02) (Lin et al., 2022) one about Tai Chi (SMD: −0.555, P-random effects: 0.01) (Du et al., 2022), one about traditional Chinese exercises and (SMD: −0.418, P-random effects: 0.01) (Song et al., 2021), and one about Aerobic Exercise (SMD: −0.533, P-random effects:<0.01) (Song et al., 2021). Weak evidence also indicated that exercise intervention could alleviate anxiety symptoms, including two meta-analyses items about Baduanjin (SMD: −0.453, P-random effects:<0.01 (Lin et al., 2022); and SMD: −0.220, P-random effects:<0.01 (Luo et al., 2022)), two about Tai Chi (SMD: −1.346, P-random effects:<0.01 (Zhang et al., 2022); and SMD: −0.255, P-random effects: 0.03 (Du et al., 2022)), and one about Aerobic Exercise (SMD: −0.499, P-random effects:<0.01 (Song et al., 2021)).

Cognitive behavioural intervention (CBI)

A total of 15 meta-analyses assessed the effects of cognitive behavioural intervention on mental health problems including depression, anxiety, sleep disturbance, and stress. Overall 12 re-analyses reported a nominally statistically significant summary result using random effects models (P<0.05). The 95 % prediction interval excluded the null value in only two meta-analyses. There was significant heterogeneity (I2>50 %) in 33 % (n = 5) of the included meta-analyses. Evidence of small-study effects bias was noticed in two meta-analyses whereas excess of significance bias was observed in six meta-analyses. 7 meta-analyses consisted of less than 5 studies, suggesting the power of the test would be reduced (Fig. 2 and Supplemental Table 2).

Only one meta-analysis (Chandler et al., 2022) was supported by suggestive strength of the evidence that CBI has positive effects on sleep disturbance, with the SMD of −0.603 (95 % CI: −0.916, −0.290) and P-random effects<0.01. Strength of association was weak for nine meta-analyses, suggesting that CBI could reduce the risk of depression (SMD: −0.588 to −0.295, all P-random effects<0.01), anxiety (SMD: −0.768 to −0.234, P-random effects:<0.01–0.04; Hedges'g: −0.579 to −0.830, all P-random effects<0.01) and stress (SMD: −0.544 to −0.603, all P-random effects<0.01). In addition, 2 meta-analyses supported by weak evidence also indicated that there were CBI effects on depression and anxiety. The Hedges’ g was 0.456 (95 % CI:0.082, 0.831) for depression and 0.553 (95 % CI: 0.283,0.823) for anxiety, separately.

Mindfulness-based intervention (MBI)

A total of 20 meta-analyses assessed the effect of a mindfulness-based intervention on mental health problems including depression, anxiety, and stress. Among these comparisons, 14 re-analyses were nominally statistically significant at P<0.05 under random effects models, and only two 95 % prediction intervals excluded the null value. About 25 % (n = 5) of the included meta-analyses that we re-analysed had high heterogeneity (I2>50 %). The risk of small-study effects bias was noticed in 1 comparison, and excess significance bias was verified for 6 comparisons. However, most comparisons (15/20) consisted of less than 5 studies, in which case the power of the test was reduced (Fig. 2 and Supplemental Table 2).

None of the 20 meta-analyses achieved convincing, highly suggestive, or suggestive strength of the evidence. In addition, the strength of the evidence was weak for meta-analyses, which showed that MBI could reduce the risk of anxiety (SMD: −0.803 to −0.483, P-random effects:<0.01–0.04), depression (SMD: −0.728 to −0.287, P-random effects:<0.01–0.03) and stress (SMD: −0.624 to −0.343, P-random effects:<0.01–0.04). Weak evidence also showed that MBI was effective for the prevention of depressive symptoms, with SMD (95 % CI) of 0.836 (0.371, 1.301).

Other interventions

A total of 24 meta-analyses assessed the effect of other interventions (i.e., educational interventions, simulation, aromatherapy, study skill training, acceptance, and commitment therapy, etc.) on mental health problems including depression, anxiety, and stress. 11 re-analyses reported a nominal statistically significant summary effect under random effects models (P<0.05), however, only two 95 % prediction interval excluded the null value. 46 % (n = 11) of the included meta-analyses had high heterogeneity (I2>50 %). The risk of small-study effects bias was noticed in three meta-analyses whereas the excess of significance bias was observed in eight meta-analyses. However, most meta-analyses (17/24) consisted of less than 5 studies, indicating the power of the test would be reduced (Fig. 2 and Supplemental Table 2).

A meta-analysis achieved suggestive strength of evidence suggesting that mood and anxiety intervention (MAI) had positive effects on anxiety (Hedges'g = −0.198, 95 % CI: −0.302, −0.094, P-random effects<0.01). Furthermore, 11 meta-analyses were supported by weak evidence, which suggested other interventions like simulation (SMD: −0.415, P-random effects: 0.86) (Oliveira Silva et al., 2023), present control intervention (Hedges'g: 0.417, P-random effects:<0.01) (Harrer et al., 2019), acceptance, commitment training (SMD: −0.552, P-random effects:<0.01) (Chen et al., 2021) and attention/perception modification (SMD: −0.530 to −0.494, P-random effects: 0.01) (Huang et al., 2018) could have effects on university students with mental health problems including depression, anxiety and stress.

Discussion

To our knowledge, this study is the first umbrella review to comprehensively and quantitatively identify and evaluate the hierarchy of evidence for various types of interventions for university students with mental disorders. We included 19 published systematic reviews, which comprised 74 meta-analyses for the efficacy of different interventions for mental health outcomes including depression, anxiety, stress, and sleep disturbance. Overall, approximately 64 % (n = 47) of the included associations between interventions and mental disorders reported a nominally statistically significant summary random-effects estimate. 43 % (n = 32) associations represented large heterogeneity (I2>50 %). When the 95 % prediction intervals were calculated, which further indicated between-study heterogeneity, we found that the null value was excluded in only 9 % of the associations, this estimate could be explained by the low percentage of nominally significant meta-analyses. Furthermore, in about 12 % (n = 9) of the associations, the summary estimates were overestimated because of small study effects and in 41 % (n = 30) the observed number of studies with nominally statistically significant results in each meta-analysis was larger than expected, which implied that the results might have low power of test due to many meta-analyses with a small number of individual studies.

Our grading of the current evidence suggested that interventions based on exercise, CBI, MBI, and other interventions like MAI were effective while exercise intervention had the highest effect size for both depression and anxiety among university students. However, the strength of the efficacy and credibility of evidence was weak for most studies according to the umbrella review criteria. We found that the reduced confidence in the evidence could be attributed to the between-study heterogeneity, risk of excess significance bias, and prediction intervals including the null value, thus the reported associations need to be interpreted with caution.

It was suggested that contemporary university students are under pressure from study, life, job and family stressors, which were increasingly becoming the source of their psychological distress (Yang et al., 2022). Continuous stress and mental tension could trigger a range of unfavorable feelings and increase the risk of mental disorders such as anxiety and depression (Bonnet & Arand, 2000). The use of psychiatric medication was common among people with mental disorders. However, a significant number of side effects were frequently associated with medical treatment, which reduced treatment compliance and therefore negatively impacted the efficacy of the psychiatric medication (Carrascal-Laso et al., 2021; Lally & MacCabe, 2015). The findings of this umbrella review might provide an alternative or adjunctive treatment for disorders of this type. In this study, the efficacy of exercise intervention for depression and anxiety was supported by the strength of weak evidence. Despite the credibility of the estimate for this efficacy was not being optimal, it was worth conducting more high-quality randomized controlled trials to verify the effects of exercise interventions on various mental disorders. Previous studies examining the relationship between exercise and mental health have been widely conducted (Huang et al., 2021). The results of this review were in agreement with the previously published review suggesting that physical activity is one of the mainstay effective approaches in the management of depression, anxiety, and other mental health problems (Gao, 2022; Liu et al., 2021; Singh et al., 2023). Routine traditional fitness practice could alleviate fatigue and tension in the brain through the reduction of negative mood (Yang et al., 2022). The potential mechanism of exercise intervention contributing to alleviating severe anxiety and depression symptoms could be explained by the increased training of the middle cerebral cortex from exercises such as Qigong and Taichi, which has been shown to regulate the hypothalamic-pituitary-adrenal axis, brain-derived neurotrophic factor, monoamine neurotransmitter, and adiponectin. Developing the habits of routine exercise would be beneficial for the promotion of physical and psychological health (Yeung, Chan, Cheung & Zou, 2018).

Moreover, the current umbrella review found suggestive evidence to support a moderate positive effect of cognitive behavioural therapy for insomnia (CBT-I) intervention on sleep disturbance among university students, which was in concert with previous studies looking at the effects of CBT for insomnia on sleep and even extend to mental health (Cheung, Jarrin, Ballot, Bharwani & Morin, 2019; Murawski, Wade, Plotnikoff, Lubans & Duncan, 2018). The development of insomnia is typically accompanied by depression, and often continuous following depression alleviated (Henry et al., 2021). Improvements in sleep quality could contribute to moderate improvements in mental health and improvements in insomnia have been observed to mediate the effects of depression using a CBT-I intervention (Henry et al., 2021; Scott, Webb, Martyn-St James, Rowse & Weich, 2021). It is hypothesized that CBI including sleep restriction therapy and stimulus management could boost slow-wave sleep, which was recognized as a disruption in both insomnia and depression, leading to increased homeostatic sleep drive (Krystal & Edinger, 2010; Staner, 2010). University students have the unique advantage of resources to utilize free services offered by university settings for counselling and intervention treatment of mental disorders, however, mental health problems are still high in this population. Sleep is rarely stigmatized way, thus universities can improve the condition by offering services through campus accommodation and/or university apps (Chandler et al., 2022). Additionally, we also found suggestive evidence that mood and anxiety intervention (MAI) has a small effect on anxiety. Notably, the evidence from a meta-analysis included only 4 individual studies. Therefore, the summary estimates might be inflated due to small study effects bias.

Mindfulness meditation is increasingly being included in mental health interventions, and our research shows weak evidence that mindfulness meditation can reduce the risk of anxiety and depression and prevent depressive symptoms. Mindfulness meditation training aims to help practitioners overcome depressive rumination by returning their attention to the present moment while eliminating rumination also reduces the emotional significance of the rumination thinking process, thereby reducing the risk of depression recurrence (Alsubaie et al., 2017). The effect of mindfulness meditation on anxiety is also to reduce repetitive negative thinking, similar to depression (Gu, Strauss, Bond & Cavanagh, 2015). After mindfulness meditation exercise, promotes top-down regulation of responsiveness to vague stimuli, leading to increased activation of brain regions important for emotional assessment and response (ventromedial PFC, ACC, and insula)(Goldin, Ziv, Jazaieri & Gross, 2012).

Limitation

The main limitations of this umbrella review are those of the included study, that is the limitations of the original meta-analyses. The most frequent flaws for the low methodological quality reviews, detected by AMSTAR2, were the absence of a protocol of the systematic overview, no description of the study selection process and the data extraction process, the potential impact of risk of bias (RoB) not assessed and absence of a thorough discussion of the RoB in individual studies when interpreting the results of the review, and publication bias were not examined or discussed.

Furthermore, we were not able to quantify the degree of mental disorders at a patient level, which could have minimized the between-study variability of the synthesized findings. We also did not analyze whether the efficacy of interventions is influenced by the type of inactive control, length of follow-up, type of provider, or other clinical or social-related variables. However, we have minimized potential bias using methodological approaches recommended by the available guidelines for evidence-based reviews.

Despite we searched major databases and additional sources to retrieve relevant literature, we could not include unpublished articles and those not published in the major databases. This potential exclusion of studies that could meet our criteria may inevitably result in publication bias. Finally, this umbrella study encompassed the meta-analyses conducted on university students, they are not representative of all sections of the overall population with mental disorders.

Conclusions

In conclusion, this umbrella review provides preliminary evidence of the effectiveness of different non-pharmacological interventions on university students with mental disorders. However, these results should be interpreted carefully since heterogeneity was high. Future high-quality studies are necessary to confirm more convincing evidence of the potential effects of non-pharmacological interventions in the prevention and control of mental disorders.

Funding

The 2022 Guangdong Provincial National Defense Education Project "Research on the National Defense Education System for Hong Kong, Macao, and Taiwan Overseas Chinese Students in Mainland Universities from the Perspective of the Overall National Security Perspective" by the Guangdong Federation of Social Sciences and the Guangdong Provincial Association of National Defense Education (SL22ZD01); Fundamental Research Funds for Central Universities in 2022 "Research on the influencing factors of scientific and technological security of Jinan University" (21622801); School level Teaching Quality and Teaching Reform Project of Jinan University "Reform and Practice of Teaching Military Theory Courses in Colleges and Universities Characterized by overseas Chinese in the New Era." (JG2022122).

Data availability

All data included in this study were extracted from publicly available systematic reviews.

CRediT authorship contribution statement

WT and XY designed the study. HH and HSF performed the searches and data extraction. CSY analyzed the data. HH and HSF drafted the manuscript. All authors contributed and approved the manuscript.

References
[Alsubaie et al., 2017]
M. Alsubaie, R. Abbott, B. Dunn, C. Dickens, T.F. Keil, W. Henley, et al.
Mechanisms of action in mindfulness-based cognitive therapy (MBCT) and mindfulness-based stress reduction (MBSR) in people with physical and/or psychological conditions: A systematic review.
Clinical psychology review, 55 (2017), pp. 74-91
[Auerbach et al., 2016]
R.P. Auerbach, J. Alonso, W.G. Axinn, P. Cuijpers, D.D. Ebert, J.G. Green.
Mental disorders among college students in the world health organization world mental health surveys.
Psychological medicine, 46 (2016), pp. 2955-2970
[Auerbach et al., 2018]
R.P. Auerbach, P. Mortier, R. Bruffaerts, J. Alonso, C. Benjet, P. Cuijpers.
WHO world mental health surveys international college student project: prevalence and distribution of mental disorders.
Journal of abnormal psychology, 127 (2018), pp. 623-638
[Barbui et al., 2020]
C. Barbui, M. Purgato, J. Abdulmalik, C. Acarturk, J. Eaton, C. Gastaldon.
Efficacy of psychosocial interventions for mental health outcomes in low-income and middle-income countries: An umbrella review.
The lancet. Psychiatry, 7 (2020), pp. 162-172
[Bolinski et al., 2020]
F. Bolinski, N. Boumparis, A. Kleiboer, P. Cuijpers, D.D. Ebert, H. Riper.
The effect of e-mental health interventions on academic performance in university and college students: A meta-analysis of randomized controlled trials.
Internet interventions, 20 (2020),
[Bonnet and Arand, 2000]
M.H. Bonnet, D.L. Arand.
Activity, arousal, and the MSLT in patients with insomnia.
Sleep, 23 (2000), pp. 205-212
[Carrascal-Laso et al., 2021]
L. Carrascal-Laso, M. Franco-Martín, E. Marcos-Vadillo, I. Ramos-Gallego, B. García-Berrocal, E. Mayor-Toranzo, et al.
Economic impact of the application of a precision medicine model (5SPM) on psychotic patients.
Pharmacogenomics and personalized medicine, 14 (2021), pp. 1015-1025
[Chandler et al., 2022]
L. Chandler, C. Patel, L. Lovecka, M. Gardani, L. Walasek, J. Ellis.
Improving university students' mental health using multi-component and single-component sleep interventions: A systematic review and meta-analysis.
Sleep Med, 100 (2022), pp. 354-363
[Chen et al., 2021]
X. Chen, B. Zhang, S.X. Jin, Y.X. Quan, X.W. Zhang, X.S. Cui.
The effects of mindfulness-based interventions on nursing students: A meta-analysis.
Nurse education today, 98 (2021),
[Cheung et al., 2019]
J.M.Y. Cheung, D.C. Jarrin, O. Ballot, A.A. Bharwani, C.M. Morin.
A systematic review of cognitive behavioral therapy for insomnia implemented in primary care and community settings.
Sleep medicine reviews, 44 (2019), pp. 23-36
[Du et al., 2022]
Z. Du, X. Zhang, H. Qin, R. Wang, Y. Bai, X. Yao.
META analysis on the effect of taijiquan on improving negative psychological symptoms of college students and the optimal dose.
Frontiers in public health, 10 (2022),
[Egger, Davey Smith, Schneider and Minder, 1997]
M. Egger, G. Davey Smith, M. Schneider, C. Minder.
Bias in meta-analysis detected by a simple, graphical test.
BMJ (Clinical research ed.), 315 (1997), pp. 629-634
[Gao, 2022]
M. Gao.
Experimental study on the effect of taijiquan on the physical function and mental health of college students.
Applied bionics and biomechanics, 2022 (2022),
[Gao et al., 2022]
X. Gao, X. Su, X. Han, H. Wen, C. Cheng, S. Zhang.
Unsaturated fatty acids in mental disorders: an umbrella review of meta-analyses.
Advances in nutrition (Bethesda, Md.), 13 (2022), pp. 2217-2236
[Global, regional, and national burden of 12 mental disorders in 204 countries and territories, 1990-2019: A systematic analysis for the Global Burden of Disease Study 2019 2022]
Global, regional, and national burden of 12 mental disorders in 204 countries and territories, 1990-2019: A systematic analysis for the Global Burden of Disease Study 2019.
The lancet. Psychiatry, 9 (2022), pp. 137-150
[Goldin, Ziv, Jazaieri and Gross, 2012]
P. Goldin, M. Ziv, H. Jazaieri, J.J. Gross.
Randomized controlled trial of mindfulness-based stress reduction versus aerobic exercise: Effects on the self-referential brain network in social anxiety disorder.
Frontiers in human neuroscience, 6 (2012), pp. 295
[Gong et al., 2023]
X.G. Gong, L.P. Wang, G. Rong, D.N. Zhang, A.Y. Zhang, C. Liu.
Effects of online mindfulness-based interventions on the mental health of university students: A systematic review and meta-analysis.
Frontiers in psychology, 14 (2023),
[Gu, Strauss, Bond and Cavanagh, 2015]
J. Gu, C. Strauss, R. Bond, K. Cavanagh.
How do mindfulness-based cognitive therapy and mindfulness-based stress reduction improve mental health and wellbeing? A systematic review and meta-analysis of mediation studies.
Clinical psychology review, 37 (2015), pp. 1-12
[Harrer et al., 2019]
M. Harrer, S.H. Adam, H. Baumeister, P. Cuijpers, E. Karyotaki, R.P. Auerbach.
Internet interventions for mental health in university students: A systematic review and meta-analysis.
International journal of methods in psychiatric research, 28 (2019), pp. e1759
[Henry et al., 2021]
A.L. Henry, C.B. Miller, R. Emsley, B. Sheaves, D. Freeman, A.I. Luik.
Insomnia as a mediating therapeutic target for depressive symptoms: A sub-analysis of participant data from two large randomized controlled trials of a digital sleep intervention.
Journal of sleep research, 30 (2021), pp. e13140
[Hermelink et al., 2022]
R. Hermelink, M.F. Leitzmann, G. Markozannes, K. Tsilidis, T. Pukrop, F. Berger, et al.
Sedentary behavior and cancer-an umbrella review and meta-analysis.
Eur J Epidemiol, 37 (2022), pp. 447-460
[Huang et al., 2018]
J. Huang, Y.T. Nigatu, R. Smail-Crevier, X. Zhang, J. Wang.
Interventions for common mental health problems among university and college students: A systematic review and meta-analysis of randomized controlled trials.
Journal of psychiatric research, 107 (2018), pp. 1-10
[Huang et al., 2021]
X. Huang, X. Wang, J. Hu, Y. Xue, Y. Wei, Y. Wan.
Inadequate mental health literacy and insufficient physical activity potentially increase the risks of anxiety and depressive symptoms in chinese college students.
Frontiers in psychiatry, 12 (2021),
[Huber et al., 2022]
A. Huber, S.J. Klug, A. Abraham, E. Westenberg, V. Schmidt, A.S. Winkler.
Animal-assisted interventions improve mental, but not cognitive or physiological health outcomes of higher education students: a systematic review and meta-analysis.
International journal of mental health and addiction, (2022), pp. 1-32
[Huntley et al., 2019]
C.D. Huntley, B. Young, J. Temple, M. Longworth, C.T. Smith, V. Jha, et al.
The efficacy of interventions for test-anxious university students: A meta-analysis of randomized controlled trials.
Journal of anxiety disorders, 63 (2019), pp. 36-50
[Ibrahim, Kelly, Adams and Glazebrook, 2013]
A.K. Ibrahim, S.J. Kelly, C.E. Adams, C. Glazebrook.
A systematic review of studies of depression prevalence in university students.
Journal of psychiatric research, 47 (2013), pp. 391-400
[Ioannidis, 2009]
J.P. Ioannidis.
Integration of evidence from multiple meta-analyses: A primer on umbrella reviews, treatment networks and multiple treatments meta-analyses.
CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne, 181 (2009), pp. 488-493
[Ioannidis, Patsopoulos and Evangelou, 2007]
J.P. Ioannidis, N.A. Patsopoulos, E. Evangelou.
Uncertainty in heterogeneity estimates in meta-analyses.
BMJ (Clinical research ed.), 335 (2007), pp. 914-916
[Ioannidis and Trikalinos, 2007]
J.P. Ioannidis, T.A. Trikalinos.
An exploratory test for an excess of significant findings.
Clinical trials (London, England), 4 (2007), pp. 245-253
[John, 2013]
I. J.
Clarifications on the application and interpretation of the test for excess significance and its extensions.
Journal of mathematical psychology, 57 (2013), pp. 184-187
[Jüni, Altman and Egger, 2001]
P. Jüni, D.G. Altman, M. Egger.
Systematic reviews in health care: Assessing the quality of controlled clinical trials.
BMJ (Clinical research ed.), 323 (2001), pp. 42-46
[Kim et al., 2020]
J.H. Kim, J.Y. Kim, J. Lee, G.H. Jeong, E. Lee, S. Lee.
Environmental risk factors, protective factors, and peripheral biomarkers for ADHD: An umbrella review.
The lancet. Psychiatry, 7 (2020), pp. 955-970
[Kim et al., 2021]
M.S. Kim, W.J. Kim, A.V. Khera, J.Y. Kim, D.K. Yon, S.W. Lee.
Association between adiposity and cardiovascular outcomes: An umbrella review and meta-analysis of observational and mendelian randomization studies.
Eur Heart J, 42 (2021), pp. 3388-3403
[Krystal and Edinger, 2010]
A.D. Krystal, J.D. Edinger.
Sleep EEG predictors and correlates of the response to cognitive behavioral therapy for insomnia.
Sleep, 33 (2010), pp. 669-677
[Lally and MacCabe, 2015]
J. Lally, J.H. MacCabe.
Antipsychotic medication in schizophrenia: A review.
Br Med Bull, 114 (2015), pp. 169-179
[Lin et al., 2022]
J. Lin, Y.F. Gao, Y. Guo, M. Li, Y. Zhu, R. You.
Effects of qigong exercise on the physical and mental health of college students: A systematic review and Meta-analysis.
BMC Complement Med Ther, 22 (2022), pp. 287
[Liu et al., 2021]
X. Liu, R. Li, J. Cui, F. Liu, L. Smith, X. Chen.
The effects of Tai Chi and Qigong exercise on psychological status in adolescents: A systematic review and meta-analysis.
Frontiers in psychology, 12 (2021),
[Lo et al., 2018]
K. Lo, J. Waterland, P. Todd, T. Gupta, M. Bearman, C. Hassed.
Group interventions to promote mental health in health professional education: A systematic review and meta-analysis of randomised controlled trials.
Advances in health sciences education : theory and practice, 23 (2018), pp. 413-447
[Luan et al., 2022]
J. Luan, M. Yang, Y. Zhao, Y. Zang, Z. Zhang, H. Chen.
Aromatherapy with inhalation effectively alleviates the test anxiety of college students: A meta-analysis.
Frontiers in psychology, 13 (2022),
[Luo et al., 2022]
Q. Luo, P. Zhang, Y. Liu, X. Ma, G. Jennings.
Intervention of physical activity for university students with anxiety and depression during the COVID-19 pandemic prevention and control period: A systematic review and meta-analysis.
International journal of environmental research and public health, (2022), pp. 19
[Ma, Zhang and Cui, 2019]
L. Ma, Y.N. Zhang, Z.S. Cui.
Mindfulness-based interventions for prevention of depressive symptoms in university students: A meta-analytic review.
Mindfulness (N Y), 10 (2019), pp. 2209-2224
[Murawski et al., 2018]
B. Murawski, L. Wade, R.C. Plotnikoff, D.R. Lubans, M.J. Duncan.
A systematic review and meta-analysis of cognitive and behavioral interventions to improve sleep health in adults without sleep disorders.
Sleep medicine reviews, 40 (2018), pp. 160-169
[Oliveira Silva et al., 2023]
G. Oliveira Silva, F.S.E. Oliveira, A.S.G. Coelho, L.M.M. Fonseca, F.V.M. Vieira, S.H. Campbell.
Influence of simulation design on stress, anxiety and self-confidence of nursing students: Systematic review with meta-analysis.
Journal of clinical nursing, (2023),
[Page et al., 2021]
M.J. Page, J.E. McKenzie, P.M. Bossuyt, I. Boutron, T.C. Hoffmann, C.D. Mulrow.
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews.
BMJ (Clinical research ed.), 372 (2021), pp. n71
[Papadimitriou et al., 2021]
N. Papadimitriou, G. Markozannes, A. Kanellopoulou, E. Critselis, S. Alhardan, V. Karafousia.
An umbrella review of the evidence associating diet and cancer risk at 11 anatomical sites.
Nature communications, 12 (2021), pp. 4579
[Papatheodorou, 2019]
S. Papatheodorou.
Umbrella reviews: What they are and why we need them.
Eur J Epidemiol, 34 (2019), pp. 543-546
[Regehr, Glancy and Pitts, 2013]
C. Regehr, D. Glancy, A. Pitts.
Interventions to reduce stress in university students: A review and meta-analysis.
Journal of affective disorders, 148 (2013), pp. 1-11
[Riley, Higgins and Deeks, 2011]
R.D. Riley, J.P. Higgins, J.J. Deeks.
Interpretation of random effects meta-analyses.
BMJ (Clinical research ed.), 342 (2011), pp. d549
[Saxena, Thornicroft, Knapp and Whiteford, 2007]
S. Saxena, G. Thornicroft, M. Knapp, H. Whiteford.
Resources for mental health: Scarcity, inequity, and inefficiency.
Lancet (London, England), 370 (2007), pp. 878-889
[Scott et al., 2021]
A.J. Scott, T.L. Webb, M. Martyn-St James, G. Rowse, S. Weich.
Improving sleep quality leads to better mental health: A meta-analysis of randomised controlled trials.
Sleep medicine reviews, 60 (2021),
[Shea et al., 2017]
B.J. Shea, B.C. Reeves, G. Wells, M. Thuku, C. Hamel, J. Moran.
AMSTAR 2: A critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both.
BMJ (Clinical research ed.), 358 (2017), pp. j4008
[Sheldon et al., 2021]
E. Sheldon, M. Simmonds-Buckley, C. Bone, T. Mascarenhas, N. Chan, M. Wincott.
Prevalence and risk factors for mental health problems in university undergraduate students: A systematic review with meta-analysis.
Journal of affective disorders, 287 (2021), pp. 282-292
[Singh et al., 2023]
B. Singh, T. Olds, R. Curtis, D. Dumuid, R. Virgara, A. Watson.
Effectiveness of physical activity interventions for improving depression, anxiety and distress: An overview of systematic reviews.
British journal of sports medicine, (2023),
[Song et al., 2021]
J. Song, Z.Z. Liu, J. Huang, J.S. Wu, J. Tao.
Effects of aerobic exercise, traditional Chinese exercises, and meditation on depressive symptoms of college student: A meta-analysis of randomized controlled trials.
Medicine, 100 (2021), pp. e23819
[Staner, 2010]
L. Staner.
Comorbidity of insomnia and depression.
Sleep medicine reviews, 14 (2010), pp. 35-46
[Sun et al., 2022]
Y. Sun, M. Ji, M. Leng, X. Li, X. Zhang, Z. Wang.
Comparative efficacy of 11 non-pharmacological interventions on depression, anxiety, quality of life, and caregiver burden for informal caregivers of people with dementia: A systematic review and network meta-analysis.
International journal of nursing studies, 129 (2022),
[Vigo, Thornicroft and Atun, 2016]
D. Vigo, G. Thornicroft, R. Atun.
Estimating the true global burden of mental illness.
The lancet. Psychiatry, 3 (2016), pp. 171-178
[WG, 1954]
C. WG.
The combination of estimates from different experiments.
Biometrics, 10 (1954), pp. 101-129
[Yang, Guo, Cheng and Zhang, 2022]
T. Yang, Y. Guo, Y. Cheng, Y. Zhang.
Effects of traditional chinese fitness exercises on negative emotions and sleep disorders in college students: A systematic review and meta-analysis.
Frontiers in psychology, 13 (2022),
[Yeung, Chan, Cheung and Zou, 2018]
A. Yeung, J.S.M. Chan, J.C. Cheung, L. Zou.
Qigong and Tai-Chi for mood regulation.
Focus (American Psychiatric Publishing), 16 (2018), pp. 40-47
[Zhang, Li and Wang, 2022]
X. Zhang, W. Li, J. Wang.
Effects of exercise intervention on students' test anxiety: A systematic review with a meta-analysis.
International journal of environmental research and public health, (2022), pp. 19

These authors have contributed equally to this work and share first authorship.

Download PDF
Article options