key: cord-1049656-1gkg5bok
authors: Morgado, Tânia; Loureiro, Luís; Rebelo Botelho, Maria Antónia; Marques, Maria Isabel; Martínez-Riera, José Ramón; Melo, Pedro
title: Adolescents’ Empowerment for Mental Health Literacy in School: A Pilot Study on ProLiSMental Psychoeducational Intervention
date: 2021-07-29
journal: Int J Environ Res Public Health
DOI: 10.3390/ijerph18158022
sha: e9b924b2362b0401bfa09fc5e85bbfdbc831331e
doc_id: 1049656
cord_uid: 1gkg5bok

Adolescence is a critical life phase for mental health and anxiety an emerging challenge for adolescents. Psychoeducational interventions to promote mental health literacy (MHL) on anxiety in adolescents are needed. This study aimed to test the primary outcome of a future full-scale trial: improvement of adolescents’ anxiety MHL components on recognition, prevention strategies, and self-help strategies. A sample of 38 adolescents, 24 (63.2%) females and 14 (36.8%) males, with an average age of 14.50 years (SD = 0.89) participated in this study. Each class was allocated to the intervention group (IG, n = 21) or the waiting list control group (WLCG, n = 17) with single-blinded randomization. MHL was assessed using the QuALiSMental. The ProLiSMental psychoeducational intervention consists of four or eight weekly sessions of 90 or 45 min for adolescents, using different active pedagogical methods and techniques. There also are initial and final sessions with adolescents, legal guardians, and teachers. There was a significant improvement with a small to relatively strong effect size in many dimensions of anxiety MHL components. This study suggests the progression to the full-scale trial and values the important role of mental health and psychiatric nurses in the adolescents’ empowerment for MHL in schools.

The COVID 19 pandemic had implications for many dimensions of population health, including the mental health of people throughout the life cycle. In adolescents, several articles report the effects of the pandemic on their mental health [1] [2] [3] [4] [5] [6] , with approximately 38% of children and adolescents experiencing anxiety in the studies found in the systematic review carried out by Octavius et al. (2020) [5] . Some qualitative [7] and quantitative studies carried out in Portugal also report this reality [8, 9] . Orgilés et al. (2021) [9] refer that the prevalence of anxiety and depressive symptoms was higher than usual and in the Portuguese sample, a prevalence of 26.5% was found, slightly higher than the prevalence (11.5%) informed by Gaspar de Matos, Barrett, Dadds, and Shortt (2003) [10] . with different aims: to identify the evidence, with a systematic review [37] ; to identify the theory, with a narrative review [38] ; to model processes and results, with adolescents' and education/health professionals' focus groups [39] and experts' e-Delphi [40] ; to test the design and the methodology and assess the acceptability and feasibility, with an exploratory study [41, 42] . A pilot study was followed, a small-scale study to assess the primary outcome of a future full-scale study [45, 46] . Some authors have referred to the pertinence of using cluster randomized trials to pilot and evaluate complex interventions [47, 48] . In this study, a pilot quasi-cluster randomized controlled trial, with pretest, posttest, and one-month follow-up design was used. This study is registered in www.clinicaltrials.org (accessed on 28 July 2021) with ID number NCT03872817.

Adolescents in the 9th grade from a school in the Central Region of Portugal were eligible to participate in the pilot study of the ProLiSMental psychoeducational intervention. According to exception criteria, they were excluded from the study if being students with special educational needs (N = 1); students who participated in the feasibility study of this intervention (N = 11), and students and legal guardians who did not accept to participate and did not sign the informed consent (N = 1). The class directors recruited eligible participants.

We have followed the authors' suggestion [45] of using a 95% confidence interval approach to estimate sample size. From the total number of 67 adolescents attending the 9th grade at that school in the central region of Portugal, using G*Power 3.1 [49] , with a 95% confidence level and a sampling error of 5%, the sample size recommended for this study was 58 adolescents. Only 54 adolescents and their legal guardians from two classes in this school met the inclusion criteria, corresponding to a confidence level of 90% and a sampling error of 5%. After class randomization, 29 adolescents were included in the intervention group (IG), which received the ProLiSMental psychoeducational intervention first, and 25 adolescents in the waiting list control group (WLCG), which received the same intervention after it was completed in the IG. However, of these only 38 adolescents participated in all sessions of the ProLiSMental psychoeducational intervention and all phases of data collection, with 21 (55.3%) adolescents in the IG and 17 (44.7%) adolescents in the WLCG, which represents a 70.4% retention rate ( Figure 1 ). 

Based on the theoretical framework of several authors [13, 14, 16, 21, [50] [51] [52] [53] [54] , the Pro-LiSMental psychoeducational intervention to promote adolescents' MHL on anxiety was developed. Its main objective was to enable adolescents in the school context to access, understand, evaluate, and apply information about mental health, to promote and maintain good mental health, and to facilitate anxiety recognition, prevention, and management.

The ProLiSMental psychoeducational intervention is structured in phases [42] , whose total number of sessions can vary between 4 and 13 sessions and the total duration between 6 h and 13 h and 30 min. The psychoeducational phase with adolescents consists of four weekly sessions of 90 min or eight weekly sessions of 45 min. In each session, the following topics are approached: (1) "Recognise": mental health, emotions, and anxiety in adolescents"; (2) "Take care": mental health promotion and anxiety prevention, management, and self-help strategies; (3) "Seek help": mental health first aid actions, and seeking informal and formal help, including specialized health professionals; (4) "Action!": from knowledge on mental health and anxiety prevention, and management to action in everyday life.

In this pilot study, the ProLiSMental psychoeducational intervention was delivered in the school context by the principal researcher and three specialists nurses from primary health care (specializing in mental health and psychiatric nursing; child health and pediatric nursing or community health nursing) with experience in school health nursing and with previous 10-h training on the ProLiSMental psychoeducational intervention. In all sessions, three trainers, the researcher, and two of three primary health care nurses were always present, one of whom assumed the role of a non-participating observer.

The QuALiSMental [55] , the European Portuguese version of the "Survey of Mental Health Literacy in Young People-Interview Version" [20] , was used in this quasi-cluster randomized controlled trial to measure adolescents' MHL. The first part of the questionnaire includes instructions for filling out and questions of sociodemographic characterization of adolescents (gender, age, with whom they live, educational background, and employment situation of legal guardians). The second part reports a situation of an adolescent's social anxiety [41] , followed by questions regarding the different components of the MHL concept [14] from the perspective of knowledge, skills, and behavioral intentions [51] : (a) anxiety recognition; (b) anxiety prevention strategies; (c) anxiety self-help strategies; (d) help-seeking options; (e) anxiety mental health first aid. In this article, we will focus on the results for these first three components.

Each class was allocated to the IG or the WLCG with single-blinded randomization by tossing a coin before the first assessment has been taken. The IG received the ProLiSMental psychoeducational intervention in April 2016, and three assessments were carried out with the collaboration of the teachers with the role of class directors, differentiating from the facilitators of the ProLiSMental psychoeducational intervention: (1) one day before (pretest); (2) one day after (posttest); (3) one month after (follow-up). After the ProLiSMental psychoeducational intervention was completed in the IG, the WLCG also received the same intervention in May 2016. In the WLCG, the three assessments took place: (1) one month before; (2) one day before; (3) one day after the intervention.

The statistical analysis was performed using the IBM-SPSS 27.0 software. After the inversion of three dimensions ("avoid stressful situations"; "drink alcohol to relax"; and "smoke to relax"), appropriate descriptive statistics (e.g., mean, standard deviation), and absolute and percentage frequencies were calculated, where appropriate. The Cochran Q test with Dunn's post-hoc procedures, adjusted with Bonferroni's significance correction with a p-value of 0.05 was used. For the Cochran Q test, the chance-corrected measure of effect size (R) was used, where R is zero under chance conditions, unity when agreement among the n subjects is perfect, and negative under conditions of disagreement [56] . In this study, we considered the effect size intervals: up to 0.2-small; 0.2 to 0.5-moderate; 0.6 to 0.8-relatively large; 0.8 to 1-large. To assess the association between the IG and the WLCG at each moment, the chi-square test (χ 2 ) was used.

This study was approved by several organizations: (a) the Ethics Committee of the Regional Health Administration of Central Portugal (Administração Regional de Saúde do Centro), number 71 

Of the 38 participants in this study, 24 (63.2%) were female and 14 (36.8%) were male, with an average age of 14.50 years (SD = 0.89). In the baseline, the results regarding the sociodemographic characteristics of the participants in the IG (n = 21) and the WLCG (n = 17) ( Table 1) show the groups were homogeneous (p > 0.05). Mother's professional situation, n (%) Employeed 21 (100) 17 (100) † * Mean (M), Standard Deviation (SD); a Mann Whitney p-value (η 2 ); b Chi-square p-value (ϕ); c L-R p-value (V); † Test not performed or measure not calculated.

Regarding the "anxiety recognition" component, Table 2 shows the findings in the three assessments. In the IG after the intervention, "anxiety" was significantly recognized, with moderate effect size, by the participants (Q = 26.143; p < 0.001; R = 0.396), with a significant association between the moments a-b and a-c (p < 0.001). There were also statistically significant differences in the dimensions: "social anxiety" (Q = 10.429; p < 0.01; R = 0.132, with a significant association between the moment a-b and a-c, p < 0.01) and "shyness" (Q = 19.625; p < 0.001; R = 0.318, with a significant association between the moment a-b and a-c, p < 0.001).

In the WLCG, the third assessment also shows significant differences, with moderate effect size, in the dimensions: "anxiety" (Q = 22.154; p < 0.001; R = 0.434, with a significant association between the moment a-c and b-c, p < 0.001) and "social anxiety" (Q = 12.000; p < 0.01; R = 0.233, with a significant association between the moment a-c and b-c, p < 0.01).

In the analysis of independence between the groups at each moment, in this component there was a significant association between the IG and WLCG and the dimensions: "anxiety" (χ 2 = 20.442; p < 0.001) and "social anxiety" (χ 2 = 10.986; p < 0.001) in the second assessment.

Although about 47.6% and 70.6% of participants in the IG and WLCG groups respectively mentioned the "fear of exposure" in the baseline, in the second and the third assessment this percentage decreased statistically significant for the WLCG (Q = 12.200; p < 0.01; R = 0.163, with a significant association between the moments a-c, p < 0.001).

In the "anxiety prevention strategies" component (Table 3) , there were higher percentages of correct answers of the participants in the baseline for both groups, except for the dimensions "do not avoid stressful situations" and "have a religious or spiritual belief". In the first, there were no changes after the intervention for both groups. In the second, there was an improvement in the IG in the posttest and follow-up.

In the baseline, the highest percentages of correct answers were found in dimensions "regular contact with friends", "regular contact with family", and "improve self-esteem" for IG, which increased in the posttest. Particularly, to the dimension "regular contact with family", in the second assessment, there was a significant association to the WLCG (χ 2 = 5.828; p < 0.05). In the IG, after the intervention, there were statistically significant differences in the dimensions: "exercise regularly" (Q = 8.000; p < 0.01; R = 0.062, with a significant association between the moment a-b and a-c, p < 0.05). There were also significant differences in "regular sleep habits" (Q = 6.500; p < 0.05; R = 0.042, with a significant association between the moments a-c, p < 0.05); "regular relaxation training" (Q = 8.000; p < 0.05; R = 0.063, with a significant association between the moments a-b and a-c, p < 0.05). The dimension "have a religious or spiritual belief" (Q = 12.250; p < 0.01; R = 0.093, had a significant association between the moments a-b, p < 0.01), reinforcing improvements after the intervention.

In the WLCG, after the intervention, differently from the IG, the dimensions "do not drink alcohol" (Q = 6.000; p < 0.05; R = 0.027) and "healthy eating" (Q = 7.000; p < 0.05; R = 0.082) evidence a significant association between the moments a-c (p < 0.05).

Regarding the "anxiety self-help strategies" component (Table 4 ), in the baseline, the highest percentages of correct answers of the participants were found in the dimensions "exercise regularly", "do not drink alcohol to relax", and "do not smoke to relax". These dimensions remained or increased in the posttest and follow-up for the IG and remained after the intervention for the WLCG, not showing statistically significant differences in the three moments of assessment. In the IG, this component was the one that showed statistically significant differences after the intervention in more dimensions. We found a significant association between the moment a-b and a-c. Found however small association in relatively large effect sizes, such as "regular relaxation training" (Q = 10.000; p < 0.01; R = 0.093); "meditation regularly" (Q = 16.000; p < 0.001; R = 0.201); "acupuncture" (Q = 34.000; p < 0.001; R = 0.614). Also in the dimensions "get up early and sunbathe" (Q = 14.000; p < 0.01; R = 0.222); "website with credible information" (Q = 11.400; p < 0.01; R = 0.099); "self-help book" (Q = 8.769; p < 0.05; R = 0.093); "join a support group" (Q = 18.000; p < 0.001; R = 0.157), and "seek specialized mental health help" (Q = 13.273; p < 0.01; R = 0.152).

In the analysis of independence between the groups at each moment, there was a significant association between the IG and WLCG in the second assessment. These differences were identified in the dimensions "meditation regularly" (χ 2 = 9.299; p < 0.01); "acupuncture" (χ 2 = 23.543; p < 0.001); "get up early and sunbathe" (χ 2 = 10.600; p < 0.01); "therapy with a specialized professional" (χ 2 = 4.795; p < 0.05); "website with credible information" (χ 2 = 7.012; p < 0.01); "self-help book" (χ 2 = 4.962; p < 0.05) and "seek specialized mental health help" (χ 2 = 10.264; p < 0.001). These data showed improvements after the intervention. The significant association between the IG and WLCG continues in the third assessment in the dimensions: "acupuncture" (χ 2 = 5.208; p < 0.05) and "get up early and sunbathe" (χ 2 = 5.522; p < 0.05). This means that despite the increase of the correct answers in these dimensions in the WLCG, they were not enough to approach the values obtained in the IG after the intervention.

Additionally, in the WLCG after the intervention, differently from the IG, there were also significant improvements in the "therapy with a specialized professional" dimension (Q = 9.556; p < 0.01; R = 0.110), with a significant association between the moments a-c and b-c (p < 0.05).

This pilot study of the ProLiSMental psychoeducational intervention assessed the primary outcome of the future full-scale trial: improvement of adolescents' knowledge, skills, and behavioral intentions in the following components of anxiety mental health literacy at a school context: (a) anxiety recognition; (b) anxiety prevention strategies; (c) anxiety self-help strategies.

Regarding the first component, there was a significant improvement with a moderate effect size in the recognition of anxiety as a normative emotion and the recognition of pathological anxiety, namely the signs and symptoms of social anxiety. These results are in line with other studies on the development of mental health literacy interventions [58] [59] [60] [61] [62] [63] . There was also a reduction in the percentage of responses after intervention in the dimensions "shyness" and "fear of exposure", that despite its frequent association with social anxiety, recent evidence clarifies its similarities and differences [64] [65] [66] .

It is positive that the adolescents present good results in the anxiety prevention strategies component in the baseline. However, after the intervention, there were significant improvements with small effect size, in the dimensions: "exercise regularly"; "regular sleep habits"; "regular relaxation training"; "have a religious or spiritual belief" in the IG, and "do not drink alcohol" and "healthy eating" in the WLCG. These results corroborate the importance of healthy lifestyles and coping strategies for promoting mental health and wellbeing and preventing pathological anxiety from the earliest age groups such as children and adolescents [67, 68] . These results reinforce the need for interventions to promote mental health and MHL on these topics [18, 27, 29, 69] . However, the results of the dimension "do not avoid stressful situations" as an emotion regulation strategy [70, 71] decreased instead of increasing, throughout the three assessments, which suggest attention in the future fullscale trial. We wonder if this is due to any lack of clarification by facilitators or difficulty understanding by adolescents during the ProLiSMental psychoeducational intervention or when filling out the QuALiSMental questionnaire since this dimension appeared inverted.

In the "anxiety self-help strategies" component, some dimensions related to healthy lifestyles also showed high percentages in the baseline: "exercise regularly"; "do not drink alcohol to relax"; and "do not smoke to relax". Another dimension related to healthy lifestyles is "get up early and sunbathe", which showed statistically significant differences with moderate effect size in the IG after the intervention. There were other statistically significant improvements, with small to relatively large effect sizes, in many dimensions: "regular relaxation training"; "meditation regularly"; "acupuncture"; "website with credible information"; "self-help book"; "join a support group"; and "seek specialized mental health help" in the IG and "therapy with a specialized professional" in the WLCG. These results reinforce the importance of the positive view of the use of self-help strategies by young people, showing interest in learning new forms of self-help as a way of coping with anxiety [14, 58] . Similar results regarding the "self-help strategies" component are reported in other studies with interventions to promote MHL in adolescents [58] [59] [60] [61] [62] [63] , despite the differences between them in terms of the content and methodology of the interventions, for example, the components of the MHL under study, the number of sessions, the facilitators and the recipients.

Given the current global context of the Covid 19 pandemic, an emerging suggestion of this study is the possibility of developing ProLiSMental psychoeducational intervention in a digital and online way as noted by a recent systematic review [72] .

This intervention promotes adolescents' MHL as a protective factor of mental health in a universal way [50] and because we believe that simultaneously it contributes to the prevention of pathological anxiety, we suggest in future studies, in addition to MHL assessment, the possibility of assessing adolescents' anxiety levels before, after the intervention and over the time. We also suggest assessing satisfaction with the ProLiSMental psychoeducational intervention implementation, with validated instruments and even including legal guardians and teachers, since there are some sessions aimed at them. Reinforcing this idea, we also suggest future studies for the development of psychoeducational interventions to promote anxiety MHL aimed at these recipients.

Another interesting suggestion is the possibility of extending the ProLiSMental psychoeducational intervention to other contexts, from universal to a selective and indicated prevention perspective, reinforcing its potential to be developed throughout the mental health continuum [50] .

Considering the advantages of cluster randomized trials [47, 48] , we recognize the limitations related to the small sample size in this study, conditioning the retention and the randomization process, which increased the risk of bias.

For this reason, we suggest increasing the sample size in the full-scale trial, recruiting more participants, on the one hand, and increasing the number of facilitators, on the other hand, providing training on the ProLiSMental psychoeducational intervention, that will allow replication of the intervention on a larger scale.

The common areas of methodological uncertainty like recruitment, randomization, retention, blinding and data collection/outcome assessment methods [45, 46] were tested by this pilot study. Considering its limitations and suggestions, the results of this pilot study allow us to proceed to a full-scale trial, without changes in the components of the complex ProLiSMental psychoeducational intervention.

This pilot quasi-cluster randomized controlled trial shows the improvement of adolescents' knowledge, skills, and behavioral intentions after the ProLiSMental psychoeducational intervention, in the components of anxiety MHL: (a) anxiety recognition; (b) anxiety prevention strategies; (c) anxiety self-help strategies. Overall, there was a significant improvement and small to relatively strong effect size in many dimensions of anxiety MHL components in the IG compared to the WLCG, considering the evolution throughout the three assessments. Was similar in the WLCG at the third assessment, after the ProLiSMental psychoeducational intervention.

We highlight the significant improvements after the intervention and follow-up. These improvements include the recognition of normal and pathological anxiety; the anxiety prevention strategies: "exercise regularly"; "regular sleep habits"; "regular relaxation training"; "have a religious or spiritual belief" in the IG. Also the self-help strategies as a way of coping with anxiety: "get up early and sunbathe"; "regular relaxation training"; "meditation regularly"; "acupuncture"; "website with credible information"; "self-help book"; "join a support group"; and "seek specialized mental health help" in the IG.

The ProLiSMental psychoeducational intervention showed improvements of knowledge, skills, and behavioral intentions in various components of anxiety MHL as predictors of behaviors that promote mental health and prevent pathological anxiety, reinforcing the progression to the full-scale trial.

Despite the development, the feasibility evaluation, and the pilot of ProLiSMental psychoeducational intervention began before the Covid 19 pandemic context, due to the increased levels of anxiety in the general population and adolescents, in particular, this intervention seems to be extremely useful.

We believe that mental health and psychiatric nurses according to their professional and legal framework, as members of transdisciplinary teams, can contribute in a solid and scientifically sustained way to the development and implementation of psychoeducational interventions to promote MHL, mental health, and anxiety prevention, and simultaneously, to empower adolescents in schools.

Mental health and psychiatric nurses have an important role in facilitating networking between different health care professionals and contexts, with important contributions in the identification and early intervention in mental health problems in children and adolescents. 

COVID-19 pandemic impact on children and adolescents' mental health: Biological, environmental, and social factors

Challenges and burden of the Coronavirus 2019 (COVID-19) pandemic for child and adolescent mental health: A narrative review to highlight clinical and research needs in the acute phase and the long return to normality

Adolescent psychiatric disorders during the COVID-19 pandemic and lockdown

How is COVID-19 pandemic impacting mental health of children and adolescents?

Impact of COVID-19 on adolescents' mental health: A systematic review. Middle East Curr

Impact of COVID-19 and lockdown on mental health of children and adolescents: A narrative review with recommendations

Hey, we also have something to say": A qualitative study of Portuguese adolescents' and young people's experiences under COVID-19

Psychological Symptoms and Behavioral Changes in Children and Adolescents During the Early Phase of COVID-19 Quarantine in Three European Countries

Anxiety and Depressive Symptoms in Children and Adolescents during COVID-19 Pandemic: A Transcultural Approach

Anxiety, depression, and peer relationships during adolescence: Results from the Portuguese national health behaviour in school-aged children survey

World Health Organization. The WHO Special Initiative for Mental Health (2019-2023): Universal Health Coverage for Mental Health

Health literacy as a population strategy for health promotion

HLS-EU) Consortium Health Literacy Project European. Health literacy and public health: A systematic review and integration of definitions and models

Mental health literacy: Empowering the community to take action for better mental health

Mental Health Literacy: Promoting Public Action to Reduce Mental Health Problems. In Mental Health Literacy: Empowering People and Communities to Act

Mental health literacy": A survey of the public's ability to recognise mental disorders and their beliefs about the effectiveness of treatment

Positive mental health literacy: Development and validation of a measure among Norwegian adolescents

The Concept of Mental Health Literacy. In International Handbook of Health Literacy: Research, Practice and Policy across the Life-Span

Beliefs about appropriate first aid for young people with mental disorders: Findings from an Australian national survey of youth and parents

Transitions Theory Middle-Range and Situation-Specific Theories in Nursing Research and Practice

School-based mental health literacy interventions. In International Handbook of Health Literacy: Research, Practice and Policy across the Life-Span

Plano de Ação Para a Literacia em Saúde

Improving mental health literacy among young people aged 11-15 years in Java, Indonesia: Co-development and feasibility testing of a culturally-appropriate, user-centred resource (IMPeTUs)-A study protocol

Interventions for Adolescent Mental Health: An Overview of Systematic Reviews

School-based mental health promotion in children and adolescents with StresSOS using online or face-to-face interventions: Study protocol for a randomized controlled trial within the ProHEAD Consortium

Universal, school-based interventions to promote mental and emotional well-being: What is being done in the UK and does it work? A systematic review

Do universal school-based mental health promotion programmes improve the mental health and emotional wellbeing of young people? A literature review

Improving mental health literacy in adolescents: Systematic review of supporting intervention studies

Effectiveness of psycho-educational intervention to promote mental health focused on emotional intelligence in middle-school

School-based interventions to prevent anxiety and depression in children and young people: A systematic review and network meta-analysis

Review of mental health promotion interventions in schools

Manual de Boas Práticas Literacia em Saúde: Capacitação dos Profissionais de Saúde

Regulamento de Competências Específicas do Enfermeiro Especialista em Enfermagem de Saúde Mental e Psiquiátrica. Regulamento Nº 515. Diário da República, n.º 122

Regulamento dos Padrões de Qualidade dos Cuidados Especializados em Enfermagem de Saúde Mental

Intervenções promotoras da literacia em saúde mental dos adolescentes: Uma revisão sistemática da literatura

Psychoeducational interventions to promote adolescents' mental health literacy on anxiety in schools: Identifying theory for the development of a complex intervention

Psychoeducational intervention to promote mental health literacy among adolescents at school: A study with focus groups

Intervenção psicoeducacional ProLiSMental para adolescentes em contexto escolar: Validade de conteúdo através de e-Delphi modificado

A utilização de vinhetas na saúde mental: Tradução e adaptação transcultural de uma vinheta de ansiedade social em adolescentes

Acceptability and feasibility of the ProLiSMental psychoeducational intervention to promote adolescents' mental health literacy on anxiety in a school context

Developing and evaluating complex interventions: The new Medical Research Council guidance

Developing and evaluating complex interventions: Reflections on the 2008 MRC guidance

Pilot studies and feasibility studies for complex interventions: An introduction

How to use feasibility and pilot trials to test alternative methodologies and methodological procedures prior to full-scale trials

Quality of reporting of pilot and feasibility cluster randomised trials: A systematic review

Which design to evaluate complex interventions? Toward a methodological framework through a systematic review

Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences

Preventing Mental, Emotional, and Behavioral Disorders among Young People: Progress and Possibilities

Predicting and Changing Behavior: The Reasoned Action Approach

Health literacy as a public health goal: A challenge for contemporary health education and communication strategies into the 21st century

The evolving concept of health literacy

Health Promotion in Nursing Practice

Questionário de Avaliação da Literacia em Saúde Mental-QuALiSMental: Estudo das propriedades psicométricas

An alternative measure of effect size for Cochran's Q test for related proportions

World Medical Association Declaration of Helsinki: Ethical principles for medical research involving human subjects

Is It Possible to "Find Space for Mental Health" in Young People? Effectiveness of a School-Based Mental Health Literacy Promotion Program

Impact of contact on adolescents' mental health literacy and stigma: The SchoolSpace cluster randomised controlled trial

Adolescent Mental Health Literacy: Young People's Knowledge of Depression and Social Anxiety Disorder

A Brief Sports-Based Mental Health Literacy Program for Male Adolescents: A Cluster-Randomized Controlled Trial

Effects of a classroom-based educational resource on adolescent mental health literacy: A cluster randomised controlled trial

A school intervention for mental health literacy in adolescents: Effects of a non-randomized cluster controlled trial

Examining the relationships between error-related brain activity (the ERN) and anxiety disorders versus externalizing disorders in young children: Focusing on cognitive control, fear, and shyness

The translational neural circuitry of anxiety

Linking Temperamental Shyness and Social Anxiety in Childhood and Adolescence: Moderating Influences of Sex and Age

The effectiveness of the COPE healthy lifestyles TEEN program: A school-based intervention in middle school adolescents with 12-month follow-up

Lifestyle choices and mental health: A longitudinal survey with German and Chinese students

A Meta-Analysis of Universal School-Based Prevention Programs for Anxiety and Depression in Children

The role of emotion regulation in socially anxious children and adolescents: A systematic review

Emotion Regulation Strategies in Depressive and Anxiety Symptoms in Youth: A Meta-Analytic Review

A systematic mapping review of interventions to improve adolescent mental health literacy, attitudes and behaviours

The authors would like to thank Professor Anthony Jorm for always being available throughout the research process, the nurses who collaborated as facilitators, the collaborators of the school context where the study was developed, and the Health Sciences Research Unit: Nursing (UICISA:E), Escola Superior de Enfermagem de Coimbra, for always being available and providing support in all phases of the research process and development of the ProLiSMental psychoeducational intervention. We would also like to thank to the Centre for Interdisciplinary Research in Health, Universidade Católica Portuguesa (MAIEC project), for the contribution in the comprehensive vision of Community Health related to Mental Health and for the financing support of the project.Clinical Trial Registration Information: ClinicalTrials.gov ID: NCT03872817.

The authors declare no conflict of interest.