key: cord-0073193-njtp22m1
authors: Cheng, Kin Meng; Koo, Ah Choo; Mohd Nasir, Junita Shariza; Wong, Shen Yuong
title: Playing Edcraft at Home: Gamified Online Learning for Recycling Intention during Lockdown
date: 2021-12-20
journal: F1000Res
DOI: 10.12688/f1000research.72761.2
sha: 7283f78dc75b2b25df558666843aa2b0a5e769c6
doc_id: 73193
cord_uid: njtp22m1

Background: Gamification is an innovative approach to engaging in activities that people believe as less interesting. Recycling has been an issue not taken aware by the people in environmental sustainability. There are substantial studies on recycling intention due to the continual growth of unethical and unsustainable waste disposal. Creative approaches to recycling awareness activities should be made to fulfil youths’ increasing interest in and demand for recycling. The main objective of this study is to explore the factors related to youths’ recycling intentions after experiencing a gamified online recycling learning activity, Edcraft Gamified Learning (EGL). Gamified recycling education is believed to be a practical and engaging approach for youths. Methods: 100 students participated in EGL, consisting of two levels of plastic crafting and recycling activities. They experienced online EGL at home between May and September in 2020, during the COVID-19 pandemic total lockdown in Malaysia, namely, Movement Control Order (MCO). 29 participants were selected to participate in five focus group discussions (FGDs) with five to eight participants per session to explore their opinions towards gamified learning, motivation and recycling intention. Results: This paper reports the findings of the FGDs. A codebook was developed based on the codes from the FGD feedback. The codes were rated by two raters, followed by an assessment of inter-rater reliability and thematic analysis. The findings emerged and were confirmed with four themes as factors that influence recycling intention. They are gameful experience, social influence, intrinsic motivation, and extrinsic motivation. Conclusion: The dependent variable, recycling intention, was connected to the four themes to verify the conceptual framework. One limitation of the study was the design of the EGL activity, which was only carried out over two days with two levels of gamified recycling education, as students had concurrent academic online classes during that period.

Most countries have long ago adopted recycling to preserve the environment's health, which is often related to human health aspects. 1 Recycling behaviour has promoted a positive attitude towards the environment within society. Around the world, municipal waste production correlates with a country's economic growth. Statistics show that proenvironmental behaviour, awareness, and intentions are the most direct measures for coping with daily household waste production. Nonetheless, plastic packaging increased 53% internationally during the lockdown in the pandemic situation between March and June 2020. 2 Studies conducted in 2017 and 2018 show negative attitudes of the individuals like the lack of participation, feeling less responsible and not being aware of recycling in many countries have claimed that recycling education and infrastructure are insufficient. 3, 4 However, the negative attitudes had caused severe environmental destruction, as they are often more reactive and 'always forgot' or 'do not care' about the act of recycling when there is no support from recycling infrastructure, facilities or programmes. 5 This research aims to examine the factors that influence youths' recycling intention after experiencing a gamified online learning activity, Edcraft Gamified Learning (EGL), and to explore the effectiveness of gamified learning about recycling within a research framework. 6 2. Literature review 2.1 Gamification in learning Gamified learning is a term that refers to the fusion of gamification and education. It is, in essence, the application of game-design elements and game principles to the context of learning. Gamification has primarily been used in education to increase motivation for tasks or activities that are frequently perceived as boring or less enjoyable, particularly given that motivation is a significant predictor of students' academic achievement. Gamified learning's primary goal is to maintain learners' engagement and motivation, as well as to assist learners in achieving their learning objectives while having fun. Gamified learning is a process in which the traditional classroom methodology is transformed into a welldesigned, enjoyable classroom environment through the incorporation of game design and game-like experiences into the learning processes. It is a strategy for facilitating effective learning by involving learners in game-like elements such as challenges (levels, missions), competitions (leaderboards), and recognitions (points, rewards).

Learning can take place on any subject, but this study focuses on recycling, which is also an action that contributes to environmental sustainability.

Youths between the ages of 15 and 24 comprise 17% of the world's population, and they are the critical agents of change for the future, especially on climate change. 7 Youth has been understood as the responsible group to bring the benefits of society in the world, taking its place in attitudes, behaviours, knowledge and skills. 6 Greta Thunberg, a young climate and environmental activist, continues to lead, promote and motivate young people's awareness and behavioural changes towards pro-environmental actions. She encourages her followers to use digital platforms for pro-environmental awareness and actions. 8, 9 Thunberg's actions have also influenced some Malaysian youths to take climate action locally,

This version has been updated slightly on the abstract, specifically the first two sentences. The Literature review has added a new section on gamification in learning where it gives an introduction to the gamification domain. Then, in 2.2, Table 1 has been edited, two columns have been added to the table. The study type is on the methodology, the recommendation is the potential of gamification in waste management and recycling behaviour. Following is the conceptual framework whereby the explanation has been added for better coherency. In Methods, the activity EGL has been explained in detail and a new figure, Figure 2 also been added to show the flow of EGL activity. Previous version Figure 2 is now Figure 3 .

In 3.1 data analysis, the 6 phases of thematic analysis have been added to show the 6 steps of thematic analysis that has been implemented. All sections starting from 3.1.1, to 5 have been included with each step from the 6-step thematic analysis. In section 4.1, themes and categories, all subsections have added some info to further explain the analysis of each theme. Lastly, in section 5 -implication and conclusion, detail like game elements that contributed to the study and led to recycling intention was explained. Quantitative research that has been reviewed in Table 1 were discussed which has higher potential to explore the effectiveness of recycling behaviour.

Any further responses from the reviewers can be found at the end of the article such as that taken by Klima Action Malaysia (KAMY). 10 The youth-led green and climate movements have created a new revolution for positive environmental change, as evidenced by their influence and leadership on social media.

Youth populations are exposed to vast amounts of information, and multimedia and social media are recognised by these "digital natives". 11 The long hours youth spent online surfing the internet, socialising and playing video games in the virtual world during lockdowns due to the pandemic has increased tremendously. The long period spent by the youths in the virtual world has created an effective platform to influence their peers through video games and social media.

Studies have shown that youths opt to spend time playing video games online to avoid adverse psychological effects while confined at home during the pandemic. 12, 13 Young people should be exposed to positive activities to create an impact for any form of good cause, including pro-environmental initiatives. The initiatives can be done online, as demonstrated by youth leaders such as Thunberg and KAMY.

Waste separation and recycling are methods to curb problems associated with environmental hazards. Recycling is also a way to save economic and environmental resources. Hence, the importance of recycling behaviour has been studied, and it has been found that one of the most critical factors for achieving the effectiveness of recycling programmes is public participation, 3 which was studied by this research as people's intention to participate in recycling. Recycling is seen as problematic by some, who may perceive it as time-consuming and something that requires considerable effort. 14, 15 Germany and Sweden are among the countries that were positively impacted by their recycling programme in educating and engaging the people in waste separation and reached 90% of active participants in waste separation activity. 16, 17 Gamified learning is considered to engage people in recycling, and Table 1 , below, shows four different gamified environmental education programmes. From the findings in Table 1 , the common traits of gamified environmental awareness learning are that gamification can potentially influence the adoption of a positive recycling intention.

Some people perceive recycling as a time-consuming activity. This study will make use of gamification to engage the youth involvement in recycling, and change their "always forgot" and "do not care" attitude towards recycling intention. 5

In Figure 1 , the study has conceptualised a framework of recycling intention initiated by gamified learning. It was conceptualised that the youths' motivation is crucial to recycle and requires the intrinsic motivation (e.g., satisfaction, happiness or enjoyment, and extrinsic) motivation, e.g. (monetary reward, promotion or punishment) evoked from the gameful experience to influence their family and friends. Besides, a gameful experience is also believed to directly influence youths' families and friends from the game elements that are competitive and challenging.

With the assistance of gameful experience, the youths will be motivated intrinsically and extrinsically and socially influenced the peers and family members to recycle.

There are two research questions (RQ) from the research:

1) How effective is the online gamified recycling activity towards youths' recycling intention?

2) What are the factors of recycling intention that leads to the research conceptual framework?

The qualitative study relates to the two-level online gamified recycle crafting activity, namely Edcraft Gamified Learning (EGL) activity during the COVID-19 pandemic lockdown between May and September 2020. EGL is an online gamified activity that uses game elements (levels, points, leaderboard, and rewards) to create a craft from a recyclable item, such as used plastic.

This activity involved 100 youths from three institutions, one high school and two colleges in Selangor, Malaysia, who were 16-23 years old and staying at home due to the pandemic. Participants were recruited from their schools and colleges through the activity recruitment poster and "Word-of-Mouth" from the teachers and lecturers. They provided written consent to participate on the day of the activity and were informed that the data would be for research and publication use.

Participants were required to undergo two days and two levels of crafting activity. Next, participants were to watch a video tutorial about the recycling craft for a basic idea to accomplish level 1 recycling craft, and they were given a day to work on each craft freely and creatively. The next day, participants proceeded to level 2 with the same procedure as level 1 but with a higher difficulty recycling craft. Then, their crafts will be evaluated by art teachers and ranked on a leaderboard. The participants who were ranked on the leaderboard will receive certificates and prizes. After experiencing two-level EGL, 29 students were purposively selected as FGD participants. Participants with excellent achievement, commitment and attention to the activity were selected for the FGD. Figure 2 shows the overview of the EGL activity flow.

Braun and Clarke (2006) formulated a six-phase approach in the thematic analysis and was used in this qualitative analysis of the FGDs to identify, organise, describe, and report themes for trustworthiness. 22 In the first phase, to familiarise the data, the transcriptions were annotated and reviewed for a second times, then in the second phase, the coding stage, a coding assessment was done from the interview data to obtain the code's reliability. In third phase, the reviewed 37 codes were further sorted into 13 categories and generated into the themes based on repeated patterns and similarities in their nature. In the fourth phase, initial themes were further reviewed to check if they are making sense to the research, and the themes will be going for a final refinement in the fifth phase to gain insightful and accurate findings that match the research questions. Finally, in sixth phase, the findings from the analysis will be discussed and reported. 23 Each of the phases will be explained in the following sections.

Recordings were made of each of the five online FGD sessions. Each session lasted for 50-70 minutes, and could be listened to for a second time to identify recurring data patterns. Participants were given instructions beforehand and were informed several days before the FGD. The researcher was also given consent by each of the participants to conduct the FGD sessions.

In the first phase of the thematic analysis, the recorded sessions were transcribed from audio to text. Later, the transcripts were familiarised with annotation to the transcripts. Then, in second phase, the initial coding was done and compiled into a codebook for inter-rater reliability assessment.

Inter-rater reliability assessment

To obtain code consensus from the raters, the degree of agreement scores, 0 and 1, were measured by two raters. Both raters were trained to perform their task by identifying the target behaviour from the transcripts. 24 According to, 25,26 the value of 0.78 in Table 2 shows the kappa statistics of agreement that were analysed by the IBM Statistical Package for 

Twenty-nine students from the FGDs shared their insights, responses, opinions, and experiences online on how they acted towards the recycling issue in Malaysia, during the COVID-19 pandemic. For the third phase, four themes were obtained from the participants' responses from the 13 categories that were sorted from the 37 codes. The four themes are characterised as the independent variables or factors influencing the youths' recycling intention. They are as follows:

1) Engagement with the gamified recycling activity, 2) Intrinsic motivation,

Recycling intention is the dependent variable. All responses from the four themes were to answer RQ 1, explore the effectiveness of online gamified recycling activity that leads to recycling intention and verify the conceptual framework in Figure 1 .

In this section, each theme was listed and reviewed based on the participants' FGD responses as the fourth phase of the thematic analysis. Insights from the interviews were highlighted to create a progressive construct on the conceptual framework to explore the ideas and meaning from the participants. All the verbatim were directly quoted from their original meaning.

When the researcher asked about their engagement in gamified learning activities, two participants think that with gamification applied, they get engaged by the competition and do not want to stay behind the rank. Participant P said it is crucial not to fall behind and feel ashamed. Therefore, they tend to work harder: "Yeah I think it is very important if not I will also would like you know so like I actually put more effort." Participant R, too, was engaged because of their friend's ranking and they valued the interaction between peers: "Your friend has a higher ranking and … work a little bit harder to get a higher rank...".

Moreover, participant Temphasise the used of gamification in the activities have engaged him to work towards different challenges. He stated that "We use game to compare...then it will have missions to work on, then it has the leaderboard from it, and reward, all has it in the Edcraft. I think this fulfills the standard of gameful." Participant T had experienced video games and compared the fun of the gamified learning activity to a video game.

Participant K made a strong statement about the accomplishment of the EGL activity: "Yes, I feel it gives me the sense of accomplishment … I keep on doing...about 6-7 hours until I upload the video … I feel the sense of accomplishment...". Four participants felt the happiness from accomplishment more than obtaining the physical reward. Recognition has intrinsically motivated the students, and they appreciate what they have earned through hard work. "I think rewards are important … certificate they will be useful … I think you can put it in your resume." Additionally, enjoyment is part of the participants' emotions. They immersed themselves in the activity and felt a sense of pleasure. Participant O was triggered by the activity and enjoyed the process of making a craft out of unused recyclable items: "After participated the Edcraft … it taught me that bottle can turn into other things..."

Based on the responses, 8 participants stayed motivated to the end of the activity because they were promised a certification and prizes as rewards for completion. A reward is a form of extrinsic motivation as a temporary driver for them to recycle for participant J, and the external reward is a boost for the participant to achieve his dream as an artist. Therefore EGL, giving him a significant boost of motivation from the reward: "I am aiming for the certificate … the cert is very important..." Participant Q mentioned motivation from rewards: "I think after organising Edcraft, it will cultivate the awareness of recycling. Just like vase they need to create by themselves, need to spend money and expensive. If use plastic, it looks beautiful and quite practical as well.". This response shows that the participant appreciates their crafting and shaping their confidence to recycle.

Participants are competitive when they try their best to earn a reward within a challenging environment among a group of friends. 16 of the 29 youths from the FGDs have expressed their thought about the importance of social influence. Peers influenced each other to reach the same goal, and EGL has shown its social influence in competition: "I think it kind of affects in a positive way for youth … you will feel like want to do better than them." Some participants take competition, points and rankings seriously: "I have some friend, first round only got 11 points then second round same points as me 41 points … they are so serious, persist and not giving up."

They showed a solid feeling for overtaking their friends, and for them, the position in the rank is important for them not to stay behind. This situation has shown the youths' strong purpose to stay on par with their peers.

Participant A agreed that habit plays a role in recycling. "That is because they just do it all in habit … we do have like a monthly sort of activity in our community." This clearly demonstrates that Participant A has done recycling for some time and is committed to the activity due to habit. Likewise, Participant D shows the expression of habit, saying, "every year always got talk about environment and the 3R so that's how we all grew that habit of recycling …" There is a participant who believes that recycling is an activity that needs to be cultivated from an early age, following role models such as teachers, parents and friends. According to Participant F, "what motivates the young people to do recycling mostly comes from family. If your family practice then the children would probably just follows."

Two participants mentioned that they need to follow teachers' rules or get punished. Recycling has been an activity for the sake of rules or orders from elders: "teacher will punish the class which is not doing recycling … the person will receive punishment by sending to recycling center to wash recycling item." This statement clearly shows that they recycle not because of its advantages but to avoid getting punished. Participant K loved the idea of an online EGL recycling activity: "I think after organising Edcraft, it will cultivate the awareness of recycling … If use plastic, it looks beautiful and quite practical as well." By having EGL, recycling awareness awakened participants' thoughts about having fun recycling, and they have never thought that recycling items that many perceived as "trash" could be crafted into various practical and decorative items. In the beginning, recycling was a school activity, and punishment was imposed on them as enforcement, but after EGL, the purpose of recycling was clear, and they also learnt to repurpose recycling item instead of throwing it as trash.

Five topics from the FGD based on the codes and categories were finalised and defined the four themes, which is the fifth phase of the thematic analysis:

1) Gameful experience,

2) Intrinsic motivation,

3) Extrinsic motivation, and 4) Social influence.

The four main themes are the main factors influencing recycling intention to address RQ 2.

The responses show that participants were engaged with the activity. They felt the fun of the video game-like experience and were socially influenced by competition among their friends to get into the action of recycling and recycling intention.

The collected data and themes were used to verify, enrich and create the "flow", referring to the conceptual framework in Figure 1 and factors that influence recycling intention from RQ 1 to address RQ 2, as shown in Figure 3 . The following section will be on the sixth phase of the thematic analysis, where the implication and conclusion were discussed and reported from the above thematic analysis.

Young people are part of social change, and they bring an impact to the betterment of the environment through recycling activities. Incorporating gamified learning to improve recycling intention can be brought about through social influence and intrinsic and extrinsic motivations. The elements of games like leaderboard, levels, points and rewards are significant to develop an engaging and purposeful activity to attract the youth to participate in recycling. Based on the responses from the youths, the most prominent one is on social influences. From the FGDs, 16 out of 29 youths think that competition and leaderboard are highly affecting peers to work towards a goal. They are often feel challenged to perform their best to not lag far behind those with better achievements. This factor is believed to pose a significant role in encouraging recycling intention among youths. Besides, to further explore the relationship between gamification, motivation and recycling intention. The quantitative research method is also a reliable way to investigate the effectiveness of gamification in recycling behaviour, as shown in Table 1 . Therefore, this leads to a higher potential for future studies on quantitative methods.

This study serves as a starting point for researchers to explore the elements influencing youths' intention and behavioural change. The method used in this study is FGDs. This research used inter-rater reliability on the coding agreement and the six phases of thematic analysis to reduce ambiguities and develop quality themes and frameworks that lead to wellgrounded gamified online recycling learning. However, recycling activity requires commitment, and the two-day, twolevel activity represented a short time for attitude development. It is hoped that with the incorporation of gamified online learning, the impact of social influence on pro-environmental awareness and recycling, similar to the achievements of Greta Thunberg and KAMY, can spread to more young people around the world. Cultivation of recycling behaviour requires a longer-term gamified activity to effectively close the gap between fun learning and recycling intention. This project contains the following underlying data:

• Data file 1. (Cohen kappa reliability output in.spv format)

• Data file 2 to 6. (Focus Group Discussion Transcription in pdf.)

• Data file 7 to 10 (interrater reliability in.doc, .dat, .sav, and.sps format)

• Data file 11 (invitation letter for interrater)

Data are available under the terms of the Creative Commons Zero "No rights reserved" data waiver (CC0 1.0 Public domain dedication).

Ethical approval (EA) number from Multimedia University (approved by secretariat of Research Ethics Committee): EA2642021.

Faculty of Psychology, Universtias Negeri Jakarta, Jakarta Selatan, Indonesia I appreciate the authors for bringing a very interesting yet important research theme into the table. The paper presented an insightful message about the potential uses of gamified based intervention to enhance youth recycling intention. However, there are number of concerns about the way in which the paper is presented. The following suggestions are intended to assist the authors in improving the quality of their paper. The introduction need to be refined, there are numbers of unclear and inefficient sentences:

1) "Most countries have long ago adopted recycling to preserve the environment's health." This sentence is ambiguous, what do the authors mean by the environment's health? This sentences also need for further grammar check.

2) The sentence in paragraph 2 "A study conducted in 2017 and 2018 shows a negative attitude towards recycling in many countries, claiming that recycling education and infrastructure are insufficient". The authors indicated "A study" but the citation refers to two different studies. This sentence also not clear, what do the authors mean by "a negative attitude?" please clarifiy.

1. Table 1 . needs to be clarified. It may an idea to add study type, findings, and recommendations column for cited papers.

I also notice that some papers included in Table 1 . did not clearly state the effectiveness of gamified method as a potential way to enhance people's recycling intention. e.g. Study by Betaubun & Nasrawati (2020) , which according to the author, can be used as a reference to show the use of gamified approach for enhance recycling intention, was as a cross-sectional study. To provide strong evidences for the potential used of gamification method to enhance recycling intention, I suggest the authors to cite an experiment based publications.

As this is a qualitative study, a research question addressing the effectiveness of the program might be problematic. Objective indicators and systematic measures should be applied to answer if the program is really effective. Rather than testing the effectiveness, this study may focus on describing subject's subjective experiences using the program, and how their experiences benefit for developing the program. Further, the author may describe in more detail about the game itself. Why and how the game is delivered, e.g., duration, elements, self-guided or full-guided, online/offline, and system requirements of the program.

Braun & Clarke (2006) thematic analysis comprises series of steps when analyzing the qualitative transcriptions. The steps including how the authors develop low-order and high order themes. Please consider to explain the analysis steps in more detail.

The authors may need to explain in a bit more detail about the conceptual model ( figure 2) . How did the authors come up with this model? What thematic analysis results lead to this model?

Suggestion to test the model using quantitative method should be added. 7. removed the study by Betaubun & Nasrawati (2020) and replaced it with a new empirical article "Advocating recycling and encouraging environmentally friendly habits through gamification: An empirical investigation" which provides stronger evidences for the effectiveness of gamification in recycling intention. 4) I have enriched the conclusion and discussion part to show how the EGL effectively improves youths' motivation to recycle. Social influence is emphasised in several sections of the paper. 5) 6 phases of thematic analysis have been added in 3.1 and leading each of the steps in the following sections to provide a clearer reading for the readers. 6) Additional explanation and improvement on the conceptual framework part. 7) Suggestions for future quantitative study have been added.

No competing interests were disclosed.

The benefits of publishing with F1000Research:

Your article is published within days, with no editorial bias • You can publish traditional articles, null/negative results, case reports, data notes and more • The peer review process is transparent and collaborative • Your article is indexed in PubMed after passing peer review • Dedicated customer support at every stage • For pre-submission enquiries, contact research@f1000.com

Sedimentation in geologic history: Recycling vs. evolution or recycling with evolution

COVID-19 and waste production in households: A trend analysis

Assessing the knowledge, attitude and practice of the kermanshahi women towards reducing, recycling and reusing of municipal solid waste

Barriers to effective municipal solid waste management in a rapidly urbanising area in Thailand

PubMed Abstract|Publisher Full Text|Free Full Text

Why Don't People Recycle-A Comparative Study Between The United States of America and India

Youth-led social change: Topics, engagement types, organisational types, strategies, and impacts

In:Education for Sustainable Development and Disaster Risk Reduction

Environmental activism goes digital in lockdownbut could it change the movement for good

Who is she and what does she want

Inspiring Stories from Malaysian Youth Leaders. 2020. (accessed 4th

Can an online educational game contribute to developing information literate citizens?

Relationships between severity of internet gaming disorder, severity of problematic social media use, sleep quality and psychological distress

PubMed Abstract|Publisher Full Text|Free Full Text

The psychological impact of quarantine and how to reduce it: rapid review of the evidence

PubMed Abstract|Publisher Full Text|Free Full Text

Determinants of residents' e-waste recycling behaviour intentions: Evidence from China

Barriers to household waste recycling: Empirical evidence from South

Influence of recycling programmes on waste separation behaviour

PubMed Abstract|Publisher Full Text

OPractical Action Nepal: A case study on successful municipal solid waste management in industrialised countries by the example of karlsruhe city, germany

Make Waste Fun Again! A Gamification Approach to Recycling. Conf. Int. Conf. ArtsIT, Interactivity Game Creat

How to Encourage Recycling Behaviour? The Case of WasteApp: A Gamified Mobile Application

Advocating recycling and encouraging environmentally friendly habits through gamification: An empirical investigation

Incentives for Plastic Recycling: How to Engage Citizens in Active Collection

Black-out test versus UV camera for corona inspection of HV motor stator endwindings

Using thematic analysis in psychology

Popping R: Introduction to Interrater Agreement for Nominal Data

The Measurement of Observer Agreement for Categorical Data

PubMed Abstract|Publisher Full Text

DSM-5 field trials in the United States and Canada, part II: Test-retest reliability of selected categorical diagnoses

Online Gamified Learning: Focus Group Discussion Data set

English for Specific Purpose: Revitalizing Climate Change Awareness Using Digital Literacy and Gamification for Engineering Faculty in Papua

Using thematic analysis in psychology

Is the work clearly and accurately presented and does it cite the current literature? Partly Is the study design appropriate and is the work technically sound? Partly Are sufficient details of methods and analysis provided to allow replication by others?

In general, the paper sounds like an empirical study, but the process does not sound technically sufficiently. Please consider the following to improve the paper:The introduction can be better addressed by discussing the domain of study first, followed with the context of the study. The aim of the study should be stated in the section as well.1.The literature review should also focus on the domain of study, showing the gap (that the study taps into).

The methods are too general and lack justification. Some parts need strong justifications, like sampling.

The results and discussion are too brief. Perhaps, you can focus on one factor and discuss more deeply.

Implications should compare the findings in this paper with those previously found by others.

If applicable, is the statistical analysis and its interpretation appropriate? 1.Literature has been enriched with gamified learning and recycling.

Methods has been strengthened with a clearer explanation of the EGL activity and a new Figure 2 to show the flow of the data collection activity.

Results and discussion has improved accordingly and social influence has been addressed, deeper meaning based on the results.

Implications have shown that the research from table 1 can be a potential reference for future expansion of the study for quantitative research. The four themes have been further discussed in the conclusion and implication section. Reviewer Expertise: Thematic analysis study, Well-being, Online mental health services, well-being, social psychology I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

Author Response 07 Dec 2021 kinmeng cheng, Multimedia University, Cyberjaya, Selangor, Malaysia Thank you so much for the review. I have made the changes accordingly based on the comments. 1) Unclear statements regarding to environment's health and sentence coherency have been changed and clarified.