key: cord-0789949-zf7aucvg authors: Lima, Andrea Márcia da Cunha; Meira, Ingrid Andrade; Soares, Maria Sueli Marques; Bonan, Paulo Rogério Ferreti; Mélo, Cláudia Batista; Piagge, Carmem Silvia Laureano Dalle title: Delay in diagnosis of oral cancer: a systematic review date: 2021-10-27 journal: Med Oral Patol Oral Cir Bucal DOI: 10.4317/medoral.24808 sha: cb89bcb4dc3001d26f3bd97dca34ea1765af56ef doc_id: 789949 cord_uid: zf7aucvg BACKGROUND: Oral cancer represents a worldwide public health problem, being among the most prevalent, associated with high morbidity and mortality rates. This systematic review aimed to review the causes of the delayed diagnosis of oral cancer mainly in the elderly, in developed and developing countries. MATERIAL AND METHODS: Search strategy was developed for MEDLINE databases (via PubMed), EMBASE, Web of Science, SCOPUS, and LILACS and for grey literature (Google Scholar, ProQuest and OpenGrey), without language or period restrictions. The risk of bias was assessed using instruments from the Joanna Briggs Institute and the quality of evidence according to the GRADE system. RESULTS: The search resulted in 14,473 records, of which only 13 met the eligibility criteria. The total sample was 1,705 participants, with a predominance of males. All studies included reported causes of delayed diagnosis of oral cancer related to the patient and five also reported causes related to health professionals. The scarce knowledge of the population was pointed out as the main cause of delayed diagnosis of this cancer. Regarding the risk of bias, ten studies were classified as low risk and three, as moderate risk. The quality of the evidence was very low for the outcome related to delayed diagnosis of oral cancer. CONCLUSIONS: Wide dissemination of information on oral cancer is needed, especially for the elderly, such as its initial signs and symptoms, in developed and developing countries. Further studies should be conducted to better understand the causes of delayed diagnosis of oral cancer in countries with different socioeconomic statuses. Key words:Delayed diagnosis, mouth neoplasms, oral neoplasm, aged. Oral cancer is among the ten most prevalent types of cancer in the world, associated with high mortality and morbidity rates, representing a worldwide public health problem. This cancer is more frequent in men aged over 40 years and has multifactorial etiology, resulting from the interaction of several risk factors, being the main ones smoking and excessive consumption of alcoholic beverages (1) . In the elderly population, the number of cases of oral cancer has grown considerably, due, in part, to the increase in longevity of this population (2) . In the next 20 years, the global estimate is an increase of 66.2% in the number of new cases of oral cancer for the elderly population (3) . In developed countries, such as the United States of America, France, the United Kingdom, Japan, Italy, and Australia, an increase of 24.9% to 50.5% is estimated for the period 2020 through 2040. In developing countries (China, India, and Brazil), considering this same period, an even greater increase in new cases is projected, ranging from 80.1% to 97.8% (3) . These projections show the importance of knowing the characteristics of oral cancer, enabling the promotion of preventive actions and early diagnosis (4) . These actions avoid injuries, minimize complications resulting from treatment with higher chances of cure and provide a higher survival rate to patients (3) . However, in most cases, oral cancer is at an advanced stage at the time of diagnosis and, despite technological advances, its treatment is still a great challenge, with survival rates without a significant increase in recent decades, remaining between 50-55 over a five-year period (5) . The stages of tumors are classified according to the Classification System of Malignant Tumors (TNM) recommended by the International Union for Cancer Control (UCC). They receive graduations based on the anatomical extension of the disease, usually from T0 to T4, from N0 to N3, and from M0 to M1. The first one (T), respectively, consider the characteristics of the primary tumor, the second (N) the characteristics of the lymph nodes of the lymphatic drainage chains of the organ in which the tumor is located, and the M the presence or absence of distant metastases. T3 or T4 classifications represent advanced stages of cancer (6) , which are frequently found at the time of oral cancer diagnosis (5) . Given the above, this study aimed to review the causes of delayed diagnosis of oral cancer, especially in the elderly, in developed and developing countries. -Protocol and register This review was reported according to the items of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) (7) . A study protocol was developed based on PRISMA-P (8) and registered in PROS-PERO (9) , under registration number CRD42020214639. -Eligibility criteria The acronym PECOS (Population, Exposure, Comparison, Outcome, Study design) was used to formulate the research question of this systematic review, the population was defined as the elderly, the exposure as oral cancer, the primary outcome as causes of delay, and the study design as observational ones. Therefore, the following question was established: "Is there a difference in the causes of the delayed diagnosis of oral cancer mainly in the elderly in developed and developing countries?" The inclusion criteria consisted of observational studies, without language or period restriction, which evaluated the diagnosis of oral cancer in the elderly. The following exclusion criteria were applied: 1) studies that did not include participants aged 60 years or older; 2) studies that did not evaluate the causes of late diagnosis; 3) studies that did not report data related to the causes of late diagnosis only for oral cancer; 4) studies that performed evaluations only to the treatment of oral cancer. Furthermore, experimental studies, reviews, letters, abstracts, opinion articles, case reports, case series, and book chapters were excluded. This review was conducted to verify the causes of the delayed diagnosis, especially in the elderly, due to the high incidence of oral cancer in this population and the frequent presence of unfavorable systemic conditions, which hinder the diagnosis, treatment and cure of this disease (2) . Given this and the lack of primary studies only with the elderly, this review comprised only those studies that also included elderly participants. The age group characterized for the elderly was over 60 years, because it is still adopted by some developing countries, such as Brazil (10) . Finally, the criteria proposed by the United Nations Development Programme (UNDP) of the United Nations (UN) was adopted to classify developed and developing countries. These criteria are based on the degree of wealth, level of industrialization and development, Gross Domestic Product (GDP), per capita income, and the Human Development Index (HDI), which represents a comparative measure of countries regarding wealth, literacy, education, life expectancy and birth expectancy (11) . -Search strategy The literature search was conducted by two independent researchers [AMCL and CSLDP], at MEDLINE databases (via PubMed), EMBASE, Web of Science, SCO-PUS and LILACS, and in the gray literature (Google Scholar, ProQuest, and OpenGrey). With the collaboration of a librarian, a search strategy was set up for PubMed and adapted to the other databases. The strategy adopted sought to rescue as many studies as possible related to the subject. For this, the descriptors indexed in the Health Science Descriptors (DeCS) and in the Medical Subject Headings (Mesh Terms) were used, with the Boolean operators AND and OR, as described in Table 1 . TITLE-ABS-KEY("Delayed Diagnosis" OR "Delayed Diagnoses" OR "Late Diagnosis" OR "Late Diagnoses" OR Diagnosis OR Diagnoses OR Examinations OR Examination) AND TITLE-ABS-KEY("Mouth Neoplasm" OR "Oral Neoplasm" OR "Oral Neoplasms" OR "Cancer of Mouth" OR "Mouth Cancers" OR "Oral Cancer" OR "Oral Cancers" OR "Cancer of the Mouth" OR "Mouth Cancer") AND TITLE-ABS-KEY(Aged OR Elderly OR Elders OR Elder OR "Older adults" OR "Older person" OR "Oldest Old" OR Nonagenarians OR Nonagenarian OR Octogenarians OR Octogenarian OR Centenarians OR Centenarian OR Adult OR Adults OR "Middle Aged" OR "Middle Age") Web of Science (n= 1.052) TS=("Delayed Diagnosis" OR "Delayed Diagnoses" OR "Late Diagnosis" OR "Late Diagnoses" OR Diagnosis OR Diagnoses OR Examinations OR Examination) AND TS=("Mouth Neoplasm" OR "Oral Neoplasm" OR "Oral Neoplasms" OR "Cancer of Mouth" OR "Mouth Cancers" OR "Oral Cancer" OR "Oral Cancers" OR "Cancer of the Mouth" OR "Mouth Cancer") AND TS=(Aged OR Elderly OR Elders OR Elder OR "Older adults" OR "Older person" OR "Oldest Old" OR Nonagenarians OR Nonagenarian OR Octogenarians OR Octogenarian OR Centenarians OR Centenarian OR Adult OR Adults OR "Middle Aged" OR "Middle Age") LILACS (n= 358) ("Delayed Diagnosis" OR "Delayed Diagnoses" OR "Late Diagnosis" OR "Late Diagnoses" OR diagnosis OR diagnoses OR examinations OR examination OR "Diagnóstico Tardio" OR "Atraso de Diagnóstico" OR "Diagnóstico Atrasado" OR "Retardo no Diagnóstico" OR diagnóstico OR "Diagnóstico Retrasado" OR diagnose) AND ("Mouth Neoplasm" OR "Oral Neoplasm" OR "Oral Neoplasms" OR "Cancer of Mouth" OR "Mouth Cancers" OR "Oral Cancer" OR "Oral Cancers" OR "Cancer of the Mouth" OR "Mouth Cancer" OR "Neoplasias Bucais" OR "Neoplasia Bucal" OR "Neoplasia Oral" OR "Neoplasias Orais" OR "Neoplasia da Boca" OR "Neoplasia da Cavidade Bucal" OR "Neoplasia da Cavidade Oral" OR "Neoplasia de Boca" OR "Neoplasia de Cavidade Bucal" OR "Neoplasia de Cavidade Oral" OR "Neoplasias da Boca" OR "Neoplasias da Cavidade Bucal" OR "Neoplasias da Cavidade Oral" OR "Neoplasias de Boca" OR "Neoplasias de Cavidade Bucal" OR "Neoplasias de Cavidade Oral" OR "Cancer Bucal" OR "Cancer Oral" OR "Câncer da Boca" OR "Câncer da Cavidade Bucal" OR "Câncer da Cavidade Oral" OR "Câncer de Boca" OR "Câncer de Cavidade Bucal" OR "Câncer de Cavidade Oral" OR "Tumor Bucal" OR "Tumor Oral" OR "Tumor da Boca" OR "Tumor da Cavidade Bucal" OR "Tumor da Cavidade Oral" OR "Tumor de Boca" OR "Tumor de Cavidade Bucal" OR "Tumor de Cavidade Oral" OR "Tumores Bucais" OR "Tumores Orais" OR "Tumores da Boca" OR "Tumores da Cavidade Bucal" OR "Tumores da Cavidade Oral" OR "Tumores de Boca" OR "Tumores de Cavidade Bucal" OR "Tumores de Cavidade Oral" OR "Neoplasias de la Boca" OR "Neoplasia de Boca" OR "Neoplasia de Cavidad Bucal" OR "Neoplasia de Cavidad Oral" OR "Neoplasia de la Boca" OR "Neoplasia de la Cavidad Bucal" OR "Neoplasia de la Cavidad Oral" OR "Neoplasias Bucales" OR "Neoplasias Orales" OR "Neoplasias de Boca" OR "Neoplasias de Cavidad Bucal" OR "Neoplasias de Cavidad Oral" OR "Neoplasias de la Cavidad Bucal" AND (aged OR elderly OR elders OR elder OR "Older adults" OR "Older person" OR "Oldest Old" OR nonagenarians OR nonagenarian OR octogenarians OR octogenarian OR centenarians OR centenarian OR adult OR adults OR "Middle Aged" OR "Middle Age" OR idoso OR idosos OR "Pessoa Idosa" OR "Pessoa de Idade" OR "Pessoas Idosas" OR "Pessoas de Idade" OR "População Idosa" OR centenarios OR nonagenarios OR octogenarios AND ( db:("LILACS")) OpenGrey (n= 36) "Oral cancer" ProQuest (n= 07) noft("Delayed Diagnosis" OR "Delayed Diagnoses" OR "Late Diagnosis" OR "Late Diagnoses" OR Diagnosis OR Diagnoses OR Examinations OR Examination) AND noft("Mouth Neoplasm" OR "Oral Neoplasm" OR "Oral Neoplasms" OR "Cancer of Mouth" OR "Mouth Cancers" OR "Oral Cancer" OR "Oral Cancers" OR "Cancer of the Mouth" OR "Mouth Cancer") AND noft(Aged OR Elderly OR Elders OR Elder OR "Older adults" OR "Older person" OR "Oldest Old" OR Nonagenarians OR Nonagenarian OR Octogenarians OR Octogenarian OR Centenarians OR Centenarian OR Adult OR Adults OR "Middle Aged" OR "Middle Age") Google Scholar (n= 100) ("Delayed Diagnosis" OR "Delayed Diagnoses" OR Diagnosis OR Diagnoses) AND ("Mouth Neoplasm" OR "Oral Neoplasm" OR "Oral Cancer") AND (Aged OR Elderly OR Adult OR Adults) -Assessment of methodological quality The methodological quality was evaluated using checklists for analytical cross-sectional and qualitative studies from Joanna Briggs Institute (13, 14) . Independently, two reviewers [AMCL and PRFB] performed the risk assessment of bias and, for this trial, the following classification was used: "high risk" when the study reached up to 49% of "yes", "moderate risk" scores when the study reached 50% -69% of "yes" score and "low risk" when the study reached over 70% of "yes" score (15) . After the two reviewers checking the trial, the disagreements were discussed and a third reviewer decided [IAM] . Information on bias risk assessment was generated by RevMan 5.4 software (Review Manager 5.4, The Cochrane Collaboration). The evaluation of methodological heterogeneity among the eligible studies was evaluated regarding the study design, the sample (age, confirmed diagnosis of oral cancer), quality of measurements and results. Finally, the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach was used to classify the quality of evidence for the outcome related to the delayed diagnosis of oral cancer, according to the following criteria: risk of bias, inconsistency, indirect evidence, inaccuracy or publication bias. Based on the GRADE criteria, for each serious concern, a level of evidence was lowered and non-randomized clinical studies started with a low classification (16) . Initially, 13,708 records were identified from the electronic databases and gray literature. After excluding duplicates, 9,284 were analyzed with the reading of titles and abstracts, and 71 articles were selected for full reading. After that, 59 articles were excluded because they did not meet the eligibility criteria, resulting in 12 articles included. A search update was carried out in May 2021, where 764 records were identified. After excluding duplicates, 626 studies were analyzed with the reading of titles and abstracts, selecting 01 article for full reading, which was included, resulting in 13 articles included in this review (Fig. 1) . All studies reported causes of delayed diagnosis of oral cancer related to the patient and 5 also reported causes of delayed diagnosis related to health professionals. Among the causes of delay related to the patient, the lack of knowledge about oral cancer, its risk factors and the signs and symptoms of the disease were reported in all studies. These aspects are due to the difficulty of visualization and identification of the initial lesions, neglect of the signs and initial symptoms due to absence of pain, without impairment of function, leading the participants to consider the symptoms as normal and something secondary. Hope for spontaneous cure, self-medication, fear of diagnosis and coping with the disease, financial restrictions and difficulty in accessing specialized professionals were also reported (6,17-28). The causes of delay related to professionals were reported in only five studies, four of them conducted in developing countries (17) (18) (19) (20) and one in developed country (21) . The studies indicated that these causes were related to the difficulty of recognizing the initial lesions and early treatment, leading to incorrect diagnoses, which suggests unawareness of oral cancer among health professionals. The delayed referral of the patient to the specialized service and, consequently, delayed biopsy test were also reported causes. -Characteristics of the studies Of the included studies, 13 were observational, four retrospective and two qualitative, published between 1994 and 2020 ( Table 2) . Of these studies, four were conducted in developed countries (one in Australia, one in Japan, one in Italy, and one in the United Kingdom) and nine in developing countries (two in Brazil, two in China, one in Poland, one in Malaysia, two in Pakistan and one in Thailand). The sample included 1,705 participants aged between 15 and 96 years, in eight studies most participants were aged 60 years and in five studies, this age group was also included, although it did not represent the majority of its participants. There was a higher prevalence of males in the samples of the included studies. In three studies, there was sample loss, 32 participants, four for withdrawal and 28 for incomplete information. The form of data collection that prevailed was the interview through semi-structured questionnaires (eight studies). Clinical records were used by two studies, and other three applied structured questionnaires. Questionnaire/0 52% the patients unaware of disease processes 24% lack of availability of medical or dental staff 14% visited to non-medical professional persons -Methodological quality Most of the included studies presented a low risk of bias in their evaluation. Of the 11 observational studies, eight presented low risk of bias and three moderate risk (Fig. 2) . For these last studies, statistical analysis was the main problem, which was not clearly reported. As for qualitative studies, all of them at a low risk of bias (Fig. 3) . Regarding methodological heterogeneity, a great diversity was noted regarding the sample, the form of data collection, and analysis of the results, preventing the quantitative synthesis. Finally, the quality of evidence of the outcome related to the delayed diagnosis of oral cancer was very low ( The results of this systematic review indicate that the population's lack of knowledge about the signs and symptoms of oral cancer and the devaluation of selfcare are extremely related to the delayed diagnosis of this cancer. The sample studies performed their analyzes considering the elderly population along with other age groups, with no reporting of categorizations. A higher prevalence of participants aged ≥ 60 years was identified in the sample, resulting in the hypothesis of greater delay in the diagnosis of oral cancer in this population. Regarding gender in the incidence of oral cancer, the prevalence of males in the sample corroborates other primary studies not included in this review and data from the World Health Organization (6, 29) . This differs from several studies in the dental field, in which a higher prevalence of females is observed (30) . The studies conducted in developed and developing countries included in this review identified the difficulty of visualization and/or identification of oral lesions and the absence of symptoms of the initial lesions as the main cause in the delayed diagnosis of oral cancer related to the patient (6, (17) (18) (19) (20) (21) (22) (23) (24) (25) (26) (27) (28) . This may be due to the population's little knowledge on oral cancer, its risk factors, and its specific characteristics, leading them to neglect the initial signs and symptoms and, consequently, delay in the search for specialized care. This fact corroborates another study (31) that concluded that the population, even knowing the existence of oral cancer, does not have enough information for the correct diagnosis and prevention of the disease. In developing countries, fear of diagnosis and negative coping with the disease were also reported as causes of patient delay, probably related to the negative belief of the population that a cancer diagnosis is a death sentence (6, 18, 24) . Still in smaller proportions, hope for spontaneous healing of lesions and self-medication were related to the patient's delayed search for specialized care in developed and developing countries (18, 21, (22) (23) (24) (25) . These facts may be associated with difficulties in accessing health services and economic restrictions, which have also been reported as causes of patient delay, not only in studies conducted in developing countries, but also a study included in this review, conducted by Scott et al. [2006] (25) in the United Kingdom (6, 18, 24) . In developed countries, the population has greater access to health services when compared to developing countries, which does not always happen when it comes to a specialized service. As reported in the study by Ligier et al. [2016] (32) , which concluded that, although the population has universal health coverage, access to specialized care is still restricted to the most economically privileged. As described by those authors (32) , the population that presented some type of head and neck cancer rarely attended the dentist, suggesting that the lack of access to dental care is due to financial restrictions. Therefore, socioeconomic conditions may also be associated with the causes of the delayed diagnosis of oral cancer in developed and developing countries. Although it has not been reported in the studies included in this review, some authors associate the presence of comorbidities with the delay in the diagnosis of oral cancer. This suggests that patients already debilitated, due to the presence of other diseases, especially those dependent or bedridden, ignore or deny new oral symptoms (33) . The importance of disseminating knowledge about oral cancer to those who provide care services to these patients is emphasized. With the severity of the pandemic, anxiety and the population's fear of becoming infected with COVID-19 has led patients to underestimate the signs and symptoms of other serious diseases, which may lead to delays in the diagnosis of oral cancer (34) . Thus, the importance of social media and teledentistry for oral diagnosis during the pandemic period is highlighted, especially in lesions with suspected malignancy (35) . Among the included studies that evaluated the causes of the delayed diagnosis of oral cancer related to professionals in developing countries, the difficulty in recognizing oral cancer lesions early, incorrect diagnosis, and wrong treatments were prevalent. These causes were also reported in the study by Onizawa et al. [2003] (21), performed in Japan, in which small tumors and ulcerative lesions were diagnosed as benign lesions, signaling professionals' deficiency of knowledge about oral cancer in both developed and developing countries. Finally, these factors were associated with the delay in the patient's referral by the doctor or dentist and the performance of the biopsy (6, (17) (18) (19) (20) . The early diagnosis of oral cancer contributes to the implementation of appropriate treatment in early stages of disease evolution, with less invasive surgeries, faster convalescence and better patient survival (20) . On the other hand, the delayed diagnosis increases the care costs of treatment with outpatient or prolonged hospital stay, with main consequences for the most economically disadvantaged (17) . The methodological quality analysis showed that most studies presented a low risk of bias. However, there was a high methodological heterogeneity among the included studies, related to the use of several instruments to analyze the delayed diagnosis and the inclusion of a wide age group, which hindered summarizing and comparing the results, limiting this review. Some studies did not present the clinical staging of tumors through the TNM System, information relevant to the classification of late diagnosis of oral cancer. Moreover, the possible loss of information in retrospective studies and the lack of studies conducted simultaneously in developed and developing countries, adopting the same methodology, hindering comparing more accurately and analyzing the results carefully. The low level of awareness and knowledge about oral cancer by the population and health professionals shows the need for actions aimed at health education with an emphasis on prevention and early diagnosis of oral cancer, to reduce the high mortality and morbidity rates and, consequently, improve the survival of the population, especially the elderly. The causes of oral cancer delayed diagnosis in countries with different socioeconomic statuses need further clarification. Despite the lack of methodological standardization, the causes of delayed oral cancer diagnosis were related to the scarce knowledge of patients and health professionals in developed and developing countries. A proposal for a future study is to investigate, in addition to the causes that hinder early diagnosis in the elderly, the reasons for abandonment and/or non-oral cancer treatment. Cancer incidence and mortality worldwide: sources, methods and major patterns in GLOBOCAN 2012 Analysis of cancer perception by elderly people. Einstein (Sao Paulo) Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries Oral cancer knowledge, risk factors and characteristics of subjects in a large oral cancer screening program Uma avaliação do câncer oral e programas de rastreamento de pré-câncer na Europa: uma revisão sistemática Characterization of oral cancer diagnostic delay in the state of Alagoas Updating guidance for reporting systematic reviews: development of the PRISMA 2020 statement Preferred reporting items for systematic review and metaanalysis protocols (PRISMA-P) 2015 statement An international registry of systematic-review protocols Physical frailty and gait speed in community elderly: a systematic review Índice de Desenvolvimento Humano e prevenção secundária de câncer de mama e colo do útero: um estudo ecológico [Human Development Index and secondary prevention of breast and cervical cancer: an ecological study Rayyana web and mobile app for systematic reviews Methodological guidance for systematic reviews of observational epidemiological studies reporting prevalence and cumulative incidence data Qualitative research synthesis: methodological guidance for systematic reviewers utilizing metaaggregation Association between sleep bruxism and anxiety symptoms in adults: A systematic review Grading quality of evidence and strength of recommendations in clinical practice guidelines. Part 1 of 3. An overview of the GRADE approach and grading quality of evidence about interventions Lateness of diagnosis of oral and oropharyngeal carcinoma: factors related to the tumour, the patient and health professionals Factors involved in the diagnosis of oral squamous cell carcinoma in Malaysia Factors related to delay in diagnosis of oral squamous cell carcinoma Oral cancer: The first symptoms and reasons for delaying correct diagnosis and appropriate treatment Yoshida H. Factors associated with diagnostic delay of oral squamous cell carcinoma Factors related to diagnostic delay of oral squamous cell carcinoma in southern Thailand: Revisited Health seeking behaviour, delayed presentation and its impact among oral cancer patients in Pakistan: a retrospective qualitative study Factors associated with delay in presentation among patients for oral cancer Patient delay in oral cancer: a qualitative study of patients' experiences Diagnostic delay in oral squamous cell carcinoma: the role of cognitive and psychological variables Patient perspectives of diagnostic delay for suspicious oral mucosal lesions Reasons for Delayed Presentation in Patients of Oral Squamous Cell Carcinoma: A Prospective Study Oral cancer: population sample of the state of Alagoas at a reference hospital Factors associated with need for dental treatment: a cross-sectional study at Fluminense Federal University A Snapshot of Knowledge about Oral Cancer in Italy: A 505 Person Survey Profissionais de saúde e a detecção precoce do câncer de cabeça e pescoço: um estudo de base populacional em uma área de alta incidência Diagnosis and management of head and neck cancers in a high-incidence area in France: A population-based study Covid-19 pandemic: A new contributing factor to diagnostic and treatment delay in oral cancer patients Social media and telemedicine for oral diagnosis and counselling in the COVID-19 era None declared. All authors contributed from the conception or design of this systematic review, acquisition, analysis and interpretation of data. In addition, A.M.C.L wrote the first draft and all other authors participated in the critical review of this article, approving the final version to be published. Everyone has equal public responsibility for the content presented.