Standard nursing treatment on adolescents with early prodromal psychosis: a quasi-experimental study

 

Agustina Rahayu1, Budi Anna Keliat1, Mustikasari1, Erna Erawati1

1 University of Indonesia

 

 

ABSTRACT

Aim: to determine the effect of standard nursing treatment on anxiety and self-esteem among adolescents living in orphanages with early prodromal psychosis. Method: this is a quasi-experimental pre and post-test, without a control group, that was conducted with 77 adolescents, selected by the intentional sampling technique. Data were analyzed using the t-test. Result: after the standard nursing treatment was received, the adolescents showed a significant decrease in the symptoms of early prodromal psychosis (from 9.16 to 7.13) and an anxiety score (from 17.03 to 13.70) and a significant increase in self esteem (from 45.97% to 63.77%) with p-value <0.05. Conclusion: the standard nursing treatment is recommended for adolescents with early prodromal psychosis in the orphanage who have anxiety and low self-esteem.

Descriptors: Adolescent; Psychotic Disorders; Anxiety; Self Concept; Nursing Care.

 

 

INTRODUCTION

Data from the American Psychiatric Association (APA) shows, that each year, 100,000 American teenagers and young adults experience the first-episode of psychosis (FEP)(1), suggesting that the risk ratio of mental disorders is very high in the world. Thus, early prevention and treatment are necessary to overcome the worst conditions.

The prevalence of mental health disorders in Southeast Asia is lower than in other countries(2). According to the results of the Indonesia Basic Health Research, carried out in 2013, the prevalence of emotional mental disorder in adolescence and young adulthood, aged 15-24 reaches 5.6% in national level. Based on the data obtained, it can be concluded that, in the world and in Indonesia, no data concerns the prevalence of early prodromal psychosis in adolescents. However, most clients who arrive at health services have experienced psychosis and schizophrenia.  

Adolescents undergo biological, psychological and social changes that require them to adapt, as they encounter many challenges and conflicts, looking for self-identity, and enjoy fantasizing because they have excessive fantasy power(3). The simultaneous existence of demands means that some adolescents fail to adapt well, especially unstable adolescents, easily stressed, depressed, helpless and experiencing emotional changes. Adolescents who are unable to adjust to stressors (stress causes) may find changes in functioning in their life, manifesting early prodromal psychosis symptoms such as sleep disorders, behavioral changes, poor affect, appetite impairment, unrealistic thoughts, difficulty to understand conversations, as well as the changes in their appearance. The early stage of prodromal psychosis, however, is still quite difficult to treat due to the lack of public knowledge on the early detection and the existence of non-specific symptoms of the condition.

The stage of early prodromal psychosis may progress to early psychotic phases, marked by the onset of psychotic symptoms. The onset of this phase often occurs in adolescents and young adults, in this case, in the 15-25 year-old range. Therefore, early intervention is recommended at an early stage to prevent the progression of psychotic disorder. About this, studies found a correlation between anxiety and attenuated symptoms of psychosis in adolescents at high clinical risk(4) and low self-esteem(5). These clinical criteria for attenuated psychosis can be used to identify adolescents who are at elevated risk of progression to a psychotic illness.

Research results show that children and adolescents at orphanage are at higher risk for low self-esteem compared to children and adolescents living with both parents(6). This case shows the importance of early detection of the stage of early prodromal psychosis before the disease evolves into the psychotic phase. Many studies were carried out with adolescents; however, none of them underwent screening in the stage of early prodromal psychosis. Thus, it can be inferred that there is no research related to adolescents from orphanages that are in the phase of prodromal early psychosis in Indonesia. This research was carried out specifically in orphanages that have adolescents with different characteristics, with the aim to determine the effect of the standard nursing treatment on the anxiety and self-esteem of adolescents from orphanages with early prodromal psychosis.

 

 

METHODS

This is a quasi-experimental study using quantitative statistical methods, carried out from March to June 2017. The number of adolescents who have early prodromal psychosis in orphanages was investigated using the PQ-16 instrument (Prodromal Question-16), for which the inclusion criteria were applied. The PQ-16 includes 16 self-reported true/false items that screen for the risk of psychosis. Nine items assess perceptual abnormalities and hallucinations, five items assess unusual thought content, delusional ideas and paranoia, and two items assess negative symptoms. Respondents that endorse six symptom items or more are considered to be at risk for psychosis(7).

Quantitative research followed the quasi-experimental pre and post-test without a control group, measuring the self-esteem of adolescents who experienced early prodromal psychosis, using Rosenberg Self-Esteem Scale (RSES) instrument(8). The RSES had ten items with four-point Likert scale ranging from 0 (strongly disagree) to 3 (strongly agree). In this study, the total score for this scale ranged from 15 to 25, and a score less than 15 indicated a low self-esteem experience by the adolescents.

For anxiety measurement, the Hamilton Anxiety Rating Scale (HARS) is used(9). The instrument consists of 14 items with the four-point likert scale ranging from 0 (not present) to 4 (severe). The total scale ranged from 0–56, where <17 indicates mild severity, 18–24 mild to moderate severity and 25–30 moderate to severe. It measures both psychic anxiety (mental agitation and psychological distress) and somatic anxiety (physical complaints related to anxiety).

In addition, the researcher provided the standard nursing treatment to the adolescents in order to observe the changes in early prodromal psychosis and the level of self-esteem and anxiety. Before and after the intervention, a comparison between the intervention and the control groups was carried out with the t-test analysis. All analyses were performed in SPSS13.0 (SPSS Inc., Chicago, IL, USA), with a 0.05 set as the required level of significance.

The survey was conducted from March to June 2017 and its population corresponded to the total number of 117 adolescents living in four orphanages in the Baubau city area, Sulawesi province, located in Southeast Indonesia. Intentional sampling was used for adolescents who met the inclusion criteria: age between 12 and 15 years; able to read and write; able to communicate verbally well; living with caregivers in orphanages and willing to participate in the study. The sample included adolescents with early prodromal psychosis, who met the inclusion criteria. The number of adolescents who were first screened was 82 individuals. Exclusion criteria were: adolescents with health problems, such as epilepsy or head injury, with levels of early prodromal psychosis with a score of PQ<6 score (that is, adolescents with severe early prodromal psychosis were excluded). Of these, 4 adolescents were excluded; therefore, 78 adolescents participated in the study. During the research, one participant got sick and could not follow the further therapy. Thus, the total number of participants was 77 adolescents (see Figure 1).

 

 

 

 

 

 

Figure 1. Consort flow chart of nursing standard treatment for adolescents with prodromal early psychosis. Indonesia, 2017

Assessed for eligibility

(N=82)

Excluded (n=76)

   Not meeting inclusion criteria (n=0)

   Declined to participate (n= 1)

 

Purposive (n=78)

Lost follow-up

(n= 0)

 

Analysed (n= 77)
 Excluded from analysis (n=0)

 

 

 

 

 

This study received the ethical approval from the Research Ethics Committee of the Nursing Faculty, University of Indonesia. The ethical requirements and the rights of the participants have been fulfilled since the preparation of the research up to the publication. There are four basic principles of this research: right to self-determination, respect for anonymity and confidentiality, right for fair treatment, and balancing harm and benefits.

 

 

RESULTS

The screening was completed using the PQ-16 instrument. The number of adolescents with early prodromal psychosis was 77 of 117 adolescents (65.8%). It indicates that adolescents in the orphanage were at risk of suffering from psychosis. The adolescents who experienced early prodromal psychosis at the orphanage had an average age of 13.69 years and length of stay in orphanage of 2.98 years. The majority of them were male (57.14%); had no history of physical disease (59.74%); had trauma in the past (74.03%); they have never had bad school achievement (63.64%); have no school problem (67.53%); and family status of divorced parents (19.48%) (Table 1). However, in general, adolescents living with both parents generally had an inadequate economic condition. Therefore, it can be understood that almost all of them have low family functions. Some of these characteristics are the etiological factors of early prodromal psychosis and low self-esteem.

 

Table 1. Distribution of characteristic of adolescents with early prodromal psychosis living in orphanages. Indonesia, 2017 (n=77).

Variables

M(SD)

P

Age (years old)

13.69(1.10)

0.38

Length of stay in orphanage (year)

2.98(1.58)

0.55

 

N

%

Gender

  • Male

  • Female

 

44

33

 

57.14

42.86

Ever had physical illness in the past

  • Yes

  • No

 

31

46

 

40.26

59.74

Ever had trauma in the past

  • Yes

  • No

 

57

20

 

74.03

25.97

Never bad school achievement

  • Yes

  • No

 

 

49

28

 

 

63.64

36.36

Have school problem

  • Yes

  • No

 

25

52

 

32.47

67.53

Status marriage of parents

  • Divorce

  • Married

 

15

62

 

19.48

80.52

 

Based on Table 2, the average early prodromal early psychosis score of the adolescents living orphanages before the standard nursing treatment was 9.16, that is, more than half of the total 16 symptoms of early prodromal psychosis. Meanwhile, the average adolescent anxiety score before the standard nursing treatment was 17.03, which means that it was in mild severity. The average self-esteem score was 13.79 (45.97%), indicating low self-esteem.

 

Table 2. The effect of standard nursing treatment for early prodromal psychosis and self-esteem in orphanage adolescents. Indonesia, 2017(n=77)

Variable

Previous average

Posterior average

Average diff

SD

p value

Early prodroma psychosis

9.16

7.13

-2.03

1.86

0.00

Anxiety

17.03

13.70

-3.33

3.37

0.00

Self-esteem

13.79

19.13

5.34

4.14

0.00

 

 

 

 

 

Based on Table 2, it is known that the average early prodromal psychosis decreased significantly from 9.16 to 7.13. It was inferred that the score approached the category of early prodromal psychosis after the standard nursing treatment, with a p-value<0.05. The anxiety decreased from 17.03 to 13.70 (p<0.05), remaining in the mild severity after the standard nursing treatment. Meanwhile, adolescents’ self-esteem change increased significantly from 13.79 (45.97%) to 19.13 (63.77%). In other words, self-esteem increased 17.8% after the standard nursing treatment (p<0.05). It means 36.23% of the adolescents did not present an indicative score of self-esteem. Nevertheless, 36.23% of self-esteem score had not been reached by the adolescents.

 

 

DISCUSSION

Early prodromal psychosis was found at a rate of 65.6% in adolescents living in orphanages. It shows the early prodromal psychosis experienced by adolescents was developed by more than half of the total adolescents screened. It can be inferred that the rate was relatively high and needed to be overcome. Based on the result, a strong assumption is that if adolescents who experienced early prodromal psychosis are not cared for immediately, they will be impacted in the short or long term.

Stevens states that prior intervention should be made immediately in adolescents with prodromal symptoms(10). Early intervention is needed to prevent the further impact, particularly if they evolve into the initial psychosis. The negative impacts that may occur in the adolescents are suicidal behavior, violence, disruption of role functions, among others.

An important implication based on this study is the short-term impact that can occur due to early prodromal psychosis, which is low self-esteem. It is started by a variety of unpleasant problems experienced by adolescents and results in the emergence of automatic negative thoughts about the problems of their lives before orphanage, ranging from very mild to very severe.

In addition, adolescents who experience early prodromal psychosis feel easily depressed and stressed. Adolescents with psychotic symptoms are likely to have other psychiatric conditions, such as major depression, bipolar disorder or dissociative states(10). This situation, involving the problem of low self-esteem more dominant, experienced by adolescents in early prodromal psychosis, presents the risk of emotional and behavioral disorders. Another impact that may occur if the management of early prodromal psychosis is postponed is the development of self-mutilation behavior. Consistent with this study, the researcher found that psychotic-like experiences were associated with suicidal ideation among the adolescent psychiatric patients(11).

The early prodromal psychosis in adolescents decreased after standard nursing treatment, a fact clearly demonstrated by the decrease in the average score of early prodromal psychosis from 57.25% to 44.56%.

Anxiety is one of the most common nursing diagnoses in adolescents with early prodromal psychosis(4). Based on the results of the present study, the average anxiety score of adolescents who experienced early prodromal psychosis was in a mild severity before the therapy. The results of this study do not cover the research that states that anxiety increases in adolescents at the clinical high risk (CHR) of developing psychosis compared with healthy control(12). Regarding sociodemographic characteristics, the relationship between parents and family characteristics towards anxiety is obtained by the prevalence of major anxiety disorders in children and adolescents living in families with low levels of education, income, employment and family functions(13).

The results of this study are not in agreement with previous research findings, since this fact can be caused by environmental factors, where the average length of stay in the orphanage is around 3 years. Thus, adolescents may have adapted to the environment with the psychosocial services provided to orphans, who reported current well-being; they claim; they are happy because it changes their lives and makes them stronger(14).

Still on this issue, the researcher of this study found three participants who lived in the orphanage for less than a year (2 to 6 months), and whose anxiety levels were in the category of moderate to severe. It can be concluded that environmental factors, such as living in a place for a long time, greatly affect stress and can cause anxiety. The longer a person lives in one place, the lower their level of anxiety. In addition, the economic condition in the orphanage is quite stable. Thus, all the needs of adolescents can be fulfilled. Based on the situations, it can be concluded that adolescents' anxiety is in a mild severity that can be influenced by the environmental factors.

Based on this study, the anxiety experienced by the adolescents decreased significantly in the mild severity (from 17.03 to 13.70). It means anxiety remained in the minor category after the standard nursing treatment in the adolescents who experienced early prodromal psychosis in orphanages. It can be inferred that standard nursing treatment can overcome anxiety symptoms. The results of this study are also in accordance with the research conducted by Hidayat(15). She proposed that relaxation of breathing is effectively able to reduce anxiety. Other studies about five-finger hypnotic therapy have proved to decrease anxiety in hypertensive clients(16) and in students who are preparing a thesis(17). In addition, other research has also demonstrated that the standard nursing treatment overcomes anxiety in clients with physical illness and improve the ability of their families(18). This treatment, which can be performed by nurses for overcoming anxiety, aims to discuss their causes, occurrences, signs and symptoms and discuss the results of anxiety, trained physical relaxation, distraction techniques, finger hypnosis  and spiritual way(19). From the explanation above, it can be concluded that the standard nursing treatment can reduce anxiety of adolescents who experience early prodromal psychosis in orphanages.

Moreover, the self-esteem of adolescents in orphanages before the standard nursing treatment has reached the average score. It indicates that this level is still below half the level of self-esteem. Another research has found that institutionalized orphans face challenges due to limited resources and decrease parental affection, yet they do have satisfactory well-being. In addition, orphans have lower self-esteem than children living with both parents do. The findings imply an increase in availability for emotional engagement involvement on the part of the caregivers of these children(20).

Based on this study, after the standard nursing treatment of adolescents who experienced early prodromal psychosis in the orphanage, their self-esteem was significantly increased from 45.97% to 68.47%, results that agree with those found in a systematic review developed by Das et al(21). This research found that creative community-based activities, such as music, dance, singing, theater, and visual arts have a positive effect on teenagers' self-esteem.

By using standard nursing treatment, nurses identify positive aspects that are still owned by adolescents, help them assess their ability and discuss skill that can still be used, help adolescents to choose and determine their ability to be trained, and practice the abilities that have been selected. These treatments can increase the adolescents’ awareness of the positive aspects that are still owned. As a result, it can increase the adolescent's self-esteem.

This study shows that the average age of adolescents who have early prodromal psychosis is approximately 14 years and adolescents who have this remain in the orphanages for almost three years.

Regarding to the history of adolescents’ physical illness, more than half of the total number of adolescents does not have the history of physical pain and the others present head trauma and fever. Adolescents have experienced unpleasant experiences in the past, mostly by at least one loss, rejection and physical/mental violence. Furthermore, in terms of school achievement, the data obtained showed that more than half of the adolescents achieved good results in their school and the orphanage. The results of the analysis showed that the orphanage adolescents involved in this study were mostly males.

Moreover, based on the characteristics of the school experience, the data obtained showed that more than half of the adolescents who experienced early prodromal psychosis in the orphanage have no history of delays or drop out in school. Besides, the status characteristics of their family show that adolescents who still have both parents were sent to orphanages due to economic circumstances, as their parents wander out of town and abroad with the aim to raise the children independently.

Therefore, it can be inferred that the results of the adolescents surveyed who experienced early prodromal psychosis in the orphanages showed that more than half of adolescents were screened. Thus, they need attention and further treatment for the prevention of psychosis. The early prodromal psychosis in these adolescents before the intervention showed an average score of half of the total score. It clearly indicated the severity of perceived symptoms.

The anxiety of the adolescents before the intervention is in mild severity. In the meantime, the adolescents’ self-esteem is at an in average score lower than half the total self-esteem score. The standard nursing treatment reduced the symptoms of early prodromal psychosis and anxiety as well as significantly increased the self-esteem of the adolescents in the orphanages.

Based on the results, it is expected that the community nursing services can apply the standard nursing treatment in the orphanage and collaborate with nurses in the mental health service of nursing practitioners and registered nurses through cooperation with the school health service, being able to refer specialist nurse, if necessary, for further treatment. Another study suggests that the integration of health services is needed as a part of the preventive, educational and collective activities based on the socioeconomic and cultural environment of the individual(22).

The standard nursing treatment can be used for adolescents in orphanages to decrease the early prodromal psychosis symptoms, decrease anxiety, and increase the adolescents’ self-esteem, which come with various problems in their lives. In addition, the nursing standard treatment can be taught to caregivers in the orphanages, so they can teach and monitor the adolescents who have prodromal early psychosis, anxiety, and low self-esteem. A longitudinal study needs to be conducted every six months for adolescents with early prodromal psychosis, monitoring the predisposition and precipitation factors of early prodromal psychosis. As a result, it is desired to reduce the symptoms of this condition, which causes decrease of anxiety and increase of the self-esteem of adolescents.

 

 

Conflict of interest

No potential conflict of interest relevant to this article was reported.

 

Acknowledgement

We are thankful to all participants in this research and to the Nursing Faculty of Universitas Indonesia, Directorate of research and development in society (DRPM) that funded this research, and to all participants at the Orphanage in Baubau City.

 

References

  1. Heinssen RK, Goldstein AB, Azrin ST. Evidence-Based Treatment for First Episode Psychosis: Componens of Coordinated Specialty Care. NIMH White Paper: 2014.

  2. Steel Z, Marnane C, Iranpour C, Chey T, Jackson JW, Patel V, et al. The global prevalence of common mental disorders: a systematic review and meta-analysis 1980-2013. International journal of epidemiology. [Internet]. 2014 [cited 2017 Jan 31];43(2):476-93. Available from:https://www.ncbi.nlm.nih.gov/pubmed/24648481

  3. Stuart GW, Keliat BA, Pasaribu J. Principal and practice of mental health nursing. Edisi Indonesia. Jakarta: Elsevier; 2016.

  4. McAusland L, Buchy L, Cadenhead KS, Cannon TD, Cornblatt BA, Heinssen R, et al. Anxiety in youth at clinical high risk for psychosis. Early intervention in psychiatry. [Internet] 2015 [cited 2017 Feb 22];11(6): 480-487.

  5. Rüsch N, Corrigan PW, Heekeren K, Theodoridou A, Dvorsky D, Metzler S, et al. Well-being among persons at risk of psychosis: the role of self labelling, shame and stigma stress. Psychiatric services. [Internet]. 2014 [cited 2017 April 1]; 65(4): 483-489. Available from: https://ps.psychiatryonline.org/doi/pdf/10.1176/appi.ps.201300169

  6. Asif A. Self-esteem and depression aming orphan and non orphan children. UEA: Dubai. MedCrave Group LLC: 2017. https://pdfs.semanticscholar.org/b38d/5229eb24f4b63c75ad6d219b6f93aa443ac3.pdf.

  7. Ising HK, Veling W, Loewy RL, Rietveld MW, Rietdijk J, Dragt S. The validity of the 16-item version of the Prodromal Questionnaire (PQ-16) to screen for ultra high risk of developing psychosis in the general help-seeking population. Schizophrenia Bull. [Internet]. 2012 [cited 2017 Feb 22]; 38(6), 1288–1296. Available from: https://www.ncbi.nlm.nih.gov/pubmed/22516147

  8. Rosenberg M. Society and adolescent self-image. Princeton (NJ): Princeton University Press; 1965.

  9. Hamilton M.The assessment of anxiety states by rating. Br J Med Psychol. [Internet]. 1959 [cited 2017 Feb 01]; 32:50–55. Available from: https://onlinelibrary.wiley.com/doi/abs/10.1111/j.2044-8341.1959.tb00467.x

  10. Stevens JR, Prince JB, Prager LM, Stern TA. Psychotic disorders in children and adolescents: a primer on contemporary evaluation and management. Prim Care Companion CNS Disord. [Internet]. 2014 [cited 2017 May 13];16(2):PCC.13f01514 Available from:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4116281/

 

  1. Lindgren, M. Psychotic-like symptoms and psychosis prediction in adolescent psychiatric patients. University of Helsinki, Institute of Behavioural Sciences, Studies in Psychology. [Internet]. 2015. 110. Available from: https://www.julkari.fi/bitstream/handle/10024/126672/psychotic_like.pdf?sequence=1&isAllowed=y

  2. McAusland L, Buchy L, Cadenhead KS, et al. Anxiety in youth at clinical high risk for psychosis. Early Interv Psychiatry. [Internet] 2015 [cited 2017 May 13];11(6):480–487. Available from:doi:10.1111/eip.12274

  3. Lawrence D, Johnson S, Hafekost J, Boterhoven DHK, Sawyer M, Ainley J, et al. The Mental Health of Children and Adolescents: Report On The Second Australian Child And Adolescent Survey Of Mental Health And Wellbeing. [Internet]. Canberra: Department of Health; 2015.[cited 2017 May 29]. Available from:https://www1.health.gov.au/internet/main/publishing.nsf/Content/9DA8CA21306FE6EDCA257E2700016945/$File/child2.pdf

  4. Phillips L, Daniels C. An outcome of psyuchosocial services provide to orphan and vulnerable children in the western cape. [Internet]. Cape town: western cape goverment; August 2015. [cited 2017 Apr 29]. Available from: https://www.westerncape.gov.za/sites/www.westerncape.gov.za/files/an_evaluation_of_psycho_social_services_for_ovc_aug_2015_0.pdf

  5. Hidayat AY, Ekaputri YS. Application of Deep Breathing Techniques in Anxiety Nursing Diagnosis With Diabetes Mellitus And Pulmonary Tubercolosis In Public Rooms RSMM Bogor. Thesis FIK-Publication of UI ANA: 2015.

  6. Banon E, Dalam E. Effectiveness Of Lima Jari Hypnotherapy In Decreasing Hypertension Patient Ansiety Level. JKep. 2014; 2(3) Nop 2014:24-33.

  7. Hastuti RY, Arumsari A. The Influence of Five-Finger Hypnotic Therapy to Reduce Anxiety in Students Who Are Preparing an Essay. Motorik Journal Of Health Science. 2016; 10(21).

  8. Livana PH, Keliat BA. The Decrease of Anxiety Response of Client of Phisical Illness with Anxiety Generalist Therapy at Bogor Public Hospital. Jurnal Keperawatan Jiwa. 2016; 4(1): 13-20.

  9. Keliat BA, Akemat, Susanti H. Case Management of Mental Disorders, CMHN (Intermediate Course). Jakarta: EGC; 2016.

  10. Moyo S, Gudyanga E, Susa R. Impact of institusionalisation of orphaned children on their wellbeing. IOSR j of humanities and social science. [Internet]. 2015 [cited 2017 Aug 12]; 20(6):63-69.Available from: https://pdfs.semanticscholar.org/5039/31d74c18cbcc8beebbede59a6f2c6e60a88f.pdf

  11. Das JK, Salam RA, Lassi ZS, Khan MN, Mahmood W, Patel V, et al. Interventions for Adolescent Mental Health: An Overview of Systematic Reviews. The Journal of adolescent health: official publication of the Society for Adolescent Medicine. 2016 [cited 2017 sept 24];59(4S):49-S60. Available from:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5026677/

  12. Faial LCM, Silva RMCRA, Pereira ER. Estudio descriptiovo de las percepciones del alumno adolescente sobre salud una: perspectiva mer leaupontiana. [internet] 2014 Oct [cited 2018 Jan 15]; 13 (suppl I): 449-51. Available from: http://www.objnursing.uff.br/index.php/nursing/article/view/5019/html_268

 

 

All authors participated in the phases of this publication in one or more of the following steps, in according to the recommendations of the International Committee of Medical Journal Editors (ICMJE, 2013): (a) substantial involvement in the planning or preparation of the manuscript or in the collection, analysis or interpretation of data; (b) preparation of the manuscript or conducting critical revision of intellectual content; (c) approval of the version submitted of this manuscript. All authors declare for the appropriate purposes that the responsibilities related to all aspects of the manuscript submitted to OBJN are yours. They ensure that issues related to the accuracy or integrity of any part of the article were properly investigated and resolved. Therefore, they exempt the OBJN of any participation whatsoever in any imbroglios concerning the content under consideration. All authors declare that they have no conflict of interest of financial or personal nature concerning this manuscript which may influence the writing and/or interpretation of the findings. This statement has been digitally signed by all authors as recommended by the ICMJE, whose model is available in http://www.objnursing.uff.br/normas/DUDE_eng_13-06-2013.pdf

 

 

Received:2018/05/26  

Reviewed: 2019/02/19  

Approved: 2019/03/2019