Aim: To describe the semantic validation process of an instrument for assessing health needs for people with physical, hearing and visual impairment (IANS-PcDFAV). Method: This is a methodological study carried out between April and May 2016, regarding the semantic and appearance validation stage. Eight disabled persons, registered in three support institutions, responded to three instruments: general and specific impression questionnaire and the IANS-PcDFAV. Brainstorm technique was used. It was analyzed by descriptive statistics and by the frequency of the presented answers. Results: The instrument was considered important or very important, with items that are easy to understand. Of the 32 original items, eight were changed for the better understanding and four were negativated, one in each dimension. Conclusion: The instrument was comprehensible for all strata of the studied population, confirming it as valid in terms of semantics and appearance.
Descriptors: Disabled Persons; Health Services Needs and Demand; Validation Studies.
According to the report published by the World Health Organization(1), entitled "World report on disability", it is estimated that more than one billion people in the world live with some form of impairment or disability, which corresponds to about 15% of the world population.
A Brazilian study(2) verified the prevalence of self-reported disability, which identified 12.4 million people. Of these, it was evidenced that 2.6 million reported having physical disability, 2.2 million hearing loss, 7.2 million visual impairment and 400,000 people with intellectual disability.
Despite representing a considerable number of people in Brazil and in the world, the history of the disabled persons (DPs) was marked by exclusionary and discriminatory processes, with negative repercussions in several aspects of their lives, such as work, leisure and health. After a long period of fighting, some achievements were achieved. Among the achievements, the Convenção sobre os Direitos da Pessoa com Deficiência (CDPcD - Convention on the Rights of Persons with Disabilities)(3) can be seen as a historical milestone, with legal representation in the recognition and promotion of the human rights of DPs and in the prohibition of discrimination against this segment of the population in all areas of life(3).
The document adopted in the CRPD includes specific forecasts for rehabilitation and habilitation, education, health, access to information and public services, among other rights(3). In 2008, Brazil ratified the Convention, adopted by the United Nations (UN), as well as its Optional Protocol. This attitude guaranteed the equivalence of constitutional amendment, valuing the joint action between civil society and government, in a possible democratic effort(4).
One of the major advances achieved by the Convention was the change from the medical model to the social model of disability(4). This new model clarifies that the limiting factor is the means of insertion in society and not the deficiency itself. It is considered that the deficiencies do not necessarily indicate the presence of a disease or that the individual is considered to be ill(5).
In the health field, this model change had an important impact on understanding and performing care for disabled persons (DPs). A movement to think about health care beyond rehabilitation began to be understood, although in an incipient way, the importance of identifying the real health needs of these people was understood(5), following the precepts of the Convention: "nothing about us without us"(3).
However, the recognition of health as the right of all and the duty of the State did not effectively guarantee the constitutionally established rights(4). The health of DP was a preferred agenda in the Unified Health System (SUS). This situation was due to initiatives that were punctual, partial and without connection with the principles of integrality, equity, universality and qualified and universal access to health(4).
It is considered that concrete health practices often do not include the values, knowledges and needs of those who are cared for(6), as is the case with DP. Health needs are conceived as historical and social(7), so they change with time and with the demands of each age. Given this, it is relevant to say that the responses to this range of needs, and their multiple factors involved, are not restricted to the performance of a single professional, or solely from health area. The actions are extended to multiprofessional, interdisciplinary and intersectoral practices, so that more effective responses to the health needs of the people are possible(6).
A study carried out in the city of João Pessoa, Paraíba, Brazil, attempted to identify the support networks, as well as the health services, which are part of the primary care and that assist the DPs, since this type of care is restricted, many times, to rehabilitation centers and other secondary care services. This restriction compromises access, considering the repressed demand existing in these places, not guaranteeing the integrality of the attention(2).
It is necessary to evaluate the health needs of DPs in order to understand the singularities that surround life and their way of life, the services that are organized, both from the point of view of physical structure and professional qualification(2).
In this scenario, it is necessary to think about strategies that can identify and evaluate the health needs of the DPs. In this study, the basis for meeting this proposal lies in the development and validation of a Health Needs Assessment Instrument for People with Disabilities, specifically physical, auditory and visual impairment. The purpose of this study was to describe the process of semantic validation of an instrument for assessing the health needs for people with physical, hearing and visual impairment (IANS-PcDFAV).
This is a descriptive methodological study(8), focused on the development and validation of an instrument. The stages of the theoretical pole proposed by Pasquali(8) were followed. This pole deals with the question of the theory that involves the construct for which one wants to develop an instrument of measurement, as well as its operationalization in items, beginning with the delimitation of the psychological system or construct that one intends to measure and the delimitation of the attributes, from the researcher's experience, literature support and experts in the field(8-9).
In the first phase, the constitutive and operational definitions of the construct and the elaboration of the items that composed the instrument called the Health Needs Assessment Instrument of People with Physical, Hearing and Visual Impairment (IANC-PcDFAV) were identified through the integrative review of the literature, carried out in the databases CINAHL, MEDLINE, LILACS and SCOPUS; experience of researchers; and in the Taxonomy of Health Needs of Matsumoto and Cecílio; later, the theoretical analysis of the items was carried out in two stages. Stage 1 - Content validation, based on Delphi technique, with expert healthcare professionals who would act as judges of the instrument. The sample consisted of 33 Delphi 1 and 18 Delphi 2 experts. For data collection, the form was submitted to specialists online. The analysis was carried out by adopting the Content Validity Index (CVI)> 0.80 and Cronbach's Alpha> 0.80. The Mann-Whitney test was used to investigate the differences between the Delphi 1 and 2 phases with p> 0.05. The consensus was obtained in the second round of evaluation, achieving excellent validation indexes.
Table 1 shows the items of the instrument with the content valid by the specialists.
Table 1 - Items of the instrument with valid content. Natal, 2016.
In this study the theoretical analysis of the items is carried out, in this case, the semantic analysis, one of the stages of the theoretical pole(8). This type of validation consists in verifying that all items are comprehensible to the members of the population to which the instrument is intended(8-9). It has two functions: 1 - to verify whether the items are intelligible to the stratum of the target population that presents a lower degree of ability (lower extract); 2 - to verify the Apparent Validity of the instrument by consulting the stratum of higher skill (more sophisticated) of the target population(8).
To this end, the understanding of the instrument was verified by a sample of eight people with disabilities. Of these, two had physical disabilities; two had hearing impairment with interpreter access to Libras at the time of collection; four were visually impaired, with access to the reader, at the time of collection and were registered or enrolled in the organizations/institutions participating in the study (Mossoró Deaf Association, Mossoró Association of the Physically Disabled and Mossoró Association of the Visually Impaired); aged over 18 years, possessing a level of education that provided reading and comprehension skills.
This number of subjects is in accordance with the adopted methodological framework, which recommends a minimum number of subjects for semantic validation, without the need for a sample calculation related to statistical inferences(10).
Data collection took place in April and May 2016. Telephone contact was made to invite and schedule for participation in the study. The meetings took place at the headquarters of the organizations and institutions that gave consent for conducting the research. The DPs who agreed to participate received guidance on the purpose of the study and signed the Informed Consent Form in two copies.
The brainstorm technique was used. It consists of groups of up to four people, starting with the subjects of the lowest stratum of the target population (Group 1- four people), and then with a group of the highest stratum (Group 2 - four people). With the item comprised by Group 1, it was moved to the other group. If not, it was necessary to review the considerations of the group. As for Group 2, a verification session was held in order to avoid items to be too simple for such persons(8).
The first moment of the data collection consisted in filling in the IANS-PcDFAV, with the content already validated in the previous stage of the study. In the second phase, participants completed the initial version of the instrument, a general impression form, which aims to evaluate the general characteristics of the IANS-PcDFAV (importance, difficulties in answering the questions, changes and additions required). In the third moment, the form of specific impressions (cognitive interview), which aims to verify the relevance and comprehension of the proposed items, was completed. Both the general impression form and the specific print form were adapted from the method proposed by the DISABKIDS® project(11).
Subsequently, based on the method of paraphrasing (variant of the think aloud method)(12), the DPs were invited to repeat the item with their words and to describe their meaning. As a result of the exhaustion of this task, the 32 IANS-PcD items were divided by four subsets, represented by the four dimensions of the instrument: subset A (items A1 to A9), subset B (items B1 to B6), subset C (items C1 to C9) and subset D (items D1 to D8), and each two participants performed specific semantic validation of only a subset of items.
The data collected were organized and analyzed using descriptive statistical techniques, using the statistical program SPSS version 20.0, obtaining the mean and standard deviation. For semantic validation, a frequency> 80% was considered in the responses of the General Impressions Questionnaire. For the qualitative study of semantic validation, the frequencies of the answers obtained in the general impression questionnaire and in the cognitive interview were calculated. For the specific validation of the items, a minimum frequency of three negative responses was considered as indicating that the item could present problems and should be subject to further revision.
After semantic validation, it was decided to perform a lexical and grammatical correction by two reviewers, with qualification for such function, in order to guarantee the validity of the evaluation. In cases of disagreement between the two reviewers, a third party should give their opinion.
Ethical precepts established by Resolution 466/2012 of the National Health Council of Brazil were followed. Approval was obtained for conducting the study by the Research Ethics Committee of the Federal University of Rio Grande do Norte (UFRN) (CAAE 39639014.3.0000.5537), respecting all national and international human research standards.
Eight people with varying degrees of disability participated in this study, mean age 42.7 years (± 10.6 SD). As to the type of disability, four were people with visual impairment (50%), two were people with physical disabilities (25%) and two were people with hearing loss (25%). As for educational level, two participants had completed higher education (25%); one, incomplete higher education (12.5%); three, complete secondary education (37.5%); one, incomplete high school (12.5%); and one, incomplete elementary school (12.5%).
GENERAL SEMANTIC VALIDATION
People with disabilities expressed a positive overall impression of the version of the Instrument for the Assessment of the Health Needs of Persons with Physical, Hearing and Visual Disabilities (IANS-PcDFAV). Most of the DPs evaluated the items in the questionnaire as easy to understand and showed no difficulties in using the response scale. The issues were assessed as very important or sometimes important by most participants. Only a small percentage of DPs expressed a desire to change/add questions to the questionnaire and no participants considered the questions intrusive, in a way that they did not want to respond, according to Table 1.
Table 1 - General impression/General semantic validation of the Instrument for the Assessment of the Health Needs of Persons with Disabilities (IANS-PcD). Natal/RN, 2016
SPECIFIC SEMANTIC VALIDATION
In the specific semantic validation phase, all items were considered important for assessing the health needs of people with disabilities by at least six of the eight participants. The questions were considered comprehensible by all DPs, with the exception of items A3, A8, B4, B5, D1, D4, D5 and D6, as shown in Table 2 below.
Table 2 - IANS-PcDFAV items that presented difficulties of comprehension and suggestions for reformulation. Natal/RN, 2016
For the remaining items, the cognitive interviews confirmed the equivalence between the concepts that were intended to be evaluated and the participants' interpretation of the items. Only item A3 (Are you required to obtain orthoses (insoles, vests, plastic splints, cervical collar for immobilization, kneepad, cane, and hearing aid) and prostheses (joint prosthesis, breast prosthesis, intraocular lens, and vascular prosthesis)?) Was considered problematic, based on the criterion of a minimum frequency of three negative responses. The paraphrasing method revealed that the meaning attributed by the DPs to the item was different from that intended because of the confusion between the terms "orthoses" and "prostheses".
The interviewees' suggestions generated changes in three main categories: substitution of some terms used by others of better understanding, inclusion of the meaning of not-known words, and use of examples that could help the understanding of words or terms. The determination of the relevance of the suggestions provided by the DPs and the choice of the best adjustment strategy were used with a focus on the objective of the instrument, which is to assess the health needs of people with disabilities.
The answer options (0 - nothing, 1 - very little, 2 - more or less, 3 - very, 4 - completely and 0 - none, 1 - few, 2 - more or less, 3 - very, 4 - extremely) were assessed by all participants.
Of the 32 original items, eight were altered with a view to a better understanding and four were negatived, one in each dimension, with a view to not conditioning the respondent to answer only in an affirmative way, thus ensuring greater methodological rigor to the instrument. The items and their respective changes and denials are shown in Table 3.
Table 3 - Changes in the instrument for assessing the health needs of people with physical, hearing and visual impairment (IANS-PcDFAV). Natal/RN, 2016
It is noteworthy that people with visual impairment requested a trained reader and people with hearing impairment, even if they were literate, requested the presence of the interpreter of the Brazilian Language of Signals (Libras) for the application of the instrument.
It should be noted that, in order to guarantee the quality of the validated items, the lexical and grammatical correction of the items was performed, guaranteeing better quality of the instrument. Of the evaluated items, three have undergone changes, which are underlined in the table below (Table 4).
Table 4 - Lexical and grammatical changes carried out in the instrument for assessing the health needs of people with physical, hearing and visual impairment (IANS-PcDFAV). Natal/RN, 2016
The final version of the instrument can be obtained on demand (sirdenia.dr@hotmail.com).
The study participants presented sociodemographic characteristics that portray the Brazilian reality for DPs, such as, for example, the mean age above 30 years(13). In addition, the need for a trained reader and a Brazilian Sign Language interpreter to carry out the communication imply factors that may lead to low or no health information for DPs(14). This fact reveals the importance of using a technology that is comprehensible and accessible to the target audience, ratifying the need to semantically validate the instrument produced to assess the health needs of DPs, such as IANS-PcDFAV.
In view of the growing interest shown in recent years in the role of the DPs in matters concerning their lives and society, guided by the provisions of the Convention on the Rights of Persons with Disabilities, it is imperative that any material/technology produced for this population segment is also validated by them, respecting the indication: nothing for us, without us(3).
Regarding the general impression of the IANS-PcDFAV, it was quite positive, confirming the relevance of the items for the evaluation of the health needs of people with physical, hearing and visual disabilities, as well as their comprehensibility and adequacy of the response scale. This process proved to be relevant, since it allowed elucidating the importance of the elements contained in the instrument and identifying the necessary adjustments to increase the reliability of the instrument(15).
The cognitive interview was an essential procedure in the identification of problems in the understanding of the items, contributing to the reformulation of the items. A factor strongly present in the semantic validation process was the difficulty of the participants to identify terms or words that are part of the technical language in health related to the rehabilitation of DPs, such as orthoses and prostheses. At the time of the interview, it was observed that some of them use orthoses or prostheses, but they did not know what they were, revealing the lack of information regarding their health issues.
A study on health knowledge conducted with deaf people revealed that these people did not know about health due to poor and inefficient sources. It is added that the information provided is primary, with no depth of contents(16). This reality is not restricted to deaf people. DPs of all kinds suffer daily from exclusionary processes in all areas of their lives, and health is no different. It is observed that the communication process between health professionals and DPs is fragile and ineffective(16).
Knowledge about health, even if elementary, is essential for the subject to contribute positively to the health/disease process. It is emphasized that people can effectively exercise their right to citizenship, and consequently to health, through the empowerment of information(16).
Another worrying fact was the lack of knowledge of the terms: public policies and human rights. Attention is drawn to the fact that all participants in this study are linked to associations of people with disabilities and some are still linked to social movements fighting for people with disabilities, and yet there are still difficulties of access to information on social and human rights(18).
The result of this study differs from that of a study carried out in Fortaleza, capital of Ceará State, where the DPs reported the knowledge and repercussion of inclusive public policies for their lives(19). This differentiation can be explained by the fact that in the Brazilian reality the public policies for the DPs, for the most part, are neither effective nor efficient(20), presenting a greater slowness to reach urban centers with lower development potential. The Convention on the Rights of Persons with Disabilities, ratified in Brazil, has been based on the precepts of the Universal Declaration of Human Rights, and yet, little progress has been made in this area(3).
Regarding the change from the positive form to the negative form of the questions, other studies were considered, when the respective instruments were applied to the target populations(21-22). Even knowing the difficulty of the interviewees to understand and, consequently, to answer the items in a negative way, this change was chosen because it presents itself as a strategy used in the development of scales, in order to ensure that the respondents remain attentive to the items(22).
With regard to lexical and grammatical correction, it was observed that few items changed; only three of the 32 items of the instrument, showing that previous validation steps have already enabled most of the necessary corrections.
The results presented here indicate that the IANS-PcDFAV is mostly comprehensible and, in addition to being able to assess the health needs of people with physical, hearing and visual impairment, can identify aspects that can be intervened by managers for the improvement of health planning for this population segment.
The sample of the present study was composed of DPs that are associated in non-governmental organizations, that is, people directly or indirectly involved in movements for the rights of DPs in the State of Rio Grande do Norte. However, this factor may be a limitation, since the sample was selected for convenience, in order to take into account the methodological considerations of the study. It should be noted that the instrument was prepared and the content was validated and it has also been validated semantically in Brazil, and therefore to be used in other countries, it should be translated and adapted.
It was concluded that it was possible to describe the semantic validation of the IANS-PcDFAV, which will be applied in the future to the person with physical, auditory and visual disability to evaluate their health needs. Subsequently, it is suggested to carry out the construct validation, through the application of the instrument to a larger sample of DPs, in order to verify, through statistical tests, the accuracy and pertinence of its use to assess the health needs of people with disabilities that can support health planning.
All authors participated in the phases of this publication in one or more of the following steps, in according to the recommendations of the International Committee of Medical Journal Editors (ICMJE, 2013): (a) substantial involvement in the planning or preparation of the manuscript or in the collection, analysis or interpretation of data; (b) preparation of the manuscript or conducting critical revision of intellectual content; (c) approval of the version submitted of this manuscript. All authors declare for the appropriate purposes that the responsibilities related to all aspects of the manuscript submitted to OBJN are yours. They ensure that issues related to the accuracy or integrity of any part of the article were properly investigated and resolved. Therefore, they exempt the OBJN of any participation whatsoever in any imbroglios concerning the content under consideration. All authors declare that they have no conflict of interest of financial or personal nature concerning this manuscript which may influence the writing and/or interpretation of the findings. This statement has been digitally signed by all authors as recommended by the ICMJE, whose model is available in http://www.objnursing.uff.br/normas/DUDE_eng_13-06-2013.pdf