Next Article in Journal
Prevalence of Internet Addiction and Gaming Disorders in Southeast Asia: A Meta-Analysis
Previous Article in Journal
Association between Female Reproductive Health and Mancozeb: Systematic Review of Experimental Models
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Inventory of Quality in Early Intervention Centres for Service Providers: Preliminary Validating Study in a Spanish Sample

1
Doctoral School, University of Málaga, 29071 Málaga, Spain
2
Department of Physiotherapy, Faculty of Health Sciences, University of Málaga, 29071 Málaga, Spain
3
Valencian International University, 46002 Valencia, Spain
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2020, 17(7), 2581; https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph17072581
Submission received: 15 March 2020 / Revised: 2 April 2020 / Accepted: 8 April 2020 / Published: 9 April 2020
(This article belongs to the Section Health Care Sciences & Services)

Abstract

:
Evaluating the service quality in early intervention (EI) from the perspective of professionals with knowledge in this area is essential for the improvement of EI centres. In this study, we aimed to test the reliability and validity of the adapted Inventory of Quality in Early Intervention Centres-P (IQEIC-P) in a sample of professionals who worked in EI centres. Three hundred and twenty-four professionals of 85 EI Spanish centres were recruited for this research. Various psychometric analyses were used to evaluate the factorial structure, the internal consistency, factorial validity and construct validity. A 5-dimension structure was obtained in the exploratory factor analysis (EFA). The results showed an adequate internal consistency (Cronbach’s alpha values between 0.71 and 0.83, and composite reliability (CR) values higher than 0.70), as well as satisfactory convergent and discriminant validity (average variance extracted (AVE) values above 0.50). In the confirmatory factor analysis, good model fit indicators were observed. The IQEIC-P showed adequate psychometric properties, demonstrating to be a valid instrument for the evaluation of service quality in EI centres from the perspective of professionals. The benefits will influence the professionals themselves, and they will have a positive and direct impact on the families that are attended to in these centres.

1. Introduction

One of the objectives of early intervention (EI) is to respond to the temporary or permanent needs of children with developmental disorders or at risk of developing such [1]. EI acts in the first years of a child’s life, which are decisive for his/her neurodevelopment [2,3].
EI is undergoing an important transformation process since a few years ago [4,5,6], where offering a quality service has become a topic of interest. In this sense, knowing the key elements that determine a positive evaluation of service quality [7], as well as knowing how to define and measure such a construct, is currently fundamental. There is a lack of consensus on measuring EI service quality, even after decades of studies [8], due to the fact that these dimensions cannot be generalised to any service or geographical context [9]. Thus, it is necessary to adapt the tools, and this creates the need to develop specific scales that use dimensions with a more direct relationship depending on the context [10].
EI services in Spain are organised differently in each of the autonomous communities into which the country is divided. Each of these has the authority to organise the services that it provides in a different way [11]. The ministries with responsibility for EI are Health, Social Services and Education, which must coordinate with each other to ensure quality services based on prevention, early identification and intervention [1]. EI programs, most of which are subsidised by the government, are organised in Early Intervention Centres (EIC) [12].
According to the White Paper on Early Intervention [1], Early Intervention Centres (EIC) are defined as specialised centres, with suitable infrastructure and multi-disciplinary personnel, responsible for providing integral attention to the underage and to their families and environment. This organisational structure is the most extended in the Spanish territory. In the specific case of Andalusia (Southern Spain), it is legislated according to Decree 85/2016, of 26 April, which regulates the integral intervention of Early Childhood Care [13], although in other countries the welfare model may be different from the one applied in Spain [14].
Given the need to develop tools contextualised for the territory in which they will be used [10], Romero-Galisteo et al. [15] designed the “Inventory of Quality in Early Intervention Centres” (IQEIC) to evaluate the quality perceived by the families attended to in EI centres.
This tool was constructed from the Questionnaire of Perceived Quality in Early Intervention Physiotherapy [16] and the Satisfaction of the Client Family Questionnaire [17]. IQEIC was a scale composed of four dimensions (centre facilities, treatment rooms and material, qualified staff and technical or specific information) and 26 items. The response format for all items is a 5-point Likert scale rated from 1 (strongly disagree) to 5 (strongly agree).
The questionnaire has adequate psychometric properties, with a good fit of the indices considered in the evaluation of the model, as well as satisfactory reliability (composite reliability) and validity (convergent and discriminant). Previous versions of IQEIC have demonstrated the validity and reliability of the questionnaire [15,18,19]. To the best of our knowledge, after carrying out a literature review, the scale proposed by Romero-Galisteo et al. [15] is the only one validated in this study context [20].
In the evaluation of quality, the perspective of the patient has increased considerably [21], and, in the case of EI, the family is a fundamental aspect in the analysis of service quality [18,22,23]. However, the academic literature suggests that evaluation should not be exclusively focused on the family [24], as it is necessary to analyse the perspective of professionals with knowledge in this area.
Service providers must be involved in the evaluation of the quality of the services they provide, as this partially determines the success of their management [25]. This author highlights the relevance of comparing the perceptions of the clients with those of professionals. In this line, several authors [26,27] state that it is essential to know the opinion of the professionals since it directly affects the design, dedication, and results of the service provided. Therefore, it is important to consider the perception of the professionals who compose the multidisciplinary teams in EI centres [1,28] for the design of specific measuring tools [29]. However, the perspective of professionals has been studied only as another dimension of service quality [28].
In view of this situation, and due to the lack of tools for the evaluation of service quality from the perspective of the professionals, the relevance of the present study emerges from the need detected in this specific context [20].
Evaluating and comparing the perspectives of families and professionals will allow advancement in the process of continuous improvement that EI centres (EI) are undergoing. To this end, it is necessary to develop valid and reliable tools that consider the context in which they were created and in which they will be used.
Thus, the main objective of this study was to adapt a specific instrument to measure the service quality perceived by the professionals of EI centres. In the literature, exploratory and confirmatory factor analyses are used to test the construct validity of scales. Therefore, despite the previously known structure, both analyses were used in this study, since the adaptation of the items can give rise to new factorial structures. In this way, with the aim of exploring the dimensionality of the tool, we conducted an exploratory factor analysis with the relevant tests (Kaiser–Meyer–Olkin (KMO) and Bartlett’s test of sphericity) and a confirmatory factor analysis to verify the obtained structure by adding the complementary measures of reliability and validity (composite reliability and average variance extracted) [30,31].

2. Materials and Methods

2.1. Participants

Three hundred and twenty-four professionals from 85 EI centres of the region of Andalusia were recruited to participate in this study. The respondents were 35.7 years old on average (SD = 8.83). Regarding gender, the sample included 86.4% female and 12.7% male respondents (missing data 0.9%). With respect to the profession of the participants, eighty-eight were physiotherapists, eighty-five psychologists, seventy-five speech therapists, sixteen occupational therapists and forty-six had other professions. With regard to years of experience in early intervention, one hundred and forty participants had 0–5 years of experience, seventy-six had 6–10 years, seventy-two had 11–20 years and nineteen had more than 20 years (Table 1).
The questionnaires were sent to these centres via ordinary mail and identified with a numerical code. Authorisation was requested from the different centres through a letter explaining the purposes of the investigation and the procedure to be carried out. The participants were informed of the purpose of the study, and informed consent was requested from them to participate, in accordance with the Declaration of Helsinki, as well as the scientific nature of the study and the anonymity and confidentiality of the responses. The data collection was carried out during the months of May and June of 2018. Permission to undertake this study was granted by the Research Ethics Committee at Malaga University (code 22-2018-H). The exclusion criteria established were the following: informed consent not completed and not having enough knowledge for correctly understanding and expressing the Spanish language.

2.2. Measures

The Inventory of Quality in Early Intervention Centres (IQEIC) [15] was adapted to determine the valuation of ECI service quality from the perspective of professionals who work in EI centres, obtaining an adequate fit to the data (χ2;/gl = 2.53, CFI = 0.94, TLI = 0.92, IFI = 0.94, RMSEA = 0.059). This questionnaire is originally composed of 26 items distributed in four dimensions following the structure of the model proposed in the study of Romero-Galisteo et al. [15]. The first dimension is called “centre facilities” (CF), and it comprises the items related to accessibility, location and adequacy of the facilities; the second dimension would be “treatment room and material” (TRM), which groups the items related to the state of both the treatment rooms and the materials used in them; the third dimension, called “qualified staff” (QS), evaluates the professionals; and the last dimension, called “technical or specific information” (TSI), is related to the more specific and detailed information given to the families.
After adapting the items, the next step was the determination of the content validity by three experts in EI with more than 10 years of experience, who read and confirmed the correct understanding of all the items with no need to remove any of them, suggesting the punctual adaptation of some words in several items (e.g., “the activities proposed for users to work outside the centre are feasible” instead of “the activities proposed for users to work on at home are feasible”; “the information it gives about the user is clear” instead of “the information received about the user is clear”). A Likert-type scale was used, ranging from “1” = completely disagree to “5” completely agree. In addition, the questionnaire included a first section with sociodemographic questions, aimed at identifying the characteristics of the participants in the study.

2.3. Statistical Analyses

Various psychometric analyses were used in this study. The sample was randomly divided into 2 parts to carry out the evaluation of the psychometric properties and construct validity. The first part represented approximately 35% of the sample (n = 112), which was enough for the exploratory factor analysis (EFA) calculation [32], utilizing principal component extraction and Oblimin oblique rotation as a method of factor extraction. Beforehand, Kaiser–Meyer–Olkin (KMO) and Bartlett sphericity tests were conducted to determine whether the items were significantly correlated and shared sufficient variance to justify factor extraction [33]. The internal consistency of each scale was assessed using Cronbach’s alpha [34,35] and by examining the corrected item–total correlations between the individual items [31,36]. To determine the relationships among variables, the inter-correlation of the items was evaluated with Pearson’s correlations.
The second part represented approximately 65% (n = 211) of the sample and was used for the confirmatory factor analysis (CFA) to test the fit of the measurement model using the maximum likelihood estimation. Composite subscale scores were then created by calculating the mean of all the items in a given subscale. With regard to goodness-of-fit indices, we used χ2 and its differences regarding the degrees of freedom (χ2/df), comparative fit index (CFI), Tucker Lewis index (TLI), incremental fit index (IFI) and root mean square error of approximation (RMSEA). We considered the fit indicators to be adequate when χ2/df was below 3 [37], CFI, TLI and IFI were equal to or above 0.90, and RMSEA was below 0.08 [31,38]. The statistical analyses were conducted using SPSS and AMOS 21.0 (SPSS Inc, Chicago, 127 IL, USA).
In addition, the internal consistency of the constructs was measured through composite reliability [31], and convergent validity was evaluated through the average variance extracted (AVE), whilst discriminant validity was also established when the AVE for each latent construct exceeded the squared correlations between that construct and any other [39].

3. Results

No missing data were found in the answers, and the different items obtained a high average score, with those related to the information about people who work in EI centres being the ones with the highest score. Table 2 presents the descriptive statistics (i.e., mean, standard deviation [SD]) and internal consistency of the different dimensions of the questionnaire, and correlations between dimensions.
The relevance of the EFA showed a satisfactory KMO sampling adequacy index (0.902) and significance according to Bartlett’s test of sphericity [χ2(325) = 3758.77; p < 0.001]. The results explain 58.32% of the total variance explained, indicating that the scales had satisfactory factor structures [33] showing sample adequacy and suitability for completing a factorial analysis. The EFA showed the existence of five dimensions, as it identified a new dimension (intervention), composed of two items (5.61% of the total variance). Factor loadings above 0.40 were obtained, which is the saturation criterion to consider that an element is an indicator of the factor [40], with the exception of items 13 (“the specialised staff are easily identifiable”; λ = 0.256) and 18 (“users value the contributions and initiatives of the qualified staff”; λ = 0.236). All the items presented commonalities above 0.50 [41].
The questionnaire had optimal internal consistency reliability (α = 0.90). However, after deleting items 13 and 18, very good reliability levels were obtained, between 0.70 and 0.83. The correlation coefficient of each item score and the total score (HIc index, Table 3) of IQEIC-P was between 0.266 and 0.745; in all cases, the values were greater than 0.25 [42]. The correlations between the dimensions were significant and moderate, between 0.37 and 0.71 (Table 2).
According to the descriptive analyses, the dimension that was best valued by the participants was “qualified staff”. On the other hand, the dimension with the lowest score was “treatment room and material”, which was the only one with a mean value below 4 (Table 2).
Regarding the items, the professionals evaluated accessibility and the relationship with the users in a positive manner (items 16,17). In contrast, they gave a lower valuation in those items related to the materials available to carry out the intervention (item 10) (Table 3).
The values pertaining to the original confirmatory factor analysis (CFA) model with 26 items showed poor results. Although the value of χ2/df was good (2.39), those of CFI (0.834), TLI (0.813), IFI (0.836) and RMSEA (0.085) were below the recommended level, and these results indicated that the model should be adjusted. The items showed a factor loading greater than the conservative threshold of 0.60 (R2 ≥ 0.30) [33], indicating adequate individual reliability, except for items 2 (λ = 0.311; “it is easy to get to the centre using public transportation”), 13 (λ = 0.417) and 18 (λ = 0.490), which were consequently removed. In addition, according to the modification indices (MI) and theoretical knowledge, we established covariant relations between e8 and e10 (MI = 47.23), e16 and e17 (MI = 41.74) and e24 and e25 (MI = 21.03). The result was a scale composed of 23 items with an acceptable fit to the data in CFA [χ2/df = 1.68; CFI = 0.934; TLI = 0.923; IFI = 0.935; RMSEA = 0.057] (Figure 1).
The convergent validity is demonstrated in two ways. First, the factor loadings were significant and greater than 0.5 [43,44], and, second, the average variance extracted (AVE) for each construct was higher than 0.5 [31]. The composite reliability (CR) of the scale is also demonstrated, as the indices of each of the dimensions obtained were higher than the threshold of 0.7 [43,44]. Lastly, the discriminant validity of the measurements was accepted, given the square correlations between each dimension and any others that were lower than the AVE values for each dimension [31] (Table 4).

4. Discussion

EI and the services provided to children with disabilities have gained interest in recent studies [18,24,44,45]. However, few researchers have approached the service quality through the use of validated tools to evaluate early childhood intervention centres from the perspective of professionals who work in these institutions. Therefore, this study aimed to determine the psychometric properties of an instrument adapted to this specific context, with the aim of filling the gap in the literature regarding reliable and valid instruments that allow measuring the quality perceived by the population of EI professionals.
Thus, the instrument presented is an adaptation of the IQEIC questionnaire [15]. Despite having all the original items after the content validation, the methodological criteria applied led to the removal of three items, which did not show adequate results. The dimensions that comprised the tangible aspects, specifically CR and TFM, obtained the lowest scores, whereas the dimensions related to the intervention of professionals, such as QS, I and TSI, showed higher valuations. These results show similarities with those obtained by Horridge et al. [46], where the valuations of the professionals were lower in aspects related to the facilities and treatment rooms. These results could be due to the cutbacks to early childhood intervention centres and treatment equipment [47]. Moreover, they reported on issues related to the waiting time, as well as on the reduction in the time allocated to the treatment of children, which had a negative influence on the perception toward service quality. It is worth highlighting the score difference regarding the items of dimension I; its results were lower than those of the present study. This could be related to the negative connotations of the term “economic cutbacks”, encouraging the participants to give lower scores, and even possibly influencing the authors’ interpretation of the results.
One of the important aspects of measuring the perceived quality is that it allows the identification of criteria that create opportunities for improvement. In fact, the results of measuring the current situation could provide the necessary motivation for quality improvement [48], becoming important for professionals who provide these services, especially for those in positions of responsibility, for adequate decisions making. In this sense, the benefits do not only influence the professionals themselves but will also have a positive and direct impact on the families that are attended to in these centres.
In other countries, several studies have evaluated the service quality from the perspective of the professionals [4,27]. Their results show significant differences between the occupations or job positions of the participants. Similarly, the instrument presented in this study considered the participation of the multi-disciplinary teams that work in early childhood intervention centres, that is, physiotherapists, speech therapists, psychologists and occupational therapists. Thus, a broader perception was obtained, representing an advantage with respect to other tools which base the perception of the service on specific professionals, such as physiotherapy [14,16,49].
Some of the tools used nowadays to evaluate the service quality from the perspective of the professionals are based on other tools that were previously designed for the families. An example of these is the Measure of Processes of Care for Service Providers (MPOC-SP) [50], whose structure is similar to that of MPOC-56 [51], which is the version for family members. Studies in which both scales were used [51] highlight the need to develop the questionnaire for the professionals with parallel dimensions with respect to the version for the families, with the aim of facilitating the comparison of both perspectives.
Aytch et al. (1999) [52], among other authors, consider that using the same tool for different populations is inadvisable. In fact, they question the development of questionnaires based on the perception of a single population group since families, service providers and researchers can disagree on the aspects to be evaluated. Therefore, for the design of the tool presented in this work, we used both the latent variables proposed by Romero-Galisteo et al. [15] and the contributions of experts in EI with more than 10 years of experience.
Although the results obtained in previous studies [50,53,54] show differences between the valuation of “providing general information” and that of “technical or specific information”, whose content is similar, higher values were obtained in “treating people respectfully” and “qualified staff”.
Other studies compare the results obtained between professionals and families, showing in some cases similar values [55], and opposing opinions in other cases [56], which also demonstrates the need to analyse both perspectives [25].
Moreover, the dimensions used allow approaching the quality construct in a wider way compared to other studies that approach the model focused on the family [11,14,50,55] without considering the tangible aspects of the service (facilities, waiting rooms, state and quality of the material, etc.). Furthermore, the obtained results show the existence of a new dimension with respect to the original version of the tool, in this case, called “intervention”. Although this dimension was difficult to value for the families, it is of great relevance for professionals, which confirms that the dimensions cannot be generalised to different contexts [9]. This is in line with the methodological limitations obtained by other studies that used the same instrument in different scopes [57,58,59]. Nevertheless, authors, such as McWilliam et al. [60], evaluated the “intervention planning” from the perspective of the families.
Lastly, the purpose of designing this type of tool is to develop and contribute to the implementation of a process of continuous improvement, which is necessary in the service quality culture of early childhood intervention centres, facilitating their evaluation and the evaluation of their services, and allowing the implementation of improvements both in the short and long term [48,61].
However, the present study has some limitations. One of them is related to the sample recruitment. Since it was purposive sampling, the results cannot be generalised to other contexts, such as hospitals, private pediatric clinics, intervention exclusively in natural environments, or other geographic regions. Therefore, we consider it necessary to verify the factor structure in other contexts where the administrative organisation of EI services is different from that of early childhood intervention centres [62]; thus, studies which demonstrate the factor invariance of the tool could be very useful. In this line, future studies must compare the different perspectives, of both users and professionals, with the aim of advancing in the process of continuous improvement. On the other hand, analysing the influence of certain sociodemographic factors, such as time worked, on the perception toward service quality, would be another research line that would undoubtedly contribute with interesting data to this research field.
Another possible limitation is that a self-completion questionnaire is presented; thus, it is necessary to interpret the results cautiously [63]. However, self-evaluation is recognised as a useful tool that provides relevant information [64,65].

5. Conclusions

The obtained results allow asserting that the IQEIC-P instrument provides adequate psychometric properties for the evaluation of service quality in early childhood intervention centres from the perspective of EI professionals. The five dimensions that make up this tool provide relevant information both for the multi-disciplinary teams that work in the centres and for their managers. The evaluation of service quality will allow identifying areas for improvement, which requires future studies to delve into this construct in different contexts.

Author Contributions

Conceptualisation, I.-C.J.-C. and R.-P.R.-G.; methodology, P.G.-R.; software, P.G.-R.; validation, I.-C.J.-C. and R.-P.R.-G.; formal analysis, P.G.-R.; investigation, I.-C.J.-C. and N.M.-M.; resources, M.-T.L.-M. and N.M.-M.; data curation, P.G.-R.; writing—original draft preparation, M.-T.L.-M. and N.M.-M.; writing—review and editing, I.-C.J.-C., R.-P.R.-G., M.-T.L.-M., P.G.-R. and N.M.-M.; visualisation, R.-P.R.-G. and P.G.-R.; supervision, I.-C.J.-C. and N.M.-M. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Acknowledgments

The authors thank the multidisciplinary teams from Early Childhood Care Centres for their willingness and collaboration with the study.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Federación Estatal de Asociaciones de Profesionales de la Atención Temprana [GAT]. White Papel on Early Intervention; Real Patronato Sobre Discapacidad. Ministerio de Sanidad, Política Social e Igualdad: Madrid, Spain, 2005. [Google Scholar]
  2. Walker, S.P.; Wachs, T.D.; Grantham-McGregor, S.; Black, M.M.; Nelson, C.A.; Huffman, S.L.; Richter, L. Inequality in early childhood: Risk and protective factors for early child development. Lancet 2011, 378, 1325–1338. [Google Scholar] [CrossRef]
  3. Sims, M. The importance of early years education. In Teaching Early Years: Curriculum, Pedagogy and Assessment; Pendergast, D., Garvis, S., Eds.; Crows Nest: New South Wales, Australia, 2013; pp. 20–32. [Google Scholar]
  4. Sofaer, S.; Crofton, C.; Goldstein, E.; Hoy, E.; Crabb, J. What Do Consumers Want to Know about the Quality of Care in Hospitals. Health Serv. Res. 2005, 40, 2018–2036. [Google Scholar] [CrossRef] [PubMed]
  5. Carpenter, B. The impetus for family-centred early childhood intervention. Child Care Health Dev. 2007, 33, 664–669. [Google Scholar] [CrossRef] [PubMed]
  6. García-Grau, P.; McWilliam, R.A.; Martínez-Rico, G.; Morales-Murillo, C.P. Child, Family, and Early Intervention Characteristics Related to Family Quality of Life in Spain. J. Early Interv. 2018, 41, 44–61. [Google Scholar]
  7. Mañas-Rodríguez, M.A.; Giménez, G.; Muyor, J.M.; Martínez-Tur, V.; Moliner, P.M. Los tangibles como predictores de la satisfacción del usuario en servicios deportivos. Psicothema 2008, 20, 243–248. [Google Scholar]
  8. Torres-Samuel, M.; Vásquez-Stanescu, C.L. Modelos de evaluación de la calidad del servicio: Caracterización y análisis. Compendium 2015, 18, 57–76. [Google Scholar]
  9. Batista, J.M.; Coenders, G. Modelos de Ecuaciones Estructurales: Modelos para el Análisis de Relaciones Causales; Editorial La Muralla: Madrid, Spain, 2012. [Google Scholar]
  10. Ekinci, Y. The validation of the generic service quality dimensions: An alternative approach. J. Retail. Consum. Serv. 2001, 8, 311–324. [Google Scholar] [CrossRef]
  11. García-Grau, P.; Martínez-Rico, G.; McWillian, R.A.; Cañadas, M. Typical and Ideal Practices in Early Intervention in Spain During a Transformation Process of Professional Practices. J. Early Interv. 2019, 42, 3–19. [Google Scholar] [CrossRef]
  12. Robles-Bello, M.A.; Sánchez-Teruel, D. Early childhood intervention in Spain. Pap. Psicól. 2013, 34, 132–143. [Google Scholar]
  13. Boletín Oficial de la Junta de Andalucía. Boletín Número 81 de 29/04/2016. Available online: https://www.juntadeandalucia.es/boja/2016/81/2 (accessed on 28 March 2020).
  14. Dunst, C.J.; Trivette, C.M.; Hamby, D.W. Meta-analysis of family-centered helpgiving practices research. Ment. Retard. Dev. Disabil. Res. Rev. 2007, 13, 370–378. [Google Scholar] [CrossRef] [Green Version]
  15. Romero-Galisteo, R.P.; Moreno-Morales, N.; Blanco-Villaseñor, A.; Gálvez-Ruiz, P. Early intervention and perceived quality. Medicine 2019, 98, e15173. [Google Scholar] [CrossRef] [PubMed]
  16. Medina-Mirapeix, F. Percepción de los padres de la atención de fisioterapia recibida en centros de atención temprana. Rev. Aten. Temprana 2007, 10, 21–28. [Google Scholar]
  17. García, F.; Mirete, A.; Marín, C.; Romero, L. Satisfacción del cliente familia en atención temprana: Valoración de la importancia que otorgan a distintos aspectos del servicio. Siglo Cero 2008, 39, 35–54. [Google Scholar]
  18. Romero-Galisteo, R.P.; Morales-Sánchez, V.; Hernández-Mendo, A. Desarrollo de una herramienta para la evaluación de la calidad percibida en los centros de atención infantil temprana. An. Psicol. 2015, 31, 127–136. [Google Scholar] [CrossRef] [Green Version]
  19. Romero-Galisteo, R.P.; Morales-Sánchez, V.; Hernández-Mendo, A. Generalizabilidad y optimización en la evaluación de la calidad de los Centros de Atención Infantil Temprana (CAIT). Univ. Psychol. 2015, 14, 1009–1020. [Google Scholar] [CrossRef]
  20. Jemes, I.C.; Romero-Galisteo, R.P.; Labajos, M.T.; Moreno, N. Evaluación de la calidad de servicio en Atención Temprana: Revisión sistemática. An. Pediatr. 2019, 90, 301–309. [Google Scholar] [CrossRef]
  21. Shonkoff, J.P. Building a new biodevelopmental framework to guide the future of early childhood policy. Child Dev. 2010, 81, 357–367. [Google Scholar] [CrossRef] [Green Version]
  22. Bruder, M.B.; Dunst, C.J. Parental Judgments of Early Childhood Intervention Personnel Practices. Top. Early Child. Spec. 2015, 34, 200–210. [Google Scholar] [CrossRef]
  23. Popp, T.K.; You, H.-K. Family involvement in early intervention service planning: Links to parental satisfaction and self-efficacy. J. Early Child. Res. 2016, 14, 333–346. [Google Scholar] [CrossRef]
  24. Martínez, M.T.; Martínez, L. Promoción del desarrollo infantil y Atención Temprana: Calidad de los servicios. Azarbe Rev. Int. Trab. Soc. Bienestar. 2013, 2, 49–67. [Google Scholar]
  25. Martínez-Tur, V.; Sillo, J.M.P.; Ramos, J. Calidad de Servicio y Satisfacción del Cliente; Editorial Síntesis: Madrid, Spain, 2001. [Google Scholar]
  26. Chelladurai, P.; Chang, K. Targets and Standards of Quality in Sport Services. Sport Manag. Rev. 2000, 3, 1–22. [Google Scholar] [CrossRef]
  27. Jenaro, C.; Vega, V.; Flores, N.; Cruz, M. Quality of services and quality of life from service providers’ perspectives: Analysis with focus groups. J. Intellect. Dev. Dis. 2013, 57, 489–499. [Google Scholar] [CrossRef] [PubMed]
  28. Sims, M.; Waniganayake, M. The role of staff in quality improvement in early childhood. J. Educ. Train. Stud. 2015, 3, 187–194. [Google Scholar] [CrossRef] [Green Version]
  29. Roberge, D.; Tremblay, D.; Turgeon, M.E.; Berbiche, D. Patients’ and professionals’ evaluations of quality of care in oncology outpatient clinics. Support. Care Cancer 2013, 21, 2983–2990. [Google Scholar] [CrossRef]
  30. Comrey, A.L. A First Course in Factor Analysis; Academic Press: New York, NY, USA, 1973. [Google Scholar]
  31. Hair, J.; Black, W.; Babin, B.; Anderson, R. Multivariate Data Analysis, 7th ed.; Pearson Education: Upper Saddle River, NJ, USA, 2014. [Google Scholar]
  32. Del Barrio, S.; Luque, T. Análisis de ecuaciones estructurales. In Técnicas de Análisis de Datos en Investigación de Mercados; Luque, T., Ed.; Ediciones Pirámide: Madrid, Spain, 2000; pp. 489–557. [Google Scholar]
  33. Field, A. Discovering Statistics Using IBM SPSS Statistics, 5th ed.; SAGE Publications: Los Ángeles, LA, USA, 2009. [Google Scholar]
  34. Cronbach, L.J. Coefficient alpha and the internal structure of tests. Psychometrika 1951, 16, 297–334. [Google Scholar] [CrossRef] [Green Version]
  35. Streiner, D.L.; Norman, G.R.; Cairney, J. Health Measurement Scales: A Practical Guide to Their Development and Use, 4th ed.; Oxford University Press: New York, NY, USA, 2008. [Google Scholar]
  36. Tabachnick, B.G.; Fidell, L.S. Using Multivariate Statistics, 6th ed.; Pearson Education: Boston, MA, USA, 2013. [Google Scholar]
  37. Kline, R.B. Principles and Practice of Structural Equation Modeling, 2nd ed.; The Guilford Press: New York, NY, USA, 2005. [Google Scholar]
  38. Harrington, D. Confirmatory Factor Analysis; The Oxford University Press: New York, NY, USA, 2009. [Google Scholar]
  39. Fornell, C.; Larcker, D.F. Evaluating structural equation models with unobservable variables and measurement error. J. Mark. Res. 1981, 18, 39–50. [Google Scholar] [CrossRef]
  40. Kerlinger, F.N.; Lee, H.B. Investigación del Comportamiento, 4th ed.; McGraw-Hill: México City, México, 2002. [Google Scholar]
  41. Worthington, R.L.; Whittaker, T.A. Scale development research: A content analysis and recommendations for best practices. Couns. Psychol. 2006, 34, 806–838. [Google Scholar] [CrossRef]
  42. Nunnally, J.C.; Bernstein, I.H. Teoría Psicométrica, 3rd ed.; McGraw-Hill: México City, México, 1995. [Google Scholar]
  43. Bagozzi, R.P.; Yi, Y. On the evaluation of structural equation models. J. Acad. Mark. Sci. 1988, 16, 74–94. [Google Scholar] [CrossRef]
  44. Fisher, W.P.; Elbaum, B.; Coulter, W.A. Construction and validation of two parent-report scales for the evaluation of early intervention programs. J. Appl. Meas. 2012, 13, 57–76. [Google Scholar]
  45. Lillo-Navarro, C.; Montilla-Herrador, J.; Escolar-Reina, P.; Oliveira-Sousa, S.L.; García-Vidal, J.A.; Medina-Mirapeix, F. Factors Associated with Parents’ Adherence to Different Types of Exercises in Home Programs for Children with Disabilities. J. Clin. Med. 2019, 8, 456. [Google Scholar] [CrossRef] [Green Version]
  46. Horridge, K.A.; Dew, R.; Chatelin, A.; Seal, A.; Macías, L.M.; Cioni, G.; Kachmar, O.; Wilkes, S. Austerity and families with disabled children: A European survey. Dev. Med. Child Neurol. 2019, 61, 329–336. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  47. European Academy of Childhood Disability. Impact of Austerity on Disabled Children in Europe. 2017. Available online: http://www.eacd.org/documents-detail.php?id=45 (accessed on 9 July 2019).
  48. Palazón-Cabanes, B.; López-Picazo, J.J.; Morales-Ortiz, A.; Tomás-García, N. Identification of the factors conditioning times and indicators of quality in the intrahospital care of acute stroke. Rev. Neurol. 2016, 62, 157–164. [Google Scholar] [PubMed]
  49. Cunha, C.A.; Paz-Lourido, B. El enfoque de la calidad de vida familiar en la atención en salud: El caso de la Fisioterapia en Atención Temprana. Saúde Transform. Soc. 2010, 1, 20–27. [Google Scholar]
  50. Woodside, J.M.; Rosenbaum, P.L.; King, S.M.; King, G.A. Family-Centered Service: Developing and Validating a Self-Assessment Tool for Pediatric Service Providers. Child. Health Care 2001, 30, 237–252. [Google Scholar] [CrossRef]
  51. King, G.; Rosenbaum, P.; King, S. Parents’ perceptions of caregiving: Development and validation of a measure of processes. Dev. Med. Child Neurol. 1996, 38, 757–772. [Google Scholar] [CrossRef] [PubMed]
  52. Aytch, L.; Cryer, D.; Bailey, D.; Salz, L. Defining and assessing quality in early intervention programs for infants and toddlers with disabilities and their families: Challenges and unresolved issues. Early Educ. Dev. 1999, 18, 7–23. [Google Scholar] [CrossRef]
  53. Siebes, R.C.; Ketelaar, M.; Wijnroks, L. Van Schie, P.E.M.; Nijhuis, B.J.G.; Vermeer, A.; Gorter, J.W. Family-centred services in the Netherlands: Validating a self-report measure for paediatric service providers. Clin. Rehabil. 2006, 20, 502–512. [Google Scholar] [CrossRef]
  54. Siebes, R.C.; Nijhuis, B.J.G.; Boonstra, A.M.; Ketelaar, M.; Wijnroks, L.; Reinders-Messelink, H.A.; Postema, K.; Vermeer, A. A family-specific use of the Measure of Processes of Care for Service Providers (MPOC-SP). Clin. Rehabil. 2008, 22, 242–251. [Google Scholar] [CrossRef] [Green Version]
  55. Dyke, P.; Buttigieg, P.; Blackmore, A.M.; Ghose, A. Use of the Measure of Process of Care for families (MPOC-56) and service providers (MPOC-SP) to evaluate family-centred services in a paediatric disability setting. Child Care Health Dev. 2006, 32, 167–176. [Google Scholar] [CrossRef]
  56. Cerqueira, S.; Dessen, M.A.; Pérez-López, J. Evaluación de los servicios de atención a familias de niños con deficiencia. Perspectiva de familiares y profesionales en Brasil. An. Psicol. 2012, 28, 866–874. [Google Scholar] [CrossRef] [Green Version]
  57. Bigné, J.E.; Martínez, C.; Miquel, M.J.; Andreu, L. SERVQUAL reliability and validity in travel agencies. Ann. Tour. Res. 2003, 30, 258–262. [Google Scholar] [CrossRef]
  58. Morrison-Coulthard, L.J. A Review and Critique of Research Using Servqual. Int. J. Mark. Res. 2004, 46, 479–497. [Google Scholar] [CrossRef]
  59. Woo, K.S.; Lam, S.S.K. Measuring Service Quality: A Test-retest Reliability Investigation of Servqual. Int. J. Mark. Res. 1997, 39, 1–18. [Google Scholar] [CrossRef]
  60. McWilliam, R.A. Families in Natural Environments Scale of Service Evaluation II (FINESSE-II); Siskin Center for Child and Family Research: Chattanooga, TN, USA, 2011. [Google Scholar]
  61. Gafni-Lachter, L.R.; Josman, N.; Ben-Sasson, A. Evaluating change: Using the Measure of Processes of Care-Service Provider as an outcome measure for performance and confidence in family-centred care. Child Care Health Dev. 2019, 45, 592–599. [Google Scholar] [CrossRef]
  62. Kohli-Lynch, M.; Tann, C.J.; Ellis, M.E. Early Intervention for Children at High Risk of Developmental Disability in Low-and Middle-Income Countries: A Narrative Review. Int. J. Environ. Res. Public Health. 2019, 16, 4449. [Google Scholar] [CrossRef] [Green Version]
  63. Alcaraz, F.G.; Espín, A.A.; Martínez, A.H.; Alarcón, M.M. Diseño de Cuestionarios para la recogida de información: Metodología y limitaciones. Rev. Clin. Med. Fam. 2006, 1, 232–236. [Google Scholar]
  64. Bruder, M.B.; Dunst, C.; Maude, S.P.; Schnurr, M.; Van Polen, A.; Frolek Clark, G.; Gethmann, D. Practitioner Appraisals of Their Desired and Current Use of the 2014 Division for Early Childhood Recommended Practices. J. Early Interv. 2019. [Google Scholar] [CrossRef]
  65. Dunst, C.J.; Bruder, M.B. Early intervention service coordination models and service coordinator practices. J. Early Interv. 2006, 28, 155–165. [Google Scholar] [CrossRef]
Figure 1. Confirmatory factor analysis estimates of the 23-item questionnaire.
Figure 1. Confirmatory factor analysis estimates of the 23-item questionnaire.
Ijerph 17 02581 g001
Table 1. Sociodemographic characteristics of the participants.
Table 1. Sociodemographic characteristics of the participants.
Variablesn%Missing (%)
Gender 3 (0.9)
Male4112.7
Female28086.4
Age (years) 15 (4.6)
20–3012438.3
31–4011535.5
41–505115.7
>50195.9
Profession 14 (4.3)
Psychology8526.2
Physiotherapy8827.2
Speech Therapy7523.2
Occupational Therapist164.9
Others4614.2
Experience (months) 17 (5.2)
0–514043.2
6–107623.5
11–207222.2
>20195.9
Table 2. Internal consistency, descriptive analysis and correlations between dimensions.
Table 2. Internal consistency, descriptive analysis and correlations between dimensions.
DimensionsαM (SD)CFTRMQSITSI
Centre Facilities (CF)0.714.08 (0.71)1
Treatment Room and Material (TRM)0.833.96 (0.70)0.65 **1
Qualified Staff (QS)0.814.51 (0.48)0.38 **0.46 **1
Intervention (I)0.704.35 (0.66)0.35 **0.47 **0.71 **1
Technical or Specific Information (TSI)0.814.43 (0.54)0.37 **0.38 **0.66 **0.61 **1
Note. α = Cronbach alpha coefficient; M = Mean; SD = Standard Deviation; ** = p < 0.005.
Table 3. Mean, standard deviation, factor loadings in exploratory factor analysis (EFA), confirmatory factor analysis (CFA) and homogeneity index corrected (HIc).
Table 3. Mean, standard deviation, factor loadings in exploratory factor analysis (EFA), confirmatory factor analysis (CFA) and homogeneity index corrected (HIc).
Dimensions and ItemsM (SD)EFACFAHic
Centre Facilities
1. The centre is well located geographically4.27 (0.95)0.8250.6430.266
3. The cleaning of the centre is adequate4.05 (1.23)0.6520.6100.471
4. The centre facilities are comfortable4.03 (0.95)0.8490.8030.636
5. The facilities have the correct signalling3.99 (1.06)0.6330.6940.544
Treatment room and material
6. The number of treatment rooms is enough3.72 (1.17)0.7240.5840.514
7. The treatment rooms are large enough4.10 (1.03)0.7290.6790.570
8. The materials that are used in the centre are suitable3.92 (0.92)0.8260.7090.745
9. The materials are in good condition for use4.05 (0.85)0.7630.7070.654
10. The working material used in the centre is sufficient3.58 (1.03)0.8020.5450.612
11. The materials that are used in the treatment rooms are safe4.44 (0.71)0.6440.7510.566
Qualified staff
12. The attention paid to users at the centre is adequate4.51 (0.62)0.6000.7710.628
14. The attention paid to users at the centre is sufficient4.14 (0.79)0.5400.7290.568
15. The qualified staff have the necessary knowledge4.51 (0.69)0.6340.6710.576
16. The qualified staff are accessible4.72 (0.56)0.7680.6210.613
17. The specialised staff have a close relationship with the users4.79 (0.48)0.7550.5650.563
19. The qualified staff are coordinated with one another to improve and complete the user’s service4.43 (0.81)0.7600.6670.542
Intervention
20. The specialised staff of the centre are coordinated with other services to improve and complete the user’s service4.37 (0.80)0.7490.6470.543
21. The activities carried out with the user seem appropriate4.34 (0.70)0.6840.7390.543
Technical or specific information
22. The activities proposed to work with the user outside of the centre are feasible4.00 (0.96)0.6790.7920.672
23. The information received at the beginning of the treatment is consistent with the tasks performed subsequently4.46 (0.69)0.6790.7920.672
24. The families are given instructions/programs to work with the user outside of the centre4.56 (0.66)0.7790.6400.651
25. The centre provides a report (oral/written) about the progress of the user4.58 (0.67)0.8090.6180.574
26. The information given about the user is clear4.59 (0.57)0.7650.7560.660
Note. M = Mean; SD = Standard deviation; EFA = Exploratory factor analysis; CFA = Confirmatory factor analysis; Hic = Homogeneity index corrected.
Table 4. Composite reliability, average variance extracted and discriminant validity.
Table 4. Composite reliability, average variance extracted and discriminant validity.
DimensionsCRAVECFTRMQSITSI
Centre Facilities (CF)0.800.501
Treatment Room and Material (TRM)0.860.510.4381
Qualified Staff (QS)0.850.510.2280.4971
Intervention (I)0.760.610.2340.4330.3551
Technical or Specific Information (TSI)0.830.520.1990.2620.4750.4041
Note. CR = Composite Reliability; AVE = Average Variance Extracted.

Share and Cite

MDPI and ACS Style

Jemes-Campaña, I.-C.; Romero-Galisteo, R.-P.; Labajos-Manzanares, M.-T.; Gálvez-Ruiz, P.; Moreno-Morales, N. The Inventory of Quality in Early Intervention Centres for Service Providers: Preliminary Validating Study in a Spanish Sample. Int. J. Environ. Res. Public Health 2020, 17, 2581. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph17072581

AMA Style

Jemes-Campaña I-C, Romero-Galisteo R-P, Labajos-Manzanares M-T, Gálvez-Ruiz P, Moreno-Morales N. The Inventory of Quality in Early Intervention Centres for Service Providers: Preliminary Validating Study in a Spanish Sample. International Journal of Environmental Research and Public Health. 2020; 17(7):2581. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph17072581

Chicago/Turabian Style

Jemes-Campaña, Inmaculada-Concepción, Rita-Pilar Romero-Galisteo, María-Teresa Labajos-Manzanares, Pablo Gálvez-Ruiz, and Noelia Moreno-Morales. 2020. "The Inventory of Quality in Early Intervention Centres for Service Providers: Preliminary Validating Study in a Spanish Sample" International Journal of Environmental Research and Public Health 17, no. 7: 2581. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph17072581

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop