Next Article in Journal
High Concentration of Heavy Metal and Metalloid Levels in Edible Campomanesia adamantium Pulp from Anthropic Areas
Next Article in Special Issue
The Risk of Hospitalization in COVID-19 Patients Can Be Predicted by Lung Ultrasound in Primary Care
Previous Article in Journal
Australian Smokers’ Sensory Experiences and Beliefs Associated with Menthol and Non-Menthol Cigarettes
Previous Article in Special Issue
Missing Diagnoses during the COVID-19 Pandemic: A Year in Review
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Adjusting Client-Level Risks Impacts on Home Care Organization Ranking

1
Institute of Health Sciences, ZHAW Zurich University of Applied Sciences, Katharina-Sulzer-Platz 9, 8401 Winterthur, Switzerland
2
Department of Health Sciences and Medicine, University of Lucerne, Frohburgstrasse 3, 6002 Lucerne, Switzerland
3
Medical Faculty, University of Basel, Klingelbergstrasse 61, 4056 Basel, Switzerland
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2021, 18(11), 5502; https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph18115502
Submission received: 15 April 2021 / Revised: 16 May 2021 / Accepted: 17 May 2021 / Published: 21 May 2021
(This article belongs to the Special Issue Primary Healthcare)

Abstract

:
Quality indicators (QIs) based on the Resident Assessment Instrument-Home Care (RAI-HC) offer the opportunity to assess home care quality and compare home care organizations’ (HCOs) performance. For fair comparisons, providers’ QI rates must be risk-adjusted to control for different case-mix. The study’s objectives were to develop a risk adjustment model for worsening or onset of urinary incontinence (UI), measured with the RAI-HC QI bladder incontinence, using the database HomeCareData and to assess the impact of risk adjustment on quality rankings of HCOs. Risk factors of UI were identified in the scientific literature, and multivariable logistic regression was used to develop the risk adjustment model. The observed and risk-adjusted QI rates were calculated on organization level, uncertainty addressed by nonparametric bootstrapping. The differences between observed and risk-adjusted QI rates were graphically assessed with a Bland-Altman plot and the impact of risk adjustment examined by HCOs tertile ranking changes. 12,652 clients from 76 Swiss HCOs aged 18 years and older receiving home care between 1 January 2017, and 31 December 2018, were included. Eight risk factors were significantly associated with worsening or onset of UI: older age, female sex, obesity, impairment in cognition, impairment in hygiene, impairment in bathing, unsteady gait, and hospitalization. The adjustment model showed fair discrimination power and had a considerable effect on tertile ranking: 14 (20%) of 70 HCOs shifted to another tertile after risk adjustment. The study showed the importance of risk adjustment for fair comparisons of the quality of UI care between HCOs in Switzerland.

1. Introduction

In Switzerland, as in many other countries, healthcare is under increased scrutiny to enhance the quality and safety of patients. While quality measures for hospital-based care are well established and publicly reported, reliable and accessible information on the quality of home care is lacking [1]. This gap is ever more pronounced, because home care is becoming increasingly important due to an ageing population and a rise in prevalence of chronic conditions.
The Swiss healthcare system is highly decentralized with 26 cantons (federal states) and 2352 municipalities [2]. Home care is organized according to the canton and municipal policy and services are provided by nonprofit and private home care organizations (HCOs) as well as self-employed nursing professionals. In 2019, almost 395,000 persons (4.6% of the total population) received home care, with 80% of clients receiving services from nonprofit HCOs [3]. HCOs in Switzerland vary in size and range from small rural to large urban organizations. Nonprofit HCOs tend to be larger than private HCOs partly due to concentration processes to increase efficiency [4]. Home care aims at maintaining and stimulating the autonomy of the client and comprises nursing services as well as household tasks. Depending on the region and organization, other services such as home care for children, palliative care, and meal service are provided [5]. Responsibility for home care services lies at the level of the cantons or municipalities. Accordingly, local governments formulate a performance mandate for nonprofit HCOs to ensure help and care at home. HCOs with a performance mandate have the obligation to provide services to all clients and therefore cannot refuse clients [4].
National data on home care quality does not exist in Switzerland, although there is a legal basis that obliges providers to report data on clinical quality indicators (QIs) to the respective federal authorities [6]. The law is not being implemented due to a lack of knowledge which home care QIs are appropriate to measure quality of home care. To date, the only existing home care QIs are outcome indicators based on the Resident Assessment Instrument-Home Care (RAI-HC) Schweiz, an instrument widely used in Switzerland and internationally for home care planning. The validity and reliability of the RAI-HC have been tested in several studies showing overall good results [7,8,9,10]. The Swiss RAI-HC QIs have so far only been used for internal quality improvement processes. However, in a recent QI evaluation study [11,12], the indicators were examined for their appropriateness for national quality measurement.
Since health outcomes are not only a function of quality of care but also depend on the health status of patients [13], fair national comparisons of home care quality require risk adjustment that statistically accounts for differences in the mix of clients’ risk across HCOs [14]. Therefore, risk adjustment makes comparisons of outcomes across providers more meaningful [14]. Two main approaches to risk adjustment are found in the literature: stratification and indirect standardization [15,16,17]. Older risk adjustment approaches for QIs used stratification, i.e., stratifying the population by a risk factor (e.g., age, sex) and calculating QIs separately within each group, considering only one risk factor at a time [17]. A strength of stratification is computational simplicity; however, the approach is problematic when providers do not have enough cases to produce reliable and stable estimates of QI rates within each risk group [15]. Contemporary risk adjustment often uses indirect standardization applying regression models to derive estimates of an individual client’s likelihood of experiencing an outcome [17]. Based on the predicted values, expected QI rates are generated and compared to observed QI rates, e.g., by calculating the observed-to-expected ratio (O/E ratio) [16,18]. An advantage of indirect standardization is that multiple risk factors are taken into account simultaneously in the adjustment process, in contrast to stratification [17]. The identification of risk factors is relevant in each approach, including the description of the clinical relationship of the factor with the measured outcome and whether the factors can be influenced by providers [16,19]. However, it is important not to adjust for factors that reflect poor quality of care [16,20].
While risk adjustment for international RAI-HC QIs has been investigated in a few studies [21,22,23], risk adjustment for the Swiss RAI-HC QI has rarely been examined. The only study conducted in 2015 using indirect standardization was limited by small sample size, resulting in risk adjustment models with poor performance [24]. The risk adjustment approach developed for RAI-HC QIs is based on stratification and regression modelling within each strata [23]. This approach is not applicable to the Swiss home care setting as Switzerland uses an adapted and shorter version of the RAI-HC and comparatively Swiss HCOs are smaller resulting in smaller sample sizes.
Since 2016, the database HomeCareData (HCD) [25,26] has been in existence for calculating Swiss RAI-HC QIs. HCD centralizes client-level data collected with the RAI-HC and is currently the only register in Switzerland that contains client-level home care data. The database is still in the development phase, but the number of data suppliers is constantly growing. In 2020, 104 of about 400 nonprofit HCOs transmitted data to HCD [25].
In this study, we explore the potential and the limitations of HCD for risk adjustment of the Swiss RAI-HC QIs by taking the outcome “worsening or onset of urinary incontinence (UI)”, measured with the RAI-HC QI bladder incontinence, as an exemplary QI. We chose the QI bladder incontinence because UI implies a substantial economic burden for the health care system and is a major health problem for home care clients with a profound influence on physical and psychosocial well-being [27,28]. Furthermore, the QI addresses not only a relevant outcome but also a common quality problem. Worsening or onset of UI affects 11% of Swiss home care clients, and QI rates vary considerably between HCOs [29]. Nevertheless, UI is preventable and treatable. Evidence-based guidelines for the management of UI in older adults indicate that behavioral interventions (e.g., bladder training, pelvic floor exercises) and pharmacotherapy can reduce UI [30,31]. Therefore, home care nurses can play a pivotal role in the quality of UI care [32]. The manuscript presents results on the development of the risk adjustment model for the QI bladder incontinence using HCD data and the impact of risk adjustment on quality rankings of HCOs.

2. Materials and Methods

2.1. Study Data

The study uses the HCD [25,26], a database centralizing client-level data collected with the RAI-HC in Switzerland. The transmission of data by nonprofit HCOs to HCD is not mandatory; therefore, the register only contains data from 76 of 392 nonprofit HCOs (as of 2018). RAI-HC assessments are conducted by home care nurses at client intake and then every three to six months or when there is a significant change in clients’ health status. Thus, it is possible to follow clients over time and assess changes in health status, such as the worsening or onset of UI. HCD contains some socio-demographic data, clinical data as well as information on care needs and planned services. For this study, we extracted and cleaned HCD data from 1 January 2017 to 31 December 2018. We excluded home care clients younger than 18 years old and clients who had only one RAI-HC assessment in the selected time span because two assessments are needed to measure change in UI. In addition, we excluded clients who were terminally ill since QI bladder incontinence was not developed for clients with palliative care needs.

2.2. Construction of the Quality Indicator

The outcome for our model was the RAI-HC QI bladder incontinence, i.e., worsening or onset of UI. Worsening or onset of UI was measured with the variable “Bladder incontinence–ability to control the bladder in the last 3 days” (continent/continent with catheter or stoma/mostly incontinent/incontinent with residual control/incontinent). Based on the UI status in two assessments (pre-assessment and follow-up assessment), we constructed a dichotomous variable and categorized clients in two groups: Group one comprises clients that experienced worsening or onset of UI between the assessments (variable set to 1) and clients experienced no change or improvement in UI (variable set to 0).
The QI is described with a numerator (number of clients with the outcome) and denominator (number of clients at risk for the outcome and not otherwise excluded from the QI), i.e., it expresses a rate of home care clients that experienced worsening or onset of UI. The higher the QI rate, the more clients experienced worsening or onset of UI. Table 1 describes the QI. The QI is measured over one calendar year, i.e., for each client, we selected the most recent follow-up assessment in 2018 and its pre-assessment. The interval between the two assessments had to be no less than 30 days and no more than 365 days, otherwise, the case was excluded.

2.3. Identification and Construction of Risk Factors

We identified potential client-level risk factors associated with worsening or onset of UI by conducting a non-systematic literature review in the electronic databases PubMed and CINAHL. An overview of the identified risk factors is reported in Appendix A. Risk factors were considered for the modelling of risk adjustment if they were available in the HCD and not influenceable by the provider. The risk factors were constructed from data reported in the pre-assessment reflecting the clients’ health status before the potential worsening or onset of UI.
The following risk factors were included in the model: age (18–64, 65–79, ≥80), sex (female/male), body mass index (BMI, <25 kg/m2, 25–29.9 kg/m2, ≥30 kg/m2), daily smoking (yes/no), Cognitive Performance Scale (CPS, scale of 0–3) [33], Activities of Daily Living (ADL) index (includes “bed movement”, “transferring”, “toilet use”, and “eating”) [34], impairment in locomotion (yes/no), impairment in personal hygiene (yes/no), impairment in bathing (yes/no), unsteady gait (yes/no), Instrumental Activities of Daily Living (IADL) scale (includes “meal preparation”, “general housework”, “manage money”, “handling medication”, “making a call”, and “shopping”; scale of 0–6) [34], Depression Rating Scale (DRS, scale of 0–3) [35], bowel incontinence (yes/no), hospitalization in the last 90 days (yes/no) and type of pre-assessment (intake/significant change in health status/regular follow-up) as proxy measures of deterioration of health status, and time between assessments (30–180 days/181–365 days).

2.4. Statistical Analysis

In this study, we applied the risk adjustment approach of indirect standardization [16,18], which involved the following steps: first, the development of a risk adjustment model that allows the prediction of QI rates. Second, the generation of observed (O) and (model-predicted) expected QI rates (E) to calculate the O/E ratio, which was then multiplied by the total QI rate (client population mean) to obtain risk-adjusted QI rates. The procedure is described in more detail below.
Logistic regression was used to develop a risk adjustment model for the outcome worsening or onset of UI. We randomly split the dataset into a development dataset (80% of cases, n = 10,122 clients) and validation dataset (20% of cases, n = 2530 clients). The models (and the QI rates) were constructed using the development dataset and the accuracy of the selected model was assessed using the validation data set. We performed exploratory univariate analyses of the associations between each potential risk factor and worsening or onset of UI, followed by multivariable logistic regression analysis predicting the probability of worsening or onset of UI for each home care client, conditional on his/her risk at the pre-assessment. Variables with a p value ≤ 0.25 in univariate analyses were included in the multivariable model. First, we performed a full model including all risk factors, followed by a reduced model, in which risk factors that were non-significant (p > 0.1) were excluded. Model performance of both models was tested using the concordance statistic (c-statistic) for discriminative ability [36]. The Akaike Information Criterion (AIC) [37] was calculated to compare the full and reduced model and to select the best-fit model, which was the reduced model. This model we applied to the validation data to assess the discriminatory performance of the model in the validation data set via the c-statistic.
After fitting the logistic regression model, we calculated the risk-adjusted QI rates based on the development data set for the HCOs. We restricted the calculations to HCOs with ten or more cases in the denominator to obtain relatively stable estimates. For each HCO, we computed the actual observed QI rate (O = number of clients with worsening or onset of UI/number of clients treated) and the expected QI rate, adjusted for the case-mix (E = total sum of predicted worsening or onset of UI/number of clients treated). The risk-adjusted rate was determined as the ratio of observed-to-expected rate (O/E ratio) multiplied by the total QI rate (client population mean) [18,22]. Such risk-adjusted QI rates show which QI rates would have been obtained if all HCOs would have the same client mix. Thus, the QI rates are directly comparable [38].
To estimate uncertainty in the risk-adjusted QI rates, we used nonparametric bootstrapping considering the nesting of the clients in the HCOs. We created 10,000 samples and gained an estimate of the empirical distribution of the risk-adjusted QI rates on organization level. The distribution limits were calculated at the 2.5% and 97.5% percentiles to generate 95% confidence intervals (CIs) for the risk-adjusted QI rates for each HCO. The 95% CIs were compared to the total QI rate (client population mean) to assess which HCOs were statistically different.
We explored the difference between observed and risk-adjusted QI rates graphically using a Bland-Altman plot [39]. In the Bland-Altman plot, the difference between the observed and risk-adjusted QI rates is plotted against the average of the two measurements. Furthermore, we ranked the HCOs by observed and risk-adjusted QI rates and then split observed and adjusted QI rates into tertiles. We assessed the change in tertile rank after risk adjustment, i.e., we examined the number of HCOs that shifted to a better or worse tertile. We chose tertiles because the ranking in three groups assigned to three performing levels (high, middle, low) is easy to interpret and thus meaningful to HCOs and clients [40,41]. All statistical analyses were completed using Stata Version 15 (StataCorp LLC, College Station, TX, USA).

3. Results

3.1. Sample Characteristics

In total, 12,652 home care clients from 76 HCOs were included in the study, i.e., they had at least two RAI-HC assessments of which the follow-up was conducted in 2018. 87.7% of the clients were aged 65 years and older with a mean age (SD) in the overall sample of 79.5 (12.9) years and 63.9% of the clients were female (Table 2). 28.6% of the clients were urinary incontinent (women 32.0%, men 22.5%) in the pre-assessment. 10.7% of the clients experienced worsening or onset of UI from the pre-assessment to follow-up assessment.
QI rates on organization level were calculated for 70 of the 76 HCOs because six HCOs had less than ten cases in the denominator, i.e., provided services to less than ten clients, and were excluded. The 70 HCOs are from 20 (of 26) cantons, represent three language regions of Switzerland (German, French, and Italian speaking parts), and provided care to an average of 144 clients (SD 247, Min. 10, Max. 1915). Characteristics of the HCOs are reported in Appendix B.

3.2. Risk Adjustment Model

The multivariable logistic regression yielded a model with eight significant (p ≤ 0.05) client-level predictors of worsening or onset of UI (Table 3): older age, female sex, obesity, impairment in cognition, impairment in hygiene, impairment in bathing, unsteady gait, and hospitalization. In the model, “type of pre-assessment” showed a non-significant association. The model achieved a c-statistic of 0.658 (CI 0.638–0.673). The c-statistic in the validation data set was not significantly different with a value of 0.685 (CI 0.653–0.716).

3.3. Risk-Adjusted Quality Indicator Rates

Figure 1 displays the 70 HCOs ranked by their risk-adjusted QI rates and 95% CIs from the bootstrap resampling distribution. The 95% CIs are relatively large and influenced by the denominator size, i.e., the case number (clients) of the HCO. Large HCOs with relatively high case numbers have narrower CIs than small HCOs with low case numbers. The graph indicates that 12 (17,1%) of the 70 HCOs are statistically different from the average, as their CIs do not intersect the client population mean (total QI rate). HCOs with 95% CIs below the total QI rate (blue line) have better than average quality performance, and vice versa.

3.4. Comparison of Observed and Risk-Adjusted Quality Indicator Rates

The observed QI rates ranged from 0% to 26.92% (mean = 11.70%, SD = 5.44, IQR = 7.69–14.62) and the risk-adjusted QI rates ranged from 0% to 26.67% (mean = 11.65%, SD = 5.04, IQR = 8.28–13.92).
The Bland-Altman plot was used to explore graphically the differences between the observed and risk-adjusted QI rates (Figure 2). The mean difference between the observed and risk-adjusted QI rates is 0.05% with 95% limits of agreement (mean ± 2 SD) of −3.03% to 3.13%. The plot shows that six (8.57%) of 70 HCOs fall outside the 95% limits of agreement (four HCO above and two HCO below the lower 95% limit) and are outliers.
The HCOs were ranked based on the observed and risk-adjusted QI rates and then grouped into tertiles. 14 (20%) of 70 HCOs shifted into another tertile after risk adjustment, of which seven HCOs shifted to a lower tertile (i.e., better performance) and seven HCOs to a higher tertile (i.e., worse performance). Four (16.7%) of 24 HCOs in the lower tertile shifted into the middle tertile. Three (13.0%) of 23 HCOs in the middle tertile shifted into the upper tertile after risk adjustment, and four (17.4%) shifted into the lower tertile. Three (13.0%) of 23 HCOs in the upper tertile shifted into the middle tertile after risk adjustment.

4. Discussion

In this study, we developed a risk adjustment model based on HCD data taking RAI-HC QI bladder incontinence as an exemplary QI. The model yielded eight risk factors significantly associated with worsening or onset of UI and met statistical standards of goodness-of-fit. Risk adjustment demonstrated substantial impact on quality rankings of HCOs. One of five HCOs shifted to another tertile after risk adjustment, i.e., without adjusting for case-mix, the tertile ranking of 20% of 70 HCOs would have been incorrect, either too high or too low.
These findings indicate the importance for risk-adjusting the QI bladder incontinence for fair comparisons of quality of UI care between HCOs. It must be noted that different ranking methods can yield different results. The impact of risk adjustment on HCOs ranking would have been larger if we have chosen to divide the organizations into more intervals than tertiles, as less change would have been needed to shift to another group. Deutscher et al. [41], for example, analyzed the impact of risk adjustment on rankings of outpatient clinics and categorized the clinics in deciles as well as three distinct quality groups. They found that 70% of clinics changed decile rank and 31% shifted to another quality group following risk adjustment [41].
Furthermore, it must be pointed out that the HCO ranking does not inform on actual quality of home care with respect to UI. The ranking presents the relative QI performance among the HCOs and with respect to the client population mean (total QI rate). An established benchmark of best practice or standards for quality of home care for the QI bladder incontinence are currently lacking in Switzerland and also internationally [1,42]. Thus, it remains unclear, even after risk-adjustment, which QI rate corresponds to high quality care or potential care problems. For nursing home QIs, Hjaltadóttir et al. [43] developed thresholds indicating areas of good and poor care in Iceland. Together with an expert panel, she defined for the QI “bladder or bowel incontinence” a lower threshold and an upper threshold, 35.4% and 64.3% respectively. Such thresholds (or reference ranges within the benchmark) must also be defined for the Swiss RAI-HC QIs to provide organizations with quality aims and indications of the quality of care they provide. According to Rantz et al. [44], thresholds are also relevant on a public health level to reinforce excellent performance (e.g., with pay-for-performance programs) and flag potential problem areas.
In our study, the impact of risk adjustment on organization level was substantial. To our knowledge, no other study has investigated the impact of risk adjustment of the RAI-HC QI bladder incontinence on HCO rankings with the similar rigor. Schaffert and Staub [24], for example, developed risk adjustment models for several Swiss RAI-HC QIs in 2015 without addressing the QI specific risk factors, resulting in poor performance of the models. Internationally, research has been conducted on regional and national level comparing observed and risk-adjusted RAI-HC QIs [21,22,23,45,46,47]. Overall, and similar to our results on organization level, the findings showed moderate effects of risk adjustment, mostly slightly reducing differences in QI rates between regions or countries. In addition, we cannot compare the performance of our risk adjustment model because the studies that looked at developing risk adjustment models for RAI-HC QIs [21,22,23] did not publish the logistic regression models or information on the statistical performance of the models.

4.1. Strength and Limitations

This study contributes to the sparse literature on risk adjustment methods for RAI-HC QIs by developing a risk adjustment model for the RAI-HC QIs bladder incontinence and highlighting the impact of risk adjustment on rankings. One of the main strengths of this study is that prior to statistical modelling, we identified client-level risk factors for worsening or onset of UI in the scientific literature and illustrated the clinical relationship of the factors with UI. In addition, to prevent over-adjustment, i.e., unwittingly adjust away poor care practice, we carefully considered for each potential risk factor whether it was truly a measure of risk or a condition that home care nurses could influence by providing appropriate care [22]. For example, we chose to exclude the risk factors’ delirium and obstipation because evidence-based guidelines indicate that nurses can adequately manage these health problems [48,49] and that these factors therefore rather reflect poor care quality than risks. It is, however, debatable which factors can be influenced by nurses and to what extent, especially in home care, characterized by less control over outcomes than institutional care in hospitals or nursing homes [50].
A general limitation of this study was data availability. While we purposefully excluded some risk factors, other factors could not be operationalizable with the HCD data due to missing items (e.g., medication) or open text fields (e.g., diagnoses, environmental barriers) in the Swiss RAI-HC. This is a limitation of our model, because diagnoses and comorbidity are commonly included in risk adjustment models [16,19] and scientific evidence shows that neurological diseases and diabetes mellitus significantly increase the risk of developing UI [51,52,53]. We believe that the inclusion of such predictors in the risk adjustment model would most likely result in a model with an even better performance.
Further, a selection bias may have occurred since our sample consisted only of data from 76 (19.4%) of 392 nonprofit HCOs in 2018, which limits the generalization of the results and implies cautious interpretation.

4.2. Implication for Research and Policy

While this study has shown that the database HCD yields the potential for thorough risk adjustment of the RAI-HC QIs, lack of routine data of high quality are crucial limitations [1]. Due to the implementation of the interRAI-HC in Switzerland (longer version of the RAI-HC) in 2020, an increase in HCD data suppliers and improved data quality are expected. Future research on the risk adjustment of the QI bladder incontinence should examine further development of the risk adjustment model by including additional risk factors collected with the new interRAI-HC. Furthermore, a comprehensive national effort is needed to improve data on the quality in home care and to establish a national register comprising representative home care data [1].
On a policy level, efforts are needed to define a home care QI set for publicly reporting. The statutory mandate to measure quality of health care lies with the Federal Office of Public Health (FOPH), as well as the decision on which home care QIs shall be reported. In this paper, we only investigated one RAI-HC QIs. However, quality is a multidimensional concept and home care quality should be reflected with a large number of indicators [42,54]. Although it requires considerable effort as well as clinical and methodological knowhow [55], we highly recommend to publicly report a set of different risk-adjusted QIs and to develop evidence-based risk adjustment models following the steps presented in this paper. Finally, a solution should be found on how to include very small HCOs in future national reporting and ranking.

5. Conclusions

The HCD database was suitable for the development of an evidence-based risk adjustment model, but showed limitations in terms of risk factors’ availability and representativeness. Risk adjustment had a substantial impact on the tertile ranking of HCOs, which underlines the need for evidence-based risk adjustment for fair comparisons of the quality of UI care in home care in Switzerland.

Author Contributions

Conceptualization, A.W., J.D. and R.S.; methodology, A.W., J.D. and R.S.; formal analysis, A.W.; writing—original draft preparation, A.W.; writing—review and editing, A.W., J.D. and R.S.; visualization, A.W.; supervision, J.D.; project administration, A.W.; funding acquisition, J.D. All authors have read and agreed to the published version of the manuscript.

Funding

The research was funded by the Swiss National Science Foundation (SNSF), National Research Program 74 ‘Smarter Health Care’, Project “Swiss Home Care Data: patient profiles and quality measures for home care” (grant no. 167499).

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Cantonal Ethics Committee of the Canton of Zurich, Switzerland (BASEC-Nr. Req-2017-00054, 30.01.2017).

Informed Consent Statement:

Patient consent was waived due to the use of anonymized registry data.

Data Availability Statement

The data are not available due to legal restrictions.

Acknowledgments

The authors would like to thank Armin Gemperli and Thomas Volken for their help in conducting the statistical analysis.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Figure A1. Risk factors of urinary incontinence identified in the scientific literature. Risk factors marked in green were operationalized using the database HomeCareData. Risk factors marked in blue could not be operationalized based on the available data and risk factors marked in grey were factors influenceable by the provider and therefore not suitable for risk adjustment. Abbreviations: ADL, Activities of daily living; BMI, Body Mass Index; IADL, Instrumental activities of daily living; DRS, Depression Rating Scale; CPS, Cognitive Performance Scale.
Figure A1. Risk factors of urinary incontinence identified in the scientific literature. Risk factors marked in green were operationalized using the database HomeCareData. Risk factors marked in blue could not be operationalized based on the available data and risk factors marked in grey were factors influenceable by the provider and therefore not suitable for risk adjustment. Abbreviations: ADL, Activities of daily living; BMI, Body Mass Index; IADL, Instrumental activities of daily living; DRS, Depression Rating Scale; CPS, Cognitive Performance Scale.
Ijerph 18 05502 g0a1

Appendix B

Table A1. Number of home care organizations in the study sample (n = 70), by size.
Table A1. Number of home care organizations in the study sample (n = 70), by size.
HCO SizeNumber of HCOsAdjusted QI Rate
10–50 clients22 (31%)12.9 %
51–150 clients31 (44%)11.5%
>150 clients17 (24%)10.3 %
Abbreviations: HCO, home care organization.
Table A2. Number of home care organizations in the study sample (n = 70), by canton.
Table A2. Number of home care organizations in the study sample (n = 70), by canton.
CantonTotal of Nonprofit HCOs Number of HCOs in the Study Sample
Aargau488 (17%)
Appenzell Outer-Rhodes42 (50%)
Appenzell Inner-Rhodes21 (50%)
Basel21 (50%)
Basel District175 (29%)
Bern497 (14%)
Fribourg74 (57%)
Geneva21 (50%)
Glarus40 (0%)
Grisons 192 (11%)
Jura11 (100%)
Lucerne294 (14%)
Neuchâtel 10 (0%)
Nidwalden11 (100%)
Obwalden10 (0%)
Schaffhausen72 (29%)
Schwyz100 (0%)
Solothurn263 (12%)
St. Gallen486 (13%)
Ticino 74 (57%)
Thurgau227 (32%)
Uri11 (100%)
Vaud70 (0%)
Valais 50 (0%)
Zug11 (100%)
Zurich719 (13%)
Total39270 (18%)
Data sources: HomeCareData 2017–2018 [26], Spitex Statistik Schweiz 2018 [3] Abbreviations: HCO, home care organization.

References

  1. Vincent, C.; Staines, A. Enhancing the Quality and Safety of Swiss Healthcare. Available online: https://www.bag.admin.ch/bag/de/home/versicherungen/krankenversicherung/qualitaetsentwicklung-schweiz.html (accessed on 20 February 2021).
  2. Quentin, W.; Busse, R. The strongly decentralized Swiss Health System achieves good results: Past research has addressed persisting challenge—But more is encouraged. Health Policy 2018, 122, 565–567. [Google Scholar] [CrossRef] [PubMed]
  3. Bundesamt für Statistik. Hilfe Und Pflege Zu Hause. Available online: https://www.bfs.admin.ch/bfs/de/home/statistiken/gesundheit/gesundheitswesen/hilfe-pflege-hause.html (accessed on 10 February 2021).
  4. Gmür, R.; Steiner, P. Spitex. In Gesundheitswesen Schweiz, 2015–2017: Eine aktuelle Übersicht; Oggier, W., Ed.; Hogrefe Verlag GmbH & Co. KG: Bern, Switzerland, 2015; pp. 413–424. ISBN 978-3-456-85441-0. [Google Scholar]
  5. Spitex Schweiz. Einsatz Der Spitex. Available online: https://www.spitex.ch/Nonprofit-Spitex/Einsatz-der-Spitex/PZP9s/ (accessed on 10 February 2021).
  6. Die Bundesversammlung der Schweizerischen Eidgenossenschaft. Bundesgesetz Über Die Krankenversicherung (KVG). Available online: https://www.admin.ch/opc/de/classified-compilation/19940073/index.html (accessed on 1 November 2020).
  7. Morris, J.N.; Fries, B.E.; Steel, K.; Ikegami, N.; Bernabei, R.; Carpenter, G.I.; Gilgen, R.; Hirdes, J.P.; Topinková, E. Comprehensive clinical assessment in community setting: Applicability of the MDS-HC. J. Am. Geriatr. Soc. 1997, 45, 1017–1024. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  8. Hirdes, J.P.; Ljunggren, G.; Morris, J.N.; Frijters, D.H.; Finne Soveri, H.; Gray, L.; Björkgren, M.; Gilgen, R. Reliability of the InterRAI Suite of Assessment Instruments: A 12-Country Study of an Integrated Health Information System. BMC Health Serv. Res. 2008, 8, 277. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  9. Poss, J.W.; Jutan, N.M.; Hirdes, J.P.; Fries, B.E.; Morris, J.N.; Teare, G.F.; Reidel, K. A review of evidence on the reliability and validity of minimum data set data. Healthc. Manag. Forum 2008, 21, 33–39. [Google Scholar] [CrossRef]
  10. Hogeveen, S.E.; Chen, J.; Hirdes, J.P. Evaluation of Data Quality of InterRAI Assessments in Home and Community Care. BMC Med. Inform. Decis. Mak. 2017, 17, 150. [Google Scholar] [CrossRef]
  11. Wagner, A.; Zúñiga, F.; Rüesch, P.; Schaffert, R.; Dratva, J.; on behalf of the HCD Research Group. Selecting home care quality indicators based on the resident assessment instrument-home care (RAI-HC) for Switzerland: A Public Health and Healthcare Providers’ Perspective. PLoS ONE 2020, 15, e0244577. [Google Scholar] [CrossRef]
  12. Wagner, A.; Schaffert, R.; Möckli, N.; Zúñiga, F.; Dratva, J. Home care quality indicators based on the Resident Assessment Instrument-Home Care (RAI-HC): A systematic review. BMC Health Serv. Res. 2020, 20, 366. [Google Scholar] [CrossRef]
  13. Mukamel, D.B.; Glance, L.G.; Li, Y.; Weimer, D.L.; Spector, W.D.; Zinn, J.S.; Mosqueda, L. Does risk adjustment of the cms quality measures for nursing homes matter? Med. Care 2008, 46, 532–541. [Google Scholar] [CrossRef] [Green Version]
  14. Iezzoni, L.I. Reasons for risk adjustment. In Risk Adjustment for Measuring Health Care Outcomes; Iezzoni, L.I., Ed.; Health Administration Press: Chicago, IL, USA, 2013; pp. 1–14. ISBN 978-1-56793-437-3. [Google Scholar]
  15. Jones, R.N.; Hirdes, J.P.; Poss, J.W.; Kelly, M.; Berg, K.; Fries, B.E.; Morris, J.N. Adjustment of nursing home quality indicators. BMC Health Serv. Res. 2010, 10, 96. [Google Scholar] [CrossRef] [Green Version]
  16. Bottle, A.; Aylin, P. Statistical Methods for Healthcare Performance Monitoring; CRC Press/Taylor & Francis: Boca Raton, FL, USA, 2017; ISBN 978-1-4822-4609-4. [Google Scholar]
  17. Lane-Fall, M.B.; Neuman, M.D. Outcomes measures and risk adjustment. Int. Anesthesiol. Clin. 2013, 51. [Google Scholar] [CrossRef]
  18. Ash, A.S.; Shwartz, M.; Peköz, E.A.; Hanchate, A.D. Comparing outcomes across providers. In Risk Adjustment for Measuring Health Care Outcomes; Iezzoni, L.I., Ed.; Health Administration Press: Chicago, IL, USA, 2013; pp. 335–378. ISBN 978-1-56793-437-3. [Google Scholar]
  19. Iezzoni, L.I. Range of risk factors. In Risk Adjustment for Measuring Health Care Outcomes; Iezzoni, L.I., Ed.; Health Administration Press: Chicago, IL, USA, 2013; pp. 29–76. ISBN 978-1-56793-437-3. [Google Scholar]
  20. Arling, G.; Karon, S.L.; Sainfort, F.; Zimmerman, D.R.; Ross, R. Risk adjustment of nursing home quality indicators. Gerontologist 1997, 37, 757–766. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  21. Hirdes, J.P.; Fries, B.E.; Morris, J.N.; Ikegami, N.; Zimmerman, D.; Dalby, D.M.; Aliaga, P.; Hammer, S.; Jones, R. Home Care Quality Indicators (HCQIs) based on the MDS-HC. Gerontologist 2004, 44, 665–679. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  22. Dalby, D.M.; Hirdes, J.P.; Fries, B.E. Risk adjustment methods for Home Care Quality Indicators (HCQIs) based on the minimum data set for home care. BMC Health Serv. Res. 2005, 5, 7. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Morris, J.N.; Fries, B.E.; Frijters, D.; Hirdes, J.P.; Steel, R.K. InterRAI home care quality indicators. BMC Geriatr. 2013, 13, 127. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Schaffert, R.; Staub, L. Risikoadjustierung für Qualitätsindikatoren der Spitex. (Unpublished Manuscript, Last Modified December 2015).
  25. Institut Für Sozial- Und Präventivmedizin (ISPM). MEMdoc-Dokumentationssystem; Universität Bern: Bern, Switzerland, 2016. [Google Scholar]
  26. Spitex Schweiz. Datenpool HomeCareData; Spitex Schweiz: Bern, Switzerland, 2016. [Google Scholar]
  27. Coyne, K.S.; Wein, A.; Nicholson, S.; Kvasz, M.; Chen, C.-I.; Milsom, I. Economic burden of urgency urinary incontinence in the United States: A systematic review. J. Manag. Care Pharm 2014, 20, 130–140. [Google Scholar] [CrossRef] [Green Version]
  28. Milsom, I.; Coyne, K.S.; Nicholson, S.; Kvasz, M.; Chen, C.-I.; Wein, A.J. Global prevalence and economic burden of urgency urinary incontinence: A systematic review. Eur. Urol. 2014, 65, 79–95. [Google Scholar] [CrossRef] [PubMed]
  29. Boss, A.; Spörri, A. Empirische Beurteilung der neuen interRAI-HC Qualitätsindikatoren. (unpublished manuscript, last modified December 2020).
  30. National Guideline Alliance (UK) Urinary Incontinence and Pelvic Organ Prolapse in Women: Management NICE Guideline [NG123]. Available online: https://www.nice.org.uk/guidance/ng123 (accessed on 10 February 2021).
  31. Moulin, M.F.M.T.D.; Hamers, J.P.H.; Ambergen, A.W.; Halfens, R.J.G. Urinary incontinence in older adults receiving home care diagnosis and strategies. Scand. J. Caring Sci. 2009, 23, 222–230. [Google Scholar] [CrossRef]
  32. McDaniel, C.; Ratnani, I.; Fatima, S.; Abid, M.H.; Surani, S. Urinary incontinence in older adults takes collaborative nursing efforts to improve. Cureus 2020, 12, e9161. [Google Scholar] [CrossRef]
  33. Hartmaier, S.L.; Sloane, P.D.; Guess, H.A.; Koch, G.G.; Mitchell, C.M.; Phillips, C.D. Validation of the minimum data set cognitive performance scale: Agreement with the mini-mental state examination. J. Gerontol. A Biol. Sci. Med. Sci. 1995, 50, M128–M133. [Google Scholar] [CrossRef]
  34. Morris, J.N.; Fries, B.E.; Morris, S.A. Scaling ADLs within the MDS. J. Gerontol. A Biol. Sci. Med. Sci. 1999, 54, M546–M553. [Google Scholar] [CrossRef]
  35. Penny, K.; Barron, A.; Higgins, A.M.; Gee, S.; Croucher, M.; Cheung, G. Convergent validity, concurrent validity, and diagnostic accuracy of the InterRAI depression rating scale. J. Geriatr. Psychiatry Neurol. 2016, 29, 361–368. [Google Scholar] [CrossRef]
  36. Caetano, S.J.; Sonpavde, G.; Pond, G.R. C-Statistic: A brief explanation of its construction, interpretation and limitations. Eur. J. Cancer 2018, 90, 130–132. [Google Scholar] [CrossRef] [PubMed]
  37. Cavanaugh, J.E.; Neath, A.A. The akaike information criterion: Background, derivation, properties, application, interpretation, and refinements. WIREs Comput. Stat. 2019, 11, e1460. [Google Scholar] [CrossRef]
  38. Kutschmann, M.; Renner, D.; Fischer, B. Use of logistic regression for developing risk-adjusted quality indicators in nursing. Methods Inf. Med. 2010, 49, 608–612. [Google Scholar] [CrossRef]
  39. Giavarina, D. Understanding bland altman analysis. Biochem. Med. 2015, 25, 141–151. [Google Scholar] [CrossRef] [Green Version]
  40. Rhee, C.; Li, Z.; Wang, R.; Song, Y.; Kadri, S.S.; Septimus, E.J.; Chen, H.-C.; Fram, D.; Jin, R.; Poland, R.; et al. Impact of risk adjustment using clinical vs administrative data on hospital sepsis mortality comparisons. Open Forum Infect. Dis. 2020, 7, ofaa213. [Google Scholar] [CrossRef] [PubMed]
  41. Deutscher, D.; Werneke, M.W.; Hayes, D.; Mioduski, J.E.; Cook, K.F.; Fritz, J.M.; Woodhouse, L.J.; Stratford, P.W. Impact of risk adjustment on provider ranking for patients with low back pain receiving physical therapy. J. Orthop. Sports Phys. Ther. 2018, 48, 637–648. [Google Scholar] [CrossRef]
  42. Van der Roest, H.G.; van Eenoo, L.; van Lier, L.I.; Onder, G.; Garms-Homolová, V.; Smit, J.H.; Finne-Soveri, H.; Jónsson, P.V.; Draisma, S.; Declercq, A.; et al. Development of a novel benchmark method to identify and characterize best practices in home care across six European countries: Design, baseline, and rationale of the IBenC Project. BMC Health Serv. Res. 2019, 19. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  43. Hjaltadóttir, I.; Hallberg, I.R.; Ekwall, A.K. thresholds for minimum data set quality indicators developed and applied in Icelandic Nursing Homes. J. Nurs. Care Qual. 2012, 27, 266–276. [Google Scholar] [CrossRef]
  44. Rantz, M.J.; Petroski, G.F.; Madsen, R.W.; Mehr, D.R.; Popejoy, L.; Hicks, L.L.; Porter, R.; Zwygart-Stauffacher, M.; Grando, V. Setting thresholds for quality indicators derived from MDS Data for nursing home quality improvement Reports: An update. Jt. Comm. J. Qual. Improv. 2000, 26, 101–110. [Google Scholar] [CrossRef]
  45. Bos, J.T.; Frijters, D.H.M.; Wagner, C.; Carpenter, G.I.; Finne-Soveri, H.; Topinkova, E.; Garms-Homolová, V.; Henrard, J.-C.; Jónsson, P.V.; Sørbye, L.; et al. Variations in quality of home care between sites across europe, as measured by home care quality indicators. Aging Clin. Exp. Res. 2007, 19, 323–329. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  46. Mofina, A.M.; Guthrie, D.M. A comparison of home care quality indicator rates in two Canadian provinces. BMC Health Serv. Res. 2014, 14, 37. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  47. Foebel, A.D.; van Hout, H.P.; van der Roest, H.G.; Topinkova, E.; Garms-Homolova, V.; Frijters, D.; Finne-Soveri, H.; Jónsson, P.V.; Hirdes, J.P.; Bernabei, R.; et al. Quality of care in European home care programs using the second generation InterRAI Home Care Quality Indicators (HCQIs). BMC Geriatr. 2015, 15. [Google Scholar] [CrossRef] [Green Version]
  48. Mounsey, A.; Raleigh, M.; Wilson, A. Management of constipation in older adults. Am. Fam. Physician. 2015, 92, 500–504. [Google Scholar] [PubMed]
  49. National Clinical Guideline Centre (UK). Delirium: Diagnosis, Prevention and Management. Available online: https://www.nice.org.uk/guidance/cg103 (accessed on 8 February 2021).
  50. Ellenbecker, C.H.; Samia, L.; Cushman, M.J.; Alster, K. Patient safety and quality in home health care. In Patient Safety and Quality: An Evidence-Based Handbook for Nurses; Hughes, R.G., Ed.; Agency for Healthcare Research and Quality: Rockville, MD, USA, 2008. [Google Scholar]
  51. Landi, F. Potentially reversible risk factors and urinary incontinence in frail older people living in community. Age Ageing 2003, 32, 194–199. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  52. Suhr, R.; Lahmann, N.A. Urinary incontinence in home care: A representative multicenter study on prevalence, severity, impact on quality of life, and risk factors. Aging Clin. Exp. Res. 2018, 30, 589–594. [Google Scholar] [CrossRef]
  53. Matthews, C.A.; Whitehead, W.E.; Townsend, M.K.; Grodstein, F. Risk factors for urinary, fecal, or dual incontinence in the nurses’ health study. Obstet. Gynecol. 2013, 122, 539–545. [Google Scholar] [CrossRef] [Green Version]
  54. Blumenthal, D. Quality of care—What is it? N. Engl. J. Med. 1996, 335, 891–894. [Google Scholar] [CrossRef] [Green Version]
  55. Quentin, W.; Partanen, V.-M.; Brownwood, I.; Klazinga, N. Measuring healthcare quality. In Improving Healthcare Quality in Europe: Characteristics, Effectiveness and Implementation of Different Strategies; Busse, R., Klazinga, N., Panteli, D., Quentin, W., Eds.; European Observatory on Health Systems and Policies: Copenhagen, Denmark, 2019; pp. 31–62. ISBN 978-92-890-5175-0. [Google Scholar]
Figure 1. Caterpillar plot presenting bootstrap 95% confidence intervals (CIs) of risk-adjusted quality indicator (QI) rates of worsening or onset of urinary incontinence for 70 home care organizations. CIs are based on 10,000 bootstrap resamples. Organizations are ordered from 1–70 on the x-axis by the risk-adjusted QI rate (rank 1 corresponds to the organization with the lowest QI rate). The blue solid horizontal line shows the total QI rate (client population mean).
Figure 1. Caterpillar plot presenting bootstrap 95% confidence intervals (CIs) of risk-adjusted quality indicator (QI) rates of worsening or onset of urinary incontinence for 70 home care organizations. CIs are based on 10,000 bootstrap resamples. Organizations are ordered from 1–70 on the x-axis by the risk-adjusted QI rate (rank 1 corresponds to the organization with the lowest QI rate). The blue solid horizontal line shows the total QI rate (client population mean).
Ijerph 18 05502 g001
Figure 2. Bland-Altman plot of differences between the observed and risk-adjusted quality indicator rates. The dashed blue horizontal line shows the mean difference (0.05). The grey shaded area depicts the 95% agreement interval (−3.028 to 3.127). 8.57% (6/70 values) lies outside the limits of the agreement. The averages of observed and risk-adjusted QI rates lie between 0.0% and 26.8%.
Figure 2. Bland-Altman plot of differences between the observed and risk-adjusted quality indicator rates. The dashed blue horizontal line shows the mean difference (0.05). The grey shaded area depicts the 95% agreement interval (−3.028 to 3.127). 8.57% (6/70 values) lies outside the limits of the agreement. The averages of observed and risk-adjusted QI rates lie between 0.0% and 26.8%.
Ijerph 18 05502 g002
Table 1. Quality indicator bladder incontinence description.
Table 1. Quality indicator bladder incontinence description.
DefinitionNumeratorDenominatorExclusion Criteria
Proportion of home care clients with worsening or onset of UI.Number of home care clients with worsening of UI or the occurrence of new UI between two assessments.All home care clientsHome care clients receiving palliative care and/or aged < 18 years.
Abbreviations: UI, Urinary incontinence.
Table 2. Characteristics of the study population (n = 12,652 clients).
Table 2. Characteristics of the study population (n = 12,652 clients).
Characteristic n (%)
Change in UI status 1Improvement or no change11,304 (89.4)
Worsening or onset1348 (10.7)
Age (years)18–64 1557 (12.3)
65–79 3160 (25.0)
≥807924 (62.7)
SexMale 4571 (36.1)
Female8081 (63.9)
BMIUnder and normal weight (BMI < 25 kg/m2)6069 (49.5)
Overweight (BMI 25–29.9 kg/m2)3631 (29.6)
Obese (BMI ≥ 30 kg/m2)2558 (20.9)
Smoking (daily)No11,077 (87.8)
Yes1542 (12.2)
CPS0–intact9001 (71.1)
1–mild impairment2560 (20.2)
2–moderate impairment819 (6.5)
3–severe impairment 272 (2.2)
ADL index 2Independent11,130 (88.0)
Not independent1522 (12.0)
Locomotion in houseno impairment10,847 (89.1)
impairment1330 (10.9)
Dressingno impairment8486 (67.1)
impairment4158 (32.9)
Personal hygieneno impairment8078 (64.1)
impairment4522 (35.9)
Bathingno impairment4757 (39.7)
impairment7221 (60.3)
Unsteady gaitNo 5309 (42.0)
Yes 7343 (58.0)
IADL scale 30–independent1026 (8.1)
1–supervision required1489 (11.8)
2–limited impairment2168 (17.1)
3–sometimes extensive assistance required 2418 (19.1)
4–extensive assistance required2285 (18.1)
5–dependent2487 (19.7)
6–total dependence779 (6.2)
DRS0–no signs of depression11,240 (88.8)
1–mild signs of depression895 (7.1)
2–moderate signs of depression396 (3.1)
3–severe signs of depression121 (2.0)
Bowel incontinenceNo11,555 (91.5)
Yes1077 (8.5)
Abbreviations: ADL, Activities of daily living; BMI, Body mass index; CPS, Cognitive performance scale; DRS, Depression rating scale; IADL, Instrumental activities of daily living; UI, Urinary incontinence. 1 Change in UI from pre-assessment to follow-up assessment. 2 ADL index includes: bed movement, transferring, toilet use, and eating. 3 IADL scale includes: meal preparation, general housework, manage money, handling medication, making a call, and shopping.
Table 3. Adjusted Odds Ratios for worsening or onset of urinary incontinence (n = 8943 clients).
Table 3. Adjusted Odds Ratios for worsening or onset of urinary incontinence (n = 8943 clients).
Risk Factors of Worsening or Onset of UIOR95% CI
LowerUpper
Age (years) (ref = 18–64)
65–792.247 ***1.5483.262
≥803.184 ***2.2334.539
Female sex (ref = male)1.482 ***1.2691.732
BMI (ref = under or normal weight, BMI < 25 kg/m2)
Overweight (BMI 25–29.9 kg/m2)1.161 +0.9881.365
Obese (BMI ≥ 30 kg/m2)1.396 ***1.1631.676
CPS (ref = 0–intact)
1–mild impairment1.315 ** 1.1111.557
2–moderate impairment1.705 ***1.3212.201
3–severe impairment2.279 ***1.5083.444
Personal hygiene impairment (ref = no impairment)1.262 ** 1.0651.495
Bathing impairment (ref = no impairment)1.314 ** 1.0991.571
Unsteady gait (ref = steady gait)1.310 ***1.1201.532
Hospitalization in the last 90 days (ref = no hospitalization)1.340 ***1.1441.571
Type of pre-assessment (ref = intake assessment)
Regular follow-up assessment1.1520.9631.378
Significant status change assessment1.362 +0.9911.873
Abbreviations: BMI, Body mass index; CI, Confidence interval; CPS, Cognitive performance scale; OR, Odds ratio; UI, Urinary incontinence. Constant (intercept) = −4.28714; c-statistic = 0.658; + p ≤ 0.10, * p ≤ 0.05, ** p ≤ 0.01, *** p ≤ 0.001.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Wagner, A.; Schaffert, R.; Dratva, J. Adjusting Client-Level Risks Impacts on Home Care Organization Ranking. Int. J. Environ. Res. Public Health 2021, 18, 5502. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph18115502

AMA Style

Wagner A, Schaffert R, Dratva J. Adjusting Client-Level Risks Impacts on Home Care Organization Ranking. International Journal of Environmental Research and Public Health. 2021; 18(11):5502. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph18115502

Chicago/Turabian Style

Wagner, Aylin, René Schaffert, and Julia Dratva. 2021. "Adjusting Client-Level Risks Impacts on Home Care Organization Ranking" International Journal of Environmental Research and Public Health 18, no. 11: 5502. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph18115502

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop