Next Article in Journal
Reliability of a Risk-Factor Questionnaire for Osteoporosis: A Primary Care Survey Study with Dual Energy X-ray Absorptiometry Ground Truth
Next Article in Special Issue
Access to Healthcare Following Serious Injury: Perspectives of Allied Health Professionals in Urban and Regional Settings
Previous Article in Journal
Effects of the COVID-19 Pandemic on the Budgetary Mechanism Established to Cover Public Health Expenditure. A Case Study of Romania
Previous Article in Special Issue
A Bi-Objective Home Health Care Routing and Scheduling Model with Considering Nurse Downgrading Costs
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

LACE Score-Based Risk Management Tool for Long-Term Home Care Patients: A Proof-of-Concept Study in Taiwan

1
Department of Nursing, Taipei Veterans General Hospital, Taipei 112, Taiwan
2
Institute of Hospital and Health Care Administration, National Yang Ming Chiao Tung University, Taipei 112, Taiwan
3
Department of Family Medicine, Taipei Veterans General Hospital, Taipei 112, Taiwan
4
School of Medicine, National Yang Ming Chiao Tung University, Taipei 112, Taiwan
5
Institute of Public Health, National Yang Ming Chiao Tung University, Taipei 112, Taiwan
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2021, 18(3), 1135; https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph18031135
Submission received: 29 December 2020 / Revised: 21 January 2021 / Accepted: 25 January 2021 / Published: 28 January 2021

Abstract

:
Background: Effectively predicting and reducing readmission in long-term home care (LTHC) is challenging. We proposed, validated, and evaluated a risk management tool that stratifies LTHC patients by LACE predictive score for readmission risk, which can further help home care providers intervene with individualized preventive plans. Method: A before-and-after study was conducted by a LTHC unit in Taiwan. Patients with acute hospitalization within 30 days after discharge in the unit were enrolled as two cohorts (Pre-Implement cohort in 2017 and Post-Implement cohort in 2019). LACE score performance was evaluated by calibration and discrimination (AUC, area under receiver operator characteristic (ROC) curve). The clinical utility was evaluated by negative predictive value (NPV). Results: There were 48 patients with 87 acute hospitalizations in Pre-Implement cohort, and 132 patients with 179 hospitalizations in Post-Implement cohort. These LTHC patients were of older age, mostly intubated, and had more comorbidities. There was a significant reduction in readmission rate by 44.7% (readmission rate 25.3% vs. 14.0% in both cohorts). Although LACE score predictive model still has room for improvement (AUC = 0.598), it showed the potential as a useful screening tool (NPV, 87.9%; 95% C.I., 74.2–94.8). The reduction effect is more pronounced in infection-related readmission. Conclusion: As real-world evidence, LACE score-based risk management tool significantly reduced readmission by 44.7% in this LTHC unit. Larger scale studies involving multiple homecare units are needed to assess the generalizability of this study.

1. Introduction

Discharging long-term home care (LTHC) patients, i.e., long-term care (LTC) patients at home, from the hospital is an intricate process and challenging [1,2,3,4]. Considerable research attention has been devoted to risk management for readmission reduction to avoid excess mortality and medical cost [1,4,5]. In general, readmission reduction programs consist of two major components: stratifying patients by readmission risk and setting-up individualized preventive plans [6]. However, most readmission reduction programs usually work specifically for certain clinical condition [7]. Since LTHC patients were usually at older age with multiple comorbidities, it is challenging to balance between investments in a readmission reduction effort and readmission cost for homecare providers [8,9]. Risk management predictive models allow home care providers to arrange the priority of medical interventions according to the patient’s hospitalization risk and optimize the utilization of medical resources [10]. However, there remains a gap in putting predictive models into actual practice for home care patients [11].
LACE score is a readmission predictive model for various clinical scenarios including inpatients [12], surgical patients [13], chronic obstructive pulmonary disease (COPD) [14], and heart failure patients [15]. Preventive intervention can be prioritized according to patients’ risk [2,10,13,16,17,18]. Due to its simplicity features, LACE score gained attention among many emerging readmission predictive models [19]. According to LACE model, the probability of a patient’s readmission risk can be ideally calculated by four components, including the length of stay (L), acute admission (A), comorbidity (C), and emergency department visits in the previous six months (E) so that home care providers can stratify the patients and directed resource to the patients in need [20]. Although LACE score has been used in quite a few scenarios, it has been criticized for the poor performance in certain conditions [21,22,23]. The clinical utility of LACE score for risk management in LTHC patients remains unanswered.
In Taiwan, home care visits are specifically reimbursed toward patients who are bed- or wheel-chair bounded and severely dependent in activities of daily living (ADL) by Taiwan’s National Health Insurance (NHI) system [24,25]. As home care services are under government payment, the health system would be heavily impacted by home care patients’ readmission [11,26]. As a result, a novel home care delivery method, LACE score-based readmission risk management tool had been proposed and simulated in our home care setting previously [20]. While there has been a great deal of research on predictive models and readmission reduction, very few studies focus on integrating predictive models into actual practice for LTHC patients. This study reports a real-world experience in using LACE score-based readmission risk management tool to reduce readmission in LTHC patients. The aim of this study is twofold. The first is to validate LACE score in our home care setting. The second is to assess the effect of LACE score-based risk management tool. Our results should be a reference for quality improvement for home care services.

2. Materials and Methods

2.1. Setting, Data Source, and Ethical Concerns

A before-and-after study was conducted among LTHC patients managed by one medical center affiliated home care unit in Taipei, Taiwan. This home care unit features a service volume of 150–240 patients per year and an elderly patient population (i.e., age 80–88 years on average in past years). Home care patients are mostly diagnosed with cerebrovascular disease, hypertension, or diabetes. They are not only totally or severely dependent in ADL (i.e., Barthel index < 50) but 93–95% of them also have nasogastric tubes, urinary tubes, or tracheal tubes [25]. Referrals from its affiliated medical center contribute to 95–98% of these patients. Using the hospital’s electronic medical data (EMR), demographic information, and medical records of these patients were obtained. Age, gender, and all variables as predicting factors of LACE score were included.
This study’s protocol was approved by the Institutional Review Board of Taipei Veterans General Hospital (IRB #2018-08-016AC). The Institutional Review Board waived the requirement of written informed consent from each patient involved in our study because the data we analyzed was de-identified. Moreover, no identifiable private information or human biospecimens was involved.

2.2. Pre-Implement Cohort vs. Post-Implement Cohort

A before-after study design was used to compare the effect of LACE score-based risk management tool. To validate the performance of LACE score and collect baseline information, we enrolled LTHC patients who had had any acute hospitalization between 1 January 2017 and 31 December 2017 as the Pre-Implement cohort in 2017. Moreover, we enrolled patients who had been hospitalized between 1 January 2019 and 31 December 2019 as the Post-Implement cohort in 2019 to evaluate the risk reduction effect of risk management tool. The one-year gap (2018) of Pre-Implement cohort and Post-Implement cohort was used to minimize the bias introduced by clinical providers’ learning and training time lag (Figure 1).
For both groups of cohorts, admissions with a length of stays of more than 24 h were included, while shorter ones were excluded to avoid including observation stays. We also excluded admissions with certain events: death during hospitalization, a patient being transferred to another acute health care facility or chronic health care facility (e.g., nursing home and respite care center) after discharge, or patient discharged against medical advice. For multiple hospitalizations made by a single patient, variables of each of them are counted on an admission-by-admission basis.

2.3. Definition of 30-Day Readmission, Readmission Rate, and Cause-Specific Readmission Rates

The EMR in the hospital provided a very comprehensive follow-up in this study. Every acute hospitalization in the study cohorts is follow-up for 30 days after discharge. Hospitalizations are regarded as “hospitalization with 30-day readmissions” if patients are readmitted within 30 days after their discharge, whereas hospitalizations are regarded as “hospitalization with successful discharge” if patients are free from readmission. Readmission rates are calculated as the number of “hospitalization with 30-day readmissions” divided by the number of hospitalizations. Cause-specific readmission rates are calculated as the number of acute hospitalizations (readmission) within 30 days with specific cause for hospitalization divided by the total number of acute hospitalizations. Multiple eligible hospitalizations made by a single patient are counted separately. The bias of lost follow-up should be minimal because the home care patients who participated in this study were usually sent back to the same hospital as the home care unit if it were necessary.

2.4. Calculation of LACE Score

The LACE scores are calculated by points assigned for the patient’s length of stay, the acuity of the patient’s admission, the degree of comorbid illness or illnesses (as measured by the Charlson comorbidity index), and the number of times patients had been to the emergency department in the last six months. The higher the patients’ LACE scores are, the more chances for them to get readmitted (Appendix A Table A1) [19]. We carefully define the four components of LACE score with the best compatibility with the original LACE score definitions as the following: [19]

2.4.1. L: Length of Stay

Length of stay is the calculation of days from the first day of hospitalization to the last day. For readmission that occurs on the same day as the discharge is considered the same hospitalization.

2.4.2. A: Acute Admission

Patients admitted to the medical center via the emergency department is identified as acute admissions in contrast to planned admissions.

2.4.3. C: Comorbidity

Comorbidities are measured by the Charlson comorbidity index (CCI) score [19]. The primary or secondary diagnostic International Classification of Diseases, Ninth Revision (ICD-9) in the previous year of the index admission was used in calculating the CCI score [20].

2.4.4. E: Emergency Department Visits in the Previous Six Months

The number of visits of each patient is measured. However, multiple emergency visits within 24 h are considered the same visit.

2.5. LACE Score-Based Risk Management Tool for Readmission Reduction

In Taiwan, home care visits are reimbursed specific to LTHC patients who are totally or severely disabled. Since only two home visits per month are covered by Taiwan’s National Health Insurance system, home care units must balance the operational cost and payment to maintain its sustainability. As a result, before 2018, most home visits of the home care unit were scheduled periodically and commonly with a standard follow-up protocol.
Started from 2018, we implemented LACE score-based risk management tool and made an internal consensus on the readmission prevention program. Every home care patient’s LACE score was calculated after their acute hospitalization. Once a patient was identified as high-risk for readmission, i.e., LACE score higher than the cut-off value, home care physician and home care nurse would plan an individualized readmission reduction plan for him/her in addition to the standard follow-up [19,27]. The responsible home care nurse would make telephone calls to assess and initiate a readmission prevention plan within 72 h immediately after their discharge. The readmission prevention plan was modified from the BOOST (Better Outcomes for Older adults through Safe Transitions) tool [28] and it basically included the following components: (1) Identifying: past admission history was rigorously reviewed for the reason for admission. (2) Supporting: Follow-up phone call at 72 h to assess the condition, adherence, and complications; a follow-up home visit within seven days of hospital discharge; build link to community resource if needed. (3) Prevention: disease-specific education; action plan regarding what to do and whom to contact for worsening or new symptoms; drug education especially for antibiotics. A demonstration and return demonstration are carried out to ensure that the caregiver knows essential knowledge, attitude, and techniques for their own readmission reduction plan.

2.6. Statistical Analysis

Statistical analyses were performed using IBM SPSS Statistics, version 26, (I.B.M. Corp., Armonk, NY, USA) and MedCalc, version 19 (MedCalc Software, Ostend, Belgium). The study population was described by age, gender, and all the components of LACE score. Univariate analysis was performed by Chi-square test and a t-test to evaluate similarities between the Pre-Implement cohort in 2017 and the Post-Implement cohort in 2019.
The performance of LACE score of the Pre-Implement cohort in 2017 was evaluated in terms of calibration, using the Hosmer–Lemeshow test to test the closeness of predicted probability to observed probability, and in terms of discrimination, using the receiver operator characteristic (ROC) curve and the area under ROC curve (AUC) to test the ability of LACE score to separate patients by their risk of readmission. It is suggested that an AUC less than 0.60 reflects poor discrimination; 0.60 to 0.75, possibly helpful discrimination; and more than 0.75, clearly useful [27]. The Youden index was used to obtain the optimal cut-off value of LACE score for readmission. The clinical utility was evaluated in terms of positive predictive value (PPV), positive likelihood ratio (+LR), negative predictive value (NPV), and negative likelihood ratio (-LR) at the cut-off value; 95% confidence intervals were estimated based on binominal distribution.
To assess the effectiveness after implementing LACE score-based risk management tool, 30-day readmission, cause-specific readmission rates, and rate differences of Pre-Implement cohort in 2017 and Post-Implement cohort in 2019 were calculated. Two-sided p-values < 0.05 were considered significant.

3. Results

3.1. Pre-Implement Cohort and Post-Implement Cohort

During the first year of the study period, before implementing LACE score-based predictive risk management tool for readmission in 2017, 161 LTHC patients of the home care unit were identified, and there were 48 patients with a total of 87 acute hospitalizations (overall admission rate 54.0%) enrolled as the Pre-Implement cohort for validating purpose. In 2019, one year after implementing LACE score-based predictive risk management tool for readmission, there were 361 patients of the home care unit, and there were 132 patients with 179 acute hospitalizations (overall admission rate 49.6%) enrolled as the Post-Implement cohort for the purpose of proof-of-concept (Table 1).
Pre-Implement and Post-Implement cohorts were similar in terms of demographics and disease severity, while there was a 1.24-fold increase in service amount in 2019. In 2017 and 2019, the ratio of male to female cohorts is close to 1:1, with an average age of about 80 years old (p = 0.711 for gender; p = 0.094 for age). The average LACE score in both two groups was about 11 (p = 0.465), which means the population composition, the severity of illness, and the risk of hospital readmission were equal in the two groups. We can compare the outcome with minimal confounding bias (Table 1).

3.2. Validating Performance of LACE Score

Although LACE score predictive model only showed an acceptable performance result, it did show the potential as a useful screening tool for risk management for home care patients. With respect to the performance of the LACE score for readmission risk in the Pre-Implement cohort in 2017, the calibration and discrimination results are shown in Figure 2.
LACE score fitted well in the Pre-Implement cohort in 2017. The prediction of probabilities for readmission rates was close to the actual readmission rates (Hosmer–Lemeshow test, p = 0.171). However, the discrimination ability of LACE score was poor. In the Pre-Implement cohort in 2017, AUC is 0.598 (95% C.I., 0.488–0.702), the ROC curve in the upper right region seems good (sensitivity between 50 and 100) but the concavity of the ROC curve disappeared in the left lower region in the lower left region (sensitivity between 0 and 50) (Figure 2A). This finding suggested that LACE score might provide a good readmission prediction for certain patients but could not accurately determine the readmission for every home care patient. The LACE score’s optimal cut-off value was determined by Youden index, and patients whose LACE score were higher than 11 were considered high risk for readmission (Figure 2A).
LACE score had good potential in stratifying patients by their risk for readmission. For the given cut-off value (LACE score >11), LACE score showed a high sensitivity at 81.82% (95% C.I., 59.7–94.8) with a low specificity at 44.62% (95% C.I., 32.3–57.5). NPV is 87.9% (95% C.I., 74.2–94.8), which means that 87.9% of patients who were stratified as low-risk were correct (successfully discharge without readmission). PPV is 33.3% (95% C.I., 27.1–40.2) which means only one-third of high-risk patients actually readmitted. +LR is 1.48 (95% C.I., 1.1–2.0) and -LR is 0.41 (95% C.I., 0.2–1.0) means that LACE score is more powerful in ruling-out disease than ruling-in disease. As a result, Figure 2B showed that LACE score (the dotted line) clearly separated home care patients into high-risk (the upper part above the dotted line) and low-risk (the lower part below the dotted line), which suggested its value of a screening tool (ruling-out disease) for readmission.

3.3. Readmissions before and after Implementing LACE Score-Based Predictive Risk Management Tool

Implementing LACE score-based predictive risk management tool did reduce readmission. Once a patient was identified with a high risk for readmission, home care staff could promptly contact the patient within 72 h after discharge. A risk reduction plan would be initiated immediately in addition to the standard care protocol. As a result, there was a significant reduction of 44.7% in readmission rate in the Post-Implement cohort in 2019 (readmission rate, 14.0%; 95% C.I., 9.0–20.3), compared to that in the Pre-Implement cohort in 2017 (readmission rate, 25.3%; 95% C.I., 15.9–38.3) (rate difference, 11.32%; 95% C.I., 0.6–22.1, p = 0.0393) (Table 2).
LTHC patients were frequently readmitted because of infection problems. After implementing LACE score-based predictive risk management tool, the infection-specific readmission rate effectively decreased from 24.1% in 2017 to 12.3% in 2019 (readmission rate difference, 11.9%, 95% C.I., 1.6–22.5, p = 0.02) (Appendix A Table A2 and Table A3). There were an 11.3% reduction in readmission rate for pneumonia, and an 8.3% reduction for urinary tract infection in the Post-Implement cohort in 2019 compared to that in the Pre-Implement cohort in 2017 (Table 2; Figure 3). These findings suggested that the implementation of LACE score-based predictive risk management tool can lower the readmission rate for LTHC patients, specifically for those with infection-related problems.

4. Discussion

LTHC patients are vulnerable to readmission; however, it is challenging to effectively reducing readmission. We provided unique real-world experience in the implementation of LACE score-based readmission risk management tool for LTHC patients. The current before-and-after study validated LACE score, a predictive model for readmission, and evaluated the effect after implementing LACE score-based risk management tool. Although LACE score predictive model (AUC = 0.598) still has room for improvement, it did show the potential as a good screening tool for risk management for LTHC patients (NPV, 87.9%; 95% C.I., 74.2–94.8; -LR, 0.41; 95% C.I., 0.2–1.0). The result showed that LACE score-based predictive risk management tool could greatly reduce readmission in LTHC patients. For LTHC patients, the readmission rate of Post-Implement cohort in 2019 was significantly reduced by 44.7% (rate difference, 11.32%; 95% C.I., 0.6–22.1, p = 0.0393). This study provides an exceptional real-world experience in using LACE score-based risk management tool to reduce readmission rates among LTHC patients. The reduction effect is more pronounced in infection-related readmission. However, the result applies only to the current LTHC setting and requires further validations.
Our results filled the gap in understanding how LACE score-based risk management tool reduces readmission in LTHC patients. Our study showed that LTHC patients could be stratified by LACE scores, and a subsequent individualized preventive plans for those in needed on time had clearly cut down readmission rates [6]. Unlike previous studies, the current study further provided a convincing evidence that our tool works well for LTHC patients who were severely or totally dependent in ADL with older age, mostly intubated with nasogastric tubes, urinary catheters, and tracheal tubes, and had more comorbidities. Since LTHC patients are much different from other home care populations with better functional status, the infection-related problem rises to the leading and majority reason for readmission instead of traditional drivers of readmissions such as COPD, heart failure, and acute myocardial infarction [29].
Although some believe that LACE score model cannot perform well in older adults, our result shows its clinical usefulness in readmission risk management for LTHC patients. The clinical value of a prediction model cannot be determined solely by discrimination (i.e., AUC) and calibration [27] as the previous studies did [21,22,23]. In home care settings, there is an ethical consideration for false negatives (no preventive measure for high-risk patients predicted as low-risk) and false positives. (overdone preventive measure for low-risk patients predicted as high-risk) [30] As a result, ruling-out readmission is much more critical than ruling-in readmission in home care patients [31]. Since readmission reduction plan takes extra cost to the standard follow-up, ruling-out readmission (higher NPV and -LR, higher power to identify patients had a lower risk for readmission) can save the excessive cost of additional preventive measure to low-risk patients, and direct resources to high-risk ones [32,33]. This finding is compatible with our previous simulation [20], and this is likely why there is still room for improvement for LACE score, but a substantial reduction in readmission rate.
Infection-related problems are crucial for readmission for home care patients, and LACE score-based risk management tool may address this issue. Since home care patients are more likely to develop infection than the general population, the caregivers’ training in providing needed care at home is essential [34]. By using LACE score, home care nurses can straightly identify the high-risk patients and the families who need help. Nurses can immediately direct additional infection control intervention resources to high-risk patients and educate them based on patients’ health literacy level to complete understanding [35]. Our findings are consistent with previous results showing the effectiveness of readmission risk management [36].
Immediate and efficient outpatient communication are the keys to a successful readmission reduction plan. A nurse-led, immediate, and intensive outpatient communication can identify developing problems and decrease unplanned hospital readmission [37]. Like the previous study, nurse-led motivational and timely telephone follow-up can positively influence self-management and reduce hospital readmission [38], while a majority of readmission occurred within seven days right after discharge [29]. However, the increasing cost of intensive communication can only be resolved by either change in services-delivery or technology-assisted services [26]. In our experience, LACE score-based risk management tool considerably changed the way of regular-visit-based home visits. It provided home care nurses with information to effectively and efficiently schedule their home visits according to patients’ risk [38,39]. Moreover, our result encouraged future studies on telehealth to increase the efficiency of home visit. Examples such as MonashWatch in Australia had successfully reduced length of stay with high patient satisfaction should be a scalable solution for home care [40]. While a majority of health services had been lockdown recently because of the pandemic of COVID-19, there is a surge of using telehealth, e.g., a 154% increase in the United States [41]. Using telehealth including remote monitoring, televisit, telenursing, telenutrition, telepharmacy, and telerehabilitation should greatly support LTHC patients [42].
Although there is room for improvement of LACE score, a trade-off between simplicity and accuracy is evident. There is an emerging trend of developing predictive models. By introducing abundant variables in EMR database [43], collecting social determinants of health [44], and using sophisticated machine learning methods can build a surprisingly accurate but complex readmission prediction model [2,16,45,46]. There is always a huge information gap between the transition from hospital to home, and missing data are not uncommon for home care patients. This missingness would make the models above resulted in suboptimal predictions [47,48]. Our experience showed that LACE score is useful for LTHC patients in our home care unit since LACE score can be easily calculated by only four routinely collected variables. However, we encourage a system-level integration of clinical data to bridge the information gap between each transition. The more clinical data available, the more prediction models can be practically useful for efficiency and quality improvement in home care [10,11].
Our study had some limitations. First, our study focused on LTHC patients, a particular group of disabled patients with a high percentage of nasogastric tubes, urinary catheters, or tracheostomy tubes; thus, our result may not apply to a general home care population. Moreover, readmission rates in the current study should be adjusted when comparing to those in other studies [49]. Second, our findings are not generalizable beyond the study setting. As a single medical center and its home care unit, we may have better medical and logistic support than other home care providers. As a result, our result might be over-optimistic. A large scale and multiple center study are warranted. Third, the current study used a before-and-after study design, time effect, and observer bias should have existed. These biases might inevitably over-estimate the effect of the risk reduction plan. We encouraged a long-term follow-up study and aggregation of evidence from multiple home care units to examine the effect of risk management tool. Fourth, though the EMR database provided comprehensive information intra-hospital, we could not recognize the admissions and readmissions outside of this hospital of our study. The missingness might slightly underestimate admission rates in both groups. However, such missing bias should be minimal since the home care patients who participated in this study were usually sent back to the same hospital as the home care unit. Fifth, we did not adjudicate whether each readmission was elective versus unplanned. However, based on our experience, we would expect the rate of elective readmissions on home care services to be low. These limitations might reduce the generalizability of our results.

5. Conclusions

As real-world evidence, LACE score-based risk management tool significantly reduced readmission by 44.7% for LTHC patients in our home care unit, and the effect is more pronounced for infection-related problems. There is room for improvement in LACE predictive score’s predictive power, and larger scale, multiple homecare unit studies will have to assess the generalizability of our study.

Author Contributions

Conceptualization, M.-C.S., Y.-C.C., M.-S.H., and L.-H.L.; Data curation, M.-C.S., Y.-C.C., and M.-S.H.; Formal analysis, M.-C.S. and Y.-C.C.; Funding acquisition, Y.-C.C.; Investigation, M.-C.S.; Methodology, Y.-C.C.; Project administration, Y.-C.C.; Supervision, L.-H.L., H.-T.C., and T.-J.C.; Validation, M.-C.S. and Y.-C.C.; Writing—original draft, M.-C.S., Y.-C.C., and Y.-H.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding. The article processing charge was supported by an intramural grant of Taipei Veterans General Hospital (V109C-006). The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Institutional Review Board of Taipei Veterans General Hospital (IRB #2018-08-016AC).

Informed Consent Statement

Patient consent was waived because the data we analyzed was de-identified. Moreover, no identifiable private information or human biospecimens was involved.

Acknowledgments

The authors would like to thank Chu-Chuan Li, Su-Ju Yang, Li-Hui Hu, and Shiao-Hui Chiu for their support and assistance with this study. Special thanks also go to Yi-Jen Wang for her advice, counsel, and expertise.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. Components of LACE score [19].
Table A1. Components of LACE score [19].
AttributeValuePoints
Length of stay (days)<10
11
22
33
4–64
7–135
≥147
Acute admissionYes3
Comorbidity: Charlson comorbidity index score00
11
22
33
≥45
Emergency department visits in previous 6 months00
11
22
33
≥44
Table A2. Readmissions and cause-specific readmission rate before implementing LACE score-based predictive risk management tool to a home care patient cohort of a medical center affiliated home care unit in Taiwan in 2017. (n = 87, 2017).
Table A2. Readmissions and cause-specific readmission rate before implementing LACE score-based predictive risk management tool to a home care patient cohort of a medical center affiliated home care unit in Taiwan in 2017. (n = 87, 2017).
Causes of ReadmissionNo. of ReadmissionsCause-Specific Readmission Rate (%)
Pneumonia1416.1
Urinary tract infection55.7
Herpes zoster infection11.1
Gastrointestinal ulcers11.1
Acute myocardial infarction11.1
Table A3. Readmissions and cause-specific readmission rate after implementing LACE score-based predictive risk management tool to a home care patient cohort of a medical center affiliated home care unit in Taiwan in 2019. (n = 190, 2019).
Table A3. Readmissions and cause-specific readmission rate after implementing LACE score-based predictive risk management tool to a home care patient cohort of a medical center affiliated home care unit in Taiwan in 2019. (n = 190, 2019).
Causes of ReadmissionNo. of ReadmissionsCause-Specific Readmission Rate (%)
Pneumonia147.4
Urinary tract infection84.2
Fever of unknown origin21.1
Gastrointestinal ulcers10.5

References

  1. Yakusheva, O.; Hoffman, G.J. Does a Reduction in Readmissions Result in Net Savings for Most Hospitals? An Examination of Medicare′s Hospital Readmissions Reduction Program. Med. Care Res. Rev. 2020, 77, 334–344. [Google Scholar] [CrossRef] [PubMed]
  2. Mahmoudi, E.; Kamdar, N.; Kim, N.; Gonzales, G.; Singh, K.; Waljee, A.K. Use of Electronic Medical Records in Development and Validation of Risk Prediction Models of Hospital Readmission: Systematic Review. BMJ 2020, 369, m958. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Conroy, T.; Heuzenroeder, L.; Feo, R. In-Hospital Interventions for Reducing Readmissions to Acute Care for Adults Aged 65 and Over: An Umbrella Review. Int. J. Qual. Health Care 2020, 32, 414–430. [Google Scholar] [CrossRef] [PubMed]
  4. Wadhera, R.K.; Joynt Maddox, K.E.; Wasfy, J.H.; Haneuse, S.; Shen, C.; Yeh, R.W. Association of the Hospital Readmissions Reduction Program with Mortality among Medicare Beneficiaries Hospitalized for Heart Failure, Acute Myocardial Infarction, and Pneumonia. JAMA 2018, 320, 2542–2552. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Hoffman, G.J.; Tilson, S.; Yakusheva, O. The Financial Impact of an Avoided Readmission for Teaching and Safety-Net Hospitals Under Medicare’s Hospital Readmission Reduction Program. Med. Care Res. Rev. 2018, 77, 324–333. [Google Scholar] [CrossRef]
  6. Kripalani, S.; Theobald, C.N.; Anctil, B.; Vasilevskis, E.E. Reducing Hospital Readmission Rates: Current Strategies and Future Directions. Annu. Rev. Med. 2014, 65, 471–485. [Google Scholar] [CrossRef] [Green Version]
  7. Wasfy, J.H.; Zigler, C.M.; Choirat, C.; Wang, Y.; Dominici, F.; Yeh, R.W. Readmission Rates after Passage of the Hospital Readmissions Reduction Program: A Pre-Post Analysis. Ann. Intern. Med. 2017, 166, 324–331. [Google Scholar] [CrossRef] [Green Version]
  8. Morkisch, N.; Upegui-Arango, L.D.; Cardona, M.I.; Heuvel, D.V.D.; Rimmele, M.; Sieber, C.C.; Freiberger, E. Components of the transitional care model (TCM) to reduce readmission in geriatric patients: A systematic review. BMC Geriatr. 2020, 20, 1–18. [Google Scholar] [CrossRef]
  9. Takahashi, P.Y.; Leppin, A.L.; Hanson, G.J. Hospital to Community Transitions for Older Adults: An Update for the Practicing Clinician. Mayo Clin. Proc. 2020, 95, 2253–2262. [Google Scholar] [CrossRef]
  10. Strassner, C.; Hoffmann, M.; Forstner, J.; Roth, C.; Szecsenyi, J.; Wensing, M. Interventions to Improve Hospital Admission and Discharge Management: An Umbrella Review of Systematic Reviews. Qual. Manag. Health Care 2020, 29, 67–75. [Google Scholar] [CrossRef]
  11. Grieco, L.; Utley, M.; Crowe, S. Operational research applied to decisions in home health care: A systematic literature review. J. Oper. Res. Soc. 2020, 32. [Google Scholar] [CrossRef]
  12. Damery, S.; Combes, G. Evaluating the Predictive Strength of the Lace Index in Identifying Patients at High Risk of Hospital Readmission Following an Inpatient Episode: A Retrospective Cohort Study. BMJ Open 2017, 7, 8. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Mehta, H.B.; Sieloff, E.; Veeranki, S.P.; Sura, S.D.; Riall, T.S.; Senagore, A.J.; Goodwin, J.S. Risk Prediction Models for Hospital Readmission in Surgery: A Systematic Review. J. Am. Coll. Surg. 2017, 225, E113. [Google Scholar] [CrossRef] [Green Version]
  14. Hakim, M.A.; Garden, F.L.; Jennings, M.D.; Dobler, C.C. Performance of the Lace Index to Predict 30-Day Hospital Readmissions in Patients with Chronic Obstructive Pulmonary Disease. Clin. Epidemiol. 2018, 10, 51–59. [Google Scholar] [CrossRef] [Green Version]
  15. Yazdan-Ashoori, P.; Lee, S.F.; Ibrahim, Q.; Van Spall, H.G. Utility of the Lace Index at the Bedside in Predicting 30-Day Readmission or Death in Patients Hospitalized with Heart Failure. Am. Heart J. 2016, 179, 51–58. [Google Scholar] [CrossRef] [PubMed]
  16. Mahajan, S.M.; Heidenreich, P.; Abbott, B.; Newton, A.; Ward, D. Predictive Models for Identifying Risk of Readmission after Index Hospitalization for Heart Failure: A Systematic Review. Eur. J. Cardiovasc. Nurs. 2018, 17, 675–689. [Google Scholar] [CrossRef] [PubMed]
  17. Artetxe, A.; Beristain, A.; Graña, M. Predictive models for hospital readmission risk: A systematic review of methods. Comput. Methods Programs Biomed. 2018, 164, 49–64. [Google Scholar] [CrossRef]
  18. Zhou, H.; Della, P.R.; Roberts, P.; Goh, L.; Dhaliwal, S.S. Utility of models to predict 28-day or 30-day unplanned hospital readmissions: An updated systematic review. BMJ Open 2016, 6, e011060. [Google Scholar] [CrossRef]
  19. Van Walraven, C.; Dhalla, I.A.; Bell, C.; Etchells, E.; Stiell, I.G.; Zarnke, K.; Austin, P.C.; Forster, A.J. Derivation and Validation of an Index to Predict Early Death or Unplanned Readmission after Discharge from Hospital to the Community. Can. Med. Assoc. J. 2010, 182, 551–557. [Google Scholar] [CrossRef] [Green Version]
  20. Su, M.C.; Wang, Y.J.; Chen, T.J.; Chiu, S.H.; Chang, H.T.; Huang, M.S.; Hu, L.H.; Li, C.C.; Yang, S.J.; Wu, J.C.; et al. Assess the Performance and Cost-Effectiveness of Lace and Hospital Re-Admission Prediction Models as a Risk Management Tool for Home Care Patients: An Evaluation Study of a Medical Center Affiliated Home Care Unit in Taiwan. Int. J. Environ. Res. Public Health 2020, 17, 17. [Google Scholar] [CrossRef] [Green Version]
  21. Heppleston, E.; Fry, C.H.; Kelly, K.; Shepherd, B.; Wright, R.; Jones, G.; Robin, J.; Murray, P.; Fluck, D.; Han, T.S. Lace Index Predicts Age-Specific Unplanned Readmissions and Mortality after Hospital Discharge. Aging Clin. Exp. Res. 2020. [Google Scholar] [CrossRef] [PubMed]
  22. Fry, C.H.; Heppleston, E.; Fluck, D.; Han, T.S. Derivation of Age-Adjusted Lace Index Thresholds in the Prediction of Mortality and Frequent Hospital Readmissions in Adults. Intern. Emerg. Med. 2020, 15, 1319–1325. [Google Scholar] [CrossRef] [PubMed]
  23. Cotter, P.E.; Bhalla, V.K.; Wallis, S.J.; Biram, R.W.S. Predicting readmissions: Poor performance of the LACE index in an older UK population. Age Ageing 2012, 41, 784–789. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Genet, N.; Boerma, W.G.; Kringos, D.S.; Bouman, A.; Francke, A.L.; Fagerstrom, C.; Melchiorre, M.G.; Greco, C.; Deville, W. Home Care in Europe: A Systematic Literature Review. BMC Health Serv. Res. 2011, 11, 207. [Google Scholar] [CrossRef] [Green Version]
  25. Chang, H.-T.; Lai, H.-Y.; Hwang, I.-H.; Ho, M.-M.; Hwang, S.-J. Home healthcare services in Taiwan: A nationwide study among the older population. BMC Health Serv. Res. 2010, 10, 274. [Google Scholar] [CrossRef] [Green Version]
  26. Wong, Z.S.; Hoshino, E.; Ikegami, N. A Cost Projection of Scheduled Physician Home-Visit Services in Japan: 2014 to 2064. J. Aging Soc. Policy 2020. [Google Scholar] [CrossRef]
  27. Alba, A.C.; Agoritsas, T.; Walsh, M.; Hanna, S.; Iorio, A.; Devereaux, P.J.; McGinn, T.; Guyatt, G. Discrimination and Calibration of Clinical Prediction Models Users’ Guides to the Medical Literature. JAMA 2017, 318, 1377–1384. [Google Scholar] [CrossRef]
  28. Hansen, L.O.; Greenwald, J.L.; Budnitz, T.; Howell, E.; Halasyamani, L.; Maynard, G.; Vidyarthi, A.; Coleman, E.A.; Williams, M.V. Project Boost: Effectiveness of a Multihospital Effort to Reduce Rehospitalization. J. Hosp. Med. 2013, 8, 421–427. [Google Scholar] [CrossRef]
  29. Meadow, A.; Sangl, J. Hospital Readmissions in Medicare Home Healthcare: What Are the Leading Risk Indicators? Home Healthc. Now 2019, 37, 213–221. [Google Scholar] [CrossRef]
  30. Heggestad, A.K.T.; Magelssen, M.; Pedersen, R.; Gjerberg, E. Ethical Challenges in Home-Based Care: A Systematic Literature Review. Nurs Ethics 2020, 0969733020968859. [Google Scholar] [CrossRef]
  31. Liimatta, H.A.; Lampela, P.; Kautiainen, H.; Laitinen-Parkkonen, P.; Pitkala, K.H. The Effects of Preventive Home Visits on Older People’s Use of Health Care and Social Services and Related Costs. J. Gerontol. Ser. A Biol. Sci. Med. Sci. 2020, 75, 1586–1593. [Google Scholar] [CrossRef] [PubMed]
  32. Chimenti, C.; Sears, G.; McIntyre, J. Sepsis in Home Health Care: Screening, Education, and Rapid Triage. J. Nurs Care Qual. 2020. [Google Scholar] [CrossRef] [PubMed]
  33. Bowles, K.H.; Cater, J.R. Screening for Risk of Rehospitalization from Home Care: Use of the Outcomes Assessment Information Set and the Probability of Readmission Instrument. Res. Nurs. Health 2003, 26, 118–127. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Shang, J.; Wang, J.; Adams, V.; Ma, C. Risk factors for infection in home health care: Analysis of national Outcome and Assessment Information Set data. Res. Nurs. Health 2020, 43, 373–386. [Google Scholar] [CrossRef] [PubMed]
  35. Shang, J.J.; Russell, D.; Dowding, D.; McDonald, M.V.; Murtaugh, C.; Liu, J.F.; Larson, E.L.; Sridharan, S.; Brickner, C. A Predictive Risk Model for Infection-Related Hospitalization among Home Healthcare Patients. J. Healthc. Qual. 2020, 42, 136–147. [Google Scholar] [CrossRef] [PubMed]
  36. Facchinetti, G.; D’Angelo, D.; Piredda, M.; Petitti, T.; Matarese, M.; Oliveti, A.; De Marinis, M.G. Continuity of Care Interventions for Preventing Hospital Readmission of Older People with Chronic Diseases: A Meta-Analysis. Int. J. Nurs. Stud. 2020, 101, 103396. [Google Scholar] [CrossRef]
  37. Maatman, T.K.; McGreevy, K.A.; Sood, A.J.; Ceppa, E.P.; House, M.G.; Nakeeb, A.; Schmidt, C.M.; Nguyen, T.K.; Zyromski, N.J. Improved Outpatient Communication Decreases Unplanned Readmission in Necrotizing Pancreatitis. J. Surg. Res. 2020, 253, 139–146. [Google Scholar] [CrossRef]
  38. Mols, R.E.; Hald, M.; Vistisen, H.S.; Lomborg, K.; Maeng, M. Nurse-Led Motivational Telephone Follow-up after Same-Day Percutaneous Coronary Intervention Reduces Readmission and Contacts to General Practice. J. Cardiovasc. Nurs. 2019, 34, 222–230. [Google Scholar] [CrossRef]
  39. Parks, C.; Turner, M.; Ward, K.; Murphy, F.; Dame, P.; Hale, K.; Dixon, J.; Lawson, M.; Barber, A.; Monaghan, D. To Call or Not to Call: Assessing the Impact of Nurse Post-Discharge Telephone Calls on 30 Day Hospital Readmission Rates. J. Cardiovasc. Nurs. 2019, 34, 419–420. [Google Scholar]
  40. Martin, C.; Hinkley, N.; Stockman, K.; Campbell, D. Capitated Telehealth Coaching Hospital Readmission Service in Australia: Pragmatic Controlled Evaluation. J. Med. Internet Res. 2020, 22, e18046. [Google Scholar] [CrossRef]
  41. Koonin, L.M.; Hoots, B.; Tsang, C.A.; Leroy, Z.; Farris, K.; Jolly, T.; Antall, P.; McCabe, B.; Zelis, C.B.R.; Tong, I.; et al. Trends in the Use of Telehealth During the Emergence of the Covid-19 Pandemic United States, January-March 2020. MMWR Morb. Mortal. Wkly. Rep. 2020, 69, 1595–1599. [Google Scholar] [CrossRef] [PubMed]
  42. Goodman-Casanova, J.M.; Dura-Perez, E.; Guzman-Parra, J.; Cuesta-Vargas, A.; Mayoral-Cleries, F. Telehealth Home Support During Covid-19 Confinement for Community-Dwelling Older Adults with Mild Cognitive Impairment or Mild Dementia: Survey Study. J. Med. Internet Res. 2020, 22, e19434. [Google Scholar] [CrossRef] [PubMed]
  43. Flaks-Manov, N.; Srulovici, E.; Yahalom, R.; Perry-Mezre, H.; Balicer, R.; Shadmi, E. Preventing Hospital Readmissions: Healthcare Providers’ Perspectives on Impactibility Beyond Ehr 30-Day Readmission Risk Prediction. J. Gen. Intern. Med. 2020, 35, 1484–1489. [Google Scholar] [CrossRef] [PubMed]
  44. Jones, C.D.; Falvey, J.; Hess, E.; Levy, C.R.; Nuccio, E.; Baron, A.E.; Masoudi, F.A.; Stevens-Lapsley, J. Predicting Hospital Readmissions from Home Healthcare in Medicare Beneficiaries. J. Am. Geriatr. Soc. 2019, 67, 2505–2510. [Google Scholar] [CrossRef]
  45. Leppin, A.L.; Gionfriddo, M.R.; Kessler, M.; Brito, J.P.; Mair, F.S.; Gallacher, K.; Wang, Z.; Erwin, P.J.; Sylvester, T. Preventing 30-Day Hospital Readmissions a Systematic Review and Meta-Analysis of Randomized Trials. Jama Intern. Med. 2014, 174, 1095–1107. [Google Scholar] [CrossRef]
  46. Kansagara, D.; Englander, H.; Salanitro, A.; Kagen, D.; Theobald, C.; Freeman, M.; Kripalani, S. Risk Prediction Models for Hospital Readmission a Systematic Review. JAMA 2011, 306, 1688–1698. [Google Scholar] [CrossRef] [Green Version]
  47. Sperrin, M.; Martin, G.P.; Sisk, R.; Peek, N. Missing Data Should Be Handled Differently for Prediction Than for Description or Causal Explanation. J. Clin. Epidemiol. 2020, 125, 183–187. [Google Scholar] [CrossRef]
  48. Van Smeden, M.; Groenwold, R.H.; Moons, K.G. A cautionary note on the use of the missing indicator method for handling missing data in prediction research. J. Clin. Epidemiol. 2020, 125, 188–190. [Google Scholar] [CrossRef]
  49. Van Walraven, C.; Wong, J.; Hawken, S.; Forster, A.J. Comparing Methods to Calculate Hospital-Specific Rates of Early Death or Urgent Readmission. CMAJ 2012, 184, E810–E817. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Figure 1. Definition of study cohorts before and after implementing LACE score-based predictive risk management tool in the medical center affiliated home care unit in Taiwan, 2017 and 2019.
Figure 1. Definition of study cohorts before and after implementing LACE score-based predictive risk management tool in the medical center affiliated home care unit in Taiwan, 2017 and 2019.
Ijerph 18 01135 g001
Figure 2. (A) Receiver operator characteristic (ROC) curve of validating LACE score for readmission in the Pre-Implement cohort in the long-term home care unit in 2017 (n = 87, 2017). The cut-off value based on the Youden index is also shown as the solid black circle in the chart. (B) Distribution of LACE score for readmission in patients with successful discharge and 30-day readmission. Each dot represents one patient with its color denotes a different outcome. The horizontal line in the chart shows the cut-off value based on the Youden index. (The Pre-management cohort in 2017, n = 87).
Figure 2. (A) Receiver operator characteristic (ROC) curve of validating LACE score for readmission in the Pre-Implement cohort in the long-term home care unit in 2017 (n = 87, 2017). The cut-off value based on the Youden index is also shown as the solid black circle in the chart. (B) Distribution of LACE score for readmission in patients with successful discharge and 30-day readmission. Each dot represents one patient with its color denotes a different outcome. The horizontal line in the chart shows the cut-off value based on the Youden index. (The Pre-management cohort in 2017, n = 87).
Ijerph 18 01135 g002
Figure 3. Cause-specific readmission rates by causes of readmission before (Pre-Implement) and after (Post-Implement) implementing LACE score-based predictive risk management tool to long-term home care patients of a medical center affiliated home care unit in Taiwan in 2017 and 2019. (Pre-Implement cohort in 2017, n = 87; Post-Implement cohort in 2019, n = 179).
Figure 3. Cause-specific readmission rates by causes of readmission before (Pre-Implement) and after (Post-Implement) implementing LACE score-based predictive risk management tool to long-term home care patients of a medical center affiliated home care unit in Taiwan in 2017 and 2019. (Pre-Implement cohort in 2017, n = 87; Post-Implement cohort in 2019, n = 179).
Ijerph 18 01135 g003
Table 1. Demographic information, LACE score, and outcome before (Pre-Implement) and after (Post-Implement) implementing LACE score-based predictive risk management tool to long-term home care (LTHC) patients a medical center affiliated home care unit in Taiwan in 2017 and 2019. (Pre-Implement cohort in 2017, n = 87; Post-Implement cohort in 2019, n = 179).
Table 1. Demographic information, LACE score, and outcome before (Pre-Implement) and after (Post-Implement) implementing LACE score-based predictive risk management tool to long-term home care (LTHC) patients a medical center affiliated home care unit in Taiwan in 2017 and 2019. (Pre-Implement cohort in 2017, n = 87; Post-Implement cohort in 2019, n = 179).
Acute Hospitalizations of the Pre-Implement Cohort in 2017 (n = 87)Acute Hospitalizations of the Post-Implement Cohort in 2019 (n = 179)
Mean(SD 1)Mean(SD 1)p-ValueSig. 2
Personal Demographics
Gender 0.711
Female, no. (%)40(46.0)78(43.6)
Male, no. (%)47(54.0)101(56.4)
Age87.4(12.4)84.7(12.0)0.094
LACE Score
Length of stay (L)5.6(0.7)5.7(0.6)0.229
Acuity of admission (A)2.7(0.9)2.8(0.6)0.283
Comorbidities (C)1.7(0.9)1.6(0.9)0.396
Emergency department visits (E)1.9(1.3)1.8(1.1)0.513
LACE score11.8(2.6)11.6(1.8)0.465
Outcome
No. of 30-day readmission22 25 0.023*
Readmission rate %, (95% C.I. 3)25.3(15.9–38.3)14.0(9.0–20.3)0.039*
1 SD: standard deviation; 2 Sig.: significance level: p-Value <0.05: *; 3 95% C.I.: 95% confidence interval.
Table 2. 30-day readmissions and cause-specific readmission rates before (Pre-Implement) and after (Post-Implement) implementing LACE score-based predictive risk management tool to long-term home care patients of a medical center affiliated home care unit in Taiwan in 2017 and 2019. (Pre-Implement cohort in 2017, n = 87; Post-Implement cohort in 2019, n = 179).
Table 2. 30-day readmissions and cause-specific readmission rates before (Pre-Implement) and after (Post-Implement) implementing LACE score-based predictive risk management tool to long-term home care patients of a medical center affiliated home care unit in Taiwan in 2017 and 2019. (Pre-Implement cohort in 2017, n = 87; Post-Implement cohort in 2019, n = 179).
Causes of ReadmissionReadmissions before
Predictive Risk Management in 2017 1
(Pre-Implement in 2017, n = 87)
Readmissions after
Predictive Risk Management in 2019 2
(Post-Implement in 2019, n = 179)
Readmission Rate Difference (%)
No. of ReadmissionsCause-Specific Readmission Rate (%) 3No. of ReadmissionsCause-Specific Readmission Rate (%) 3
All-cause2225.32514.011.3
Pneumonia1416.1147.88.3
Urinary tract infection55.784.51.3
Other problems33.431.71.7
1 The total number of acute hospitalizations in the home care unit before implementing LACE score-based predictive risk management tool in 2017 is 87. 2 The total number of acute hospitalizations after implementing LACE score-based predictive risk management tool in 2019 is 179 because of the increasing service amount of the home care unit. 3 Cause-specific readmission rates were calculated as the number of acute hospitalizations (readmission) within 30 days following previous acute hospitalization of each cause of readmission divided by the total number of acute hospitalizations.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Su, M.-C.; Chen, Y.-C.; Huang, M.-S.; Lin, Y.-H.; Lin, L.-H.; Chang, H.-T.; Chen, T.-J. LACE Score-Based Risk Management Tool for Long-Term Home Care Patients: A Proof-of-Concept Study in Taiwan. Int. J. Environ. Res. Public Health 2021, 18, 1135. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph18031135

AMA Style

Su M-C, Chen Y-C, Huang M-S, Lin Y-H, Lin L-H, Chang H-T, Chen T-J. LACE Score-Based Risk Management Tool for Long-Term Home Care Patients: A Proof-of-Concept Study in Taiwan. International Journal of Environmental Research and Public Health. 2021; 18(3):1135. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph18031135

Chicago/Turabian Style

Su, Mei-Chin, Yu-Chun Chen, Mei-Shu Huang, Yen-Hsi Lin, Li-Hwa Lin, Hsiao-Ting Chang, and Tzeng-Ji Chen. 2021. "LACE Score-Based Risk Management Tool for Long-Term Home Care Patients: A Proof-of-Concept Study in Taiwan" International Journal of Environmental Research and Public Health 18, no. 3: 1135. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph18031135

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop