Next Article in Journal
Breaking Barriers to Healthcare Access: A Multilevel Analysis of Individual- and Community-Level Factors Affecting Women’s Access to Healthcare Services in Benin
Next Article in Special Issue
How Artificial Intelligence and New Technologies Can Help the Management of the COVID-19 Pandemic
Previous Article in Journal
Psychosocial Factors Predicting Resilience in Family Caregivers of Children with Cancer: A Cross-Sectional Study
Article

Diagnostic Agreement between Physicians and a Consultation–Liaison Psychiatry Team at a General Hospital: An Exploratory Study across 20 Years of Referrals

1
Department of Biomedical, Metabolic and Neural Sciences, University of Modena and Reggio Emilia, Via Giuseppe Campi, 287–41125 Modena, Italy
2
Department of Economics & Marco Biagi Foundation, University of Modena and Reggio Emilia, Via J. Berengario, 51–41121 Modena, Italy
3
Department of Mental Health, Modena Health Local Agency, Viale L.A. Muratori, 201-41124 Modena, Italy
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2021, 18(2), 749; https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph18020749
Received: 29 November 2020 / Revised: 9 January 2021 / Accepted: 15 January 2021 / Published: 17 January 2021

Abstract

Consultation–liaison psychiatry (CLP) manages psychiatric care for patients admitted to a general hospital (GH) for somatic reasons. We evaluated patterns in psychiatric morbidity, reasons for referral and diagnostic concordance between referring doctors and CL psychiatrists. Referrals over the course of 20 years (2000–2019) made by the CLP Service at Modena GH (Italy) were retrospectively analyzed. Cohen’s kappa statistics were used to estimate the agreement between the diagnoses made by CL psychiatrist and the diagnoses considered by the referring doctors. The analyses covered 18,888 referrals. The most common referral reason was suspicion of depression (n = 4937; 32.3%), followed by agitation (n = 1534; 10.0%). Psychiatric diagnoses were established for 13,883 (73.8%) referrals. Fair agreement was found for depressive disorders (kappa = 0.281) and for delirium (kappa = 0.342), which increased for anxiety comorbid depression (kappa = 0.305) and hyperkinetic delirium (kappa = 0.504). Moderate agreement was found for alcohol or substance abuse (kappa = 0.574). Referring doctors correctly recognized psychiatric conditions due to their exogenous etiology or clear clinical signs; in addition, the presence of positive symptoms (such as panic or agitation) increased diagnostic concordance. Close daily collaboration between CL psychiatrists and GH doctors lead to improvements in the ability to properly detect comorbid psychiatric conditions.
Keywords: consultation–liaison psychiatry; inter-rater agreement; psychosomatic medicine; general hospital consultation–liaison psychiatry; inter-rater agreement; psychosomatic medicine; general hospital

1. Introduction

Consultation–liaison psychiatry (CLP) deals with the psychiatric care of ill or medically complex patients who have received admission to a general hospital (GH) for somatic reasons and who display psychiatric symptoms over the course of their hospital stay [1]. CLP practices and methodologies have developed in various ways throughout the second half of the 90s in different countries with different healthcare systems. Historically, consultation psychiatry (CP) has described requests for a second, expert opinion by a ward treating physician for a specific patient, while CLP has referred to a closer integration of psychiatry in a somatic department [2]. CLP has generally included regular psychiatric consultation hours, as well as routine guidance and supervision of the GH staff administering somatic treatment by a psychiatrist regarding psychiatric and psychosomatic themes [3,4,5,6,7]. CL psychiatrists operationalize the dialogue between psychiatry and the rest of medicine, connecting GH departments with community mental health services. Despite growing evidence suggesting that CLP services can be cost-effective because, among other things, they reduce the length of patients’ hospital stay [8,9], such an extensive framework may be demanding to apply [10]. In Italy, only a few CLP services have been formally and administratively recognized in GHs, as CP services are a more common framework [11,12].
Medical–psychiatric comorbidity has huge impacts on health, functioning, and quality of life in patients and caregivers, as well as on the organization of the health care system; nevertheless, psychiatric disorders continue to be underdiagnosed and misdiagnosed at GHs [1,13,14]. Studies of CLP have investigated this and found that it may be related to the culture and training of the multiprofessional GH staff, to pitfalls in the organization of health care systems and related funding strategies, or to the intrinsic clinical complexity of medical and psychiatric multi-morbidity [15,16]. Ward doctors in GHs are often overwhelmed by having to cope with both understaffing and high turnover, leading them to struggle to find the time and the ability to establish the intimate doctor–patient relationship that is essential for performing effective psychological assessments. Moreover, some doctors at GHs may feel uneasy in dealing with psychiatric conditions. In these cases, medical–psychiatric morbidity is likely to be neglected within the GH [13].
The involvement of clinical psychologists and specialists in psychosomatic medicine has led to closer examination of medical–psychiatric comorbidity within GHs, however, rates of referrals to psychiatry are generally low [17], and few studies have investigated and discussed the accuracy of initial diagnostic classification made by the GH doctors in patients subsequently evaluated by consulting psychiatrists. These few showed variable agreement and disagreement rates dependent on multiple factors, such as the diagnostic category [18,19], the age of the patient [20], and the professional experience of the physician [21]. Evaluating the diagnostic agreement between treating physicians and CL-psychiatrists with a dedicated CLP service may provide an index of the appropriateness of the referral, reflecting how medical–psychiatric comorbidity is acknowledged and managed within GH wards and providing valuable feedback to CL psychiatrists engaged in improving the dialogue between psychiatry and the other medical branches.
We evaluated patterns in psychiatry morbidity in the CLP service of a GH, assessing the reasons for referrals and the diagnostic concordance between referring GH doctors (whether physicians or surgeons) and the CL psychiatrists. We also investigated differences in diagnostic agreement, according to the features of the referral (i.e., whether the request is urgent or not urgent), of the patient (i.e., gender, and whether there is a positive or negative psychiatric history), of the referring ward (i.e., whether the request comes from internal medicine or a surgical ward), and of the CLP service (i.e., whether it is within its first or second 10 years of activity).
Taking into consideration the available literature, we hypothesized that affective disorders would be the most frequent reason for referral and that these referrals would have low diagnostic accuracy [18,19,20,22,23,24,25]. Moreover, we supposed that agreement or accuracy would increase as the CLP service continued in existence for longer periods, as a consequence of training and supervision provided to ward doctors on the professional skills needed to deal with medical–psychiatric comorbidity.

2. Materials and Methods

2.1. Setting and Study Design

Observations were performed at the Modena GH, a 600-bed university hospital belonging to the Regione Emilia-Romagna Health System. The GH is located in the central city area of Modena, a mid-sized city in Northern Italy (population approx. 200 thousand people). The hospital has an Emergency Department (ED), allowing direct access to patients with acute medical needs.
The Modena CLP service was instituted in 1989 and is incorporated into an operative unit of the Adult Mental Health Care Department, which also includes a 12-bed residential facility for psychiatric rehabilitation and a community mental health center. The Modena acute psychiatric ward is located in another GH of the same district, belonging to a different operative unit. The CLP service provides both routine and urgent psychiatric consultations to all wards of the GH (with the exception of the pediatric ward) and to the ED. The patients who are referred are mostly inpatients, but collaboration with a limited number of outpatient clinics (notably, oncology, liver transplantation, and dialysis) is available.
Referral forms for psychiatric consultations are sent electronically through the IT system, using a semi-structured specific form [7,26]. The service commits to see to routine referrals within 48 h, but most patients are seen within 24 h of referral. Urgent referrals may be initiated via telephone, and in this case, the service commits to see the patient within 1 h. One or two of the first assessments each day are set in advance for outpatients.
At the beginning of the working day, a staff meeting takes place to produce a group reading and distribution of the referrals received to allow tasks to be assigned. In the afternoon, team discussion of clinical cases and supervision of residents is carried out. After this, psychiatric consultation letters that specify the psychiatric diagnosis (made according to the International Statistical Classification of Diseases and Related Health Problems-10 [27]) are sent electronically, and the treatment plan is sent back to GH doctors, accompanied by verbal details over the telephone when necessary. The clinical procedures for psychiatric consultations follow international standards [28] adapted to features of the local context.
An electronic database developed in Microsoft Excel (latest version) was adopted by the CLP service to document clinical activities following the involvement of the service in research on CLP promoted in Europe by the ECLW in the late 90’s [4,5,29]. A complete, homogeneous, and reliable electronic documentation is available from year 2000. The variables in the database are organized into the following sections:
(1)
Socio-demographic data,
(2)
Details of referral,
(3)
Medical and psychiatric history,
(4)
Outcome of psychiatric assessment, and
(5)
Back-referral.
The same structure was followed in the description of the dataset, displayed in the results section. The data here presented refer to the period between 1 January 2000, and 31 December 2019 (or 20 full years of data).

2.2. Statistical Analyses

The clinical and non-clinical variables in the dataset were described using percentages for the categorical and dichotomous variables and median, mean, and SD for the continuous variables. Cohen’s Kappa statistics [30] were used to assess diagnostic concordance between diagnoses made by the CLP team and the diagnosis considered by the physician who sent the referral. The results of this statistic have been interpreted according to Cohen’s suggestion, as follow: kappa values ≤ 0.01 as indicating no agreement and 0.01–0.20 as none to slight, 0.21–0.40 as fair, 0.41–0.60 as moderate, 0.61–0.80 as substantial, and 0.81–1.00 as almost perfect agreement [30]. A difference in the kappa values reflecting a step to a higher (or lower) category of agreement was considered significant. Moreover, we deemed informative a difference of kappa values at the first decimal place, relying on the conceptual understanding of Cohen’s kappa previously proposed, assuming the squaring of the kappa as the amount of accuracy [31]. The statistical analyses were performed with Stata 15 (StataCorp, College Station, TX, USA).

2.3. Statement of Ethics

The study design was approved by the competent local ethical committee (Comitato Etico AVEN, Italy) on 22 September 2020 (ethical approval code: AVEN 886/2020/OSS*/AUSLMO).

3. Results

3.1. Description of the Sample

A total of 18,888 (9089 [48.1%] from 2000 to 2009 and 9799 [51.9%] from 2010 to 2019) referrals were analyzed. The majority of referrals to CLP concerned female patients, at 54% (n = 10,187); the median age of referred patients was 59 years (mean = 57.8; SD = 18.1), with a range of 18 to 103 years. Overall (past and/or on-going) positive psychiatric history was documented for 6940 subjects (49.4%, excluding missing values). Referrals received from medical wards were vastly more common than those received from surgical wards (13,710 vs. 3398; approximately 80% vs. 20%). The majority of referrals (n = 6689; 35.4%) were sent from internal (or general) medicine wards, which also accounted for 20.70% of the total beds in the hospital. The most common reason for the referrals was a request to confirm a diagnosis of depression (n = 4937; 32.3%), followed by requests to address agitation (n = 1534; 10.0%). Urgent referrals accounted for 28.0% of the total (n = 4622), and the average rate of admission to the psychiatric ward over the entire period of study was 2.9% (n = 541). A psychiatric diagnosis was established at the end of more than two-thirds of consultations (n = 13,883; 73.8%), but no formal psychiatric diagnosis emerged after consultation in 26.2% cases (n = 4828). Anxiety (n = 1183; 6.3%), depressive disorder (n = 4182; 22.1%), mixed anxiety and depression (n = 5365; 28.4%), and adjustment disorders (n = 3250; 17.2%) were by far the most common diagnoses made by CL psychiatrists, followed by delirium (n = 1157; 6.1%) and substance abuse disorder (n = 1144; 6.1%). Table 1 presents the full details of the referrals.

3.2. Concordance of Diagnosis between CL Psychiatrist and GH Doctor

Inter-rater agreement on the primary psychiatric diagnosis as made by the CL psychiatrist and the treating physician was evaluated with Cohen’s kappa coefficient, and the results are given in Table 2.
A diagnosis of depression was given by the referring GH doctor in 4937 cases, and in 4182, the CL psychiatrist diagnosed depression, producing a Cohen’s kappa coefficient of 0.281 for this dyad, indicating fair agreement. The diagnosis of anxiety was taken into account by the GH doctor in 1379 cases and by the CL psychiatrist in 1183, with a kappa value of 0.312. When anxiety and depression were considered together, the concordance of this broad diagnostic regrouping between GH doctor and CL psychiatrist increased up to kappa = 0.305, which still indicated fair agreement.
A diagnosis of delirium was made by the referring physician in 436 cases, and the CL psychiatrist diagnosed delirium in 1157 cases, for a kappa value of 0.342, suggesting fair agreement. Interestingly, if a broader array of symptoms associated with the diagnosis of delirium (e.g., agitation) were listed as part of the referral reason, 1970 cases were considered by the referring doctor to have delirium, which means that the level of concordance for this wider diagnosis of delirium (corresponding to the descriptive diagnosis of hyperkinetic delirium) increased to reach agreement, kappa = 0.504.
A diagnosis of alcohol or substance abuse was made in 907 cases by the GH doctor and by the CL psychiatrist in 1144; the level of concordance was kappa = 0.574, indicating moderate agreement.
Finally, a diagnosis of eating disorder was considered by GH doctor in 63 cases, and the CL psychiatrist made this diagnosis in 107 cases, when concordance was estimated, kappa value was 0.315, indicating fair agreement.
The levels of agreement in relation to different features of the referrals are presented in terms of kappa values in Table 3, Table 4, Table 5, Table 6 and Table 7.
The diagnoses of alcohol or substance abuse were generally more accurate when made by physicians than by surgeons (kappa = 0.601 and = 0.415, respectively). Conversely, surgeons seemed to be somewhat more concordant with psychiatrists than physicians were in diagnosing eating disorders (kappa = 0.545 and = 0.310, respectively) and delirium, particularly the hyperkinetic type (kappa = 0.566 and = 0.491, respectively).
For urgent and non-urgent referrals, no substantial differences were seen in the degree of diagnostic agreement that emerged for all but eating disorder diagnoses that displayed higher concordance when referred urgently (kappa = 0.432 [urgent] and 0.287 [non-urgent]).
Patients with positive psychiatric history were diagnosed with higher levels of concordance between GH doctor and CL psychiatrist for all of the disorders observed, with the exception of those that were exogenous or due to a medical condition, i.e., alcohol or substance abuse (kappa = 0.556 for both those with and without psychiatric history) and delirium (kappa = 0.560 [negative psychiatric history] and = 0.444 [positive psychiatric history]).
The concordance of diagnoses between GH doctor and the CL psychiatrist increased as time went on. Notably, a comparison of the first 10 (2000–2009) and the last 10 (2010–2019) years of activity showed higher diagnostic concordance between the referring GH doctor and CL psychiatry for anxiety, kappa = 0.175 (2000–2009) and = 0.401 (2010–2019); depression, kappa = 0.186 (2000–2009) and = 0.317 (2010–2019); eating disorders, kappa < 0.01 (2000–2009) and = 0.535 (2010–2019); delirium, kappa = 0.147 (2000–2009) and = 0.427 (2010–2019); schizophrenia, kappa = 0.119 (2000–2009) and = 0.293 (2010–2019). The agreement on alcohol or substance abuse diagnoses remained moderate, kappa = 0.593 (2000–2009) and 0.559 (2010–2019).
Finally, no substantial differences were seen in the degree of diagnostic agreement according to the gender difference of the patient for all but eating disorders, that displayed moderate agreement when diagnosed in males, whereas fair in females [kappa = 0.479 (males) and = 0.285 (females)].

4. Discussion

This study evaluated patterns in psychiatric morbidity at the CLP of Modena, Italy. Firstly, it assessed the reasons for referral and diagnostic concordance between the referring GH doctor (both physicians and surgeons) and the CLP team. Secondarily, it analyzed differences in diagnostic agreement according to the features of the referral (i.e., urgent or non-urgent request), of the patient (i.e., positive or negative psychiatric history), of the referring ward (i.e., internal medicine or surgical ward), and of the age of the CLP service (first 10 years or second 10 years of activity).
This study found that anxiety, depression, and adjustment disorders were by far the most common psychiatric diagnoses in patients referred to the Modena CLP service, followed by diagnoses of delirium and alcohol or other substance abuse. Lower rates were found for schizophrenia or psychosis and eating disorders. These findings are in accordance with previous reports highlighting those three diagnostic categories as the most common reasons for the psychiatric request [19]. These were among what Goldberg and Huxley called “common mental disorders” [32], as has recently been confirmed elsewhere [33,34]. The results of this study show higher diagnostic agreement for anxiety than for depression and higher agreement for mixed anxiety and depression than for depression only, suggesting that the diagnostic accuracy of affective disorders increases in the presence of anxiety. This confirms previous evidence showing difficulties in rising diagnostic concordance for depressive disorders compared with anxiety disorders [18,23]. This may be due to the clinical features of anxiety, which grow during panic attacks and commonly present with characteristic somatic symptoms that make it easier for the GH doctor to recognize the condition.
The high rates of referrals for delirium are in line with previous evidence that indicates an overall aging of the inpatient population in GHs and reveal a high incidence of delirium in the inpatient setting [35,36], a common reason for psychiatric referral [22,24,37]. The fair diagnostic accuracy found for delirium (which rose to moderate when the presentation was associated with agitation) indicates a remarkable and well-known risk that GH doctors may miss a delirium diagnosis [36,38], particularly in case of hypo-active delirium [39]. Further, the diagnostic concordance for delirium was lower in patients with a positive psychiatric history, suggesting that this fact may mislead the GH doctors and make them more likely to attribute symptoms of delirium to a previous psychiatric condition, preventing a proper recognition of the syndrome. CL psychiatrists should collaborate closely with the medical team and instruct them in the clinical skill of identifying delirium at its earliest stage to allow appropriate management to begin, which is associated with improved outcomes [40]. Further, GH multi-professional staff should be provided with more information on how to manage delirium and should be informed of the consequences of the lack of detection and management of delirium on the outcome of physical illness [41]. This may be a good incentive for them to consider the possibility of delirium, in fact it is known that one of the best model to predict higher agreement with the experts is percentage of time spent in group practice [21]. Consistent with this, the diagnostic concordance for delirium increased during the course of the CLPS’s functioning, which is evidence for effectiveness of the training and educational interventions it provided.
The findings of the present study suggest that in about a quarter of referrals (n = 4828, 26.2%) no psychiatric diagnosis was formalized by CL psychiatrists. In most of these cases, the referring doctor relied on general or descriptive vocabulary that could denote a mental disorder or described the need of the GH doctor (i.e., “psychiatric history,” “non-compliant,” or “refused medical treatment”). Frequently, the GH doctors were requesting “psychiatric clearance” before major surgery (e.g., pre-orthotopic liver transplantation or tocophobia) or before discharging vulnerable patients, that is, to rule out significant psychiatric problems in general, or simply on the basis that the patient was already known to be suffering from a mental disorder. These findings, already pinpointed by Clarke et al. as the “staff problems” reason for referral [24], could be interpreted in multiple ways. First, they indicated an unmet need for psychiatric diagnostic skills in referring doctors [42]. Second, these types of referral, which led to diagnostic disagreement, may reflect the fact that the GH doctor did not feel at ease or possibly felt challenged in dealing with medical–psychiatric comorbidity, or, again, that they were worried about possible medico-legal implications (e.g., patients refusing medical treatments, or requesting early discharge from GH), thus requesting a psychiatric consultation to share the risk for difficult clinical management decisions [8]. Accordingly, the findings of the present study reflect the reality of routine clinical practice and provide guidance for the role of CL psychiatrist, who can bridge gaps in knowledge and skills, empowering physicians and surgeons to deal with challenging clinical situation. Indeed, a large portion of the liaison activity of a CLP service should include day-to-day professional support and training for GH doctors to reduce stigma against the mental health problems of their patients, which can lead to worse clinical outcomes if neglected [43,44,45]. While this is only an indicator, the present study provides hints of improvement in this direction, in the form of an increased diagnostic agreement between GH doctors and CL psychiatrist over the second period of the operation of CLP service than during the first half, namely, after 10 years of liaison activity, indicating an increase in trust and reciprocity between professionals in the care of the hospitalized people.
For specific diagnoses, it has been found that the GH doctors were more accurate when they suspected an affective disorder that was comorbid with anxiety and were more accurate for delirium when it was hyper-kinetic. This has at least two possible explanations. First, GH doctors are better able to recognize psychiatric issues when behavioral symptoms occur (such as agitation or panic) and fail to properly assess negative symptoms (such as lack of volition or depressed mood). Second, the results may reflect intrinsic limits of the categorical approach to diagnoses of mental disorder: a growing body of literature suggests the need to shift to a more dimensional or functional understanding of mental disorders [46,47]. Here, it is worth mentioning that the Research Domain Criteria (RDoC) framework can be used in both clinical and research practice to increase diagnostic accuracy and reliability [48,49].
Finally, diagnostic concordance was greater for substance or alcohol abuse and for eating disorders, suggesting that GH doctors are better equipped to recognize psychiatric conditions in presence of exogenous etiology and/or clear clinical or radiological signs, such as liver injury for alcoholism or impaired BMI for eating disorders. The greater diagnostic concordance highlighted for substance and alcohol abuse is consistent with the most recent literature [18].
Notably, the gender difference in the diagnostic agreement found for eating disorders, favoring males, is surprising since a body of literature suggested a higher prevalence of these conditions among females than males, and this finding may be influenced by the low number of diagnoses recorded in this category [50,51]. Notwithstanding, recent studies have been suggesting that at the community level, a higher percentage of males than females with eating disorders met criteria for an urgent medical inpatient admission [52]. Our results may be interpreted also consistent with this, suggesting either delayed treatment seeking, a more rapid escalation into medical instability, or both, among males with eating disorders, leading them to be more likely to be seen by CL psychiatrist within GH. Conversely, no agreement was found for somatization or medically unexplained symptoms, confirming the presence of well-known pitfalls to proper identification.

Limitations

Certain limitations of this study must be acknowledged. First, although the data were gathered from a large number of consultations, the study is monocentric, so its results may not be generalizable to other centers, particularly those without a dedicated CLP service. Second, the retrospective design of this study may have affected the accuracy of data collection, although the dataset was double-checked by two researchers (M.M. and L.P.) before the analyses were performed and missing or uncertain data were removed. Third, in such a wide timespan (20 years) the inter-rater agreement may have changed also as an effect of the succeeding of different CL psychiatrists. Nevertheless, the Modena CLP service has always been characterized by a shared bio-psycho-social framework and a psychodynamic orientation that have been source of consistency and diagnostic stability across the years, for similar clinical conditions [53]; also, one of the authors (S.F.) has been part of the staff of the CLP service for the whole 20 years, contributing further to stabilize diagnostic procedures and methods of data collection. Fourth, the psychiatric referrals were requested using a semi-structured form, which provided a defined clinical question and a diagnostic hypothesis. However, the referring doctors were not informed that the accuracy of their diagnostic orientation would be assessed. Even if this blinding of the referring GH doctors may have increased the truthfulness of the results, it is plausible that higher diagnostic concordance would have been found if ward clinicians had been informed that their referrals would be judged for accuracy, which might have encouraged them to be as accurate as possible as they formalized their diagnostic hypothesis. Finally, the study did not evaluate the impact of psychiatric morbidity on clinical outcome of the patient. Future studies should attempt to overcome these limitations.

5. Conclusions

Diagnostic agreement about the psychiatric diagnoses of medically ill patients staying in the GH between ward doctors (both clinicians and surgeons) and CL psychiatrists ranged from fair to moderate. Referring doctors more accurately recognized a psychiatric condition when positive symptoms (such as panic or agitation) occurred or when they relied on exogenous etiology or on clear clinical signs, while negative symptoms (such as lack of volition or depressed mood) or complex psychiatric conditions (such as psychoses or MUS) were more likely to be misdiagnosed. The results of this study indicate that close day-to-day collaboration between CL psychiatrists and GH doctors produced improvements in their ability to detect comorbid psychiatric conditions. Future studies should replicate these findings at other centers, challenging GH doctors to be more actively engaged in the psychiatric comorbidity recognition and evaluating the impact of psychiatric morbidity and its recognition on clinical outcomes. Furthermore, future studies should examine the implementation of a more dimensional and functional diagnostic approach at GHs, such as the RDoC framework, to increase diagnostic accuracy. Occasions for shared training between GH doctors and CL psychiatrists should be pursued to increase respective skills and collaboration on specific cases, leading to better care integration.

Author Contributions

Conceptualization, M.M. (Mattia Marchi) and S.F.; methodology, M.M. (Mattia Marchi) and F.M.M.; formal analysis, M.M. (Mattia Marchi); data curation, M.M. (Mattia Marchi), L.P. and S.F.; writing—original draft preparation, M.M. (Mattia Marchi) and F.M.M.; writing—review and editing, M.M. (Mattia Marchi), G.M.G., M.M. (Maria Moscara), G.M.; supervision, G.M.G. and S.F. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Area Vasta Emilia Nord (AVEN) Ethics Committee (protocol code AVEN 886/2020/OSS*/AUSLMO, approved 22 September 2020).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Data sharing with investigators outside the team requires Ethical Committee approval. Data requests may be submitted to the corresponding author. All request for anonymized data will be reviewed by the research team and then submitted to the AVEN Ethical Committee.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Kathol, R.G.; Kunkel, E.J.S.; Weiner, J.S.; McCarron, R.M.; Worley, L.L.M.; Yates, W.R.; Summergrad, P.; Huyse, F.J. Psychiatrists for Medically Complex Patients: Bringing Value at the Physical Health and Mental Health/Substance-Use Disorder Interface. Psychosomatics 2009, 50, 93–107. [Google Scholar] [CrossRef] [PubMed]
  2. Lücke, C.; Gschossmann, J.M.; Schmidt, A.; Gschossmann, J.; Lam, A.P.; Schneider, C.E.; Philipsen, A.; Müller, H.H. A Comparison of Two Psychiatric Service Approaches: Findings from the Consultation vs. Liaison Psychiatry-Study. BMC Psychiatry 2017, 17, 8. [Google Scholar] [CrossRef] [PubMed]
  3. Ferrari, S.; Blum, J.; Kelly, P. How to collaborate with other specialties. In How to Succeed in Psychiatry: A Guide to Training and Practice; Fiorillo, A., Calliesis, I., Sass, H., Eds.; Wiley Blackwell: Chichester, UK, 2012; pp. 211–235. [Google Scholar]
  4. Huyse, F.J.; Herzog, T.; Lobo, A.; Malt, U.F.; Opmeer, B.C.; Stein, B.; de Jonge, P.; van Dijck, R.; Creed, F.; Crespo, M.D.; et al. Consultation-Liaison Psychiatric Service Delivery: Results from a European Study. Gen. Hosp. Psychiatry 2001, 23, 124–132. [Google Scholar] [CrossRef]
  5. Huyse, F.J.; Herzog, T.; Lobo, A.; Malt, U.F.; Opmeer, B.C.; Stein, B.; Cardoso, G.; Creed, F.; Crespo, M.D.; Guimarâes-Lopes, R.; et al. European Consultation-Liaison Services and Their User Populations: The European Consultation-Liaison Workgroup Collaborative Study. Psychosomatics 2000, 41, 330–338. [Google Scholar] [CrossRef] [PubMed]
  6. Rigatelli, M.; Ferrari, S.; Uguzzoni, U.; Natali, A. Teaching and Training in the Psychiatric-Psychosomatic Consultation-Liaison Setting. Psychother Psychosom. 2000, 69, 221–228. [Google Scholar] [CrossRef]
  7. Rigatelli, M.; Ferrari, S. The Modena Consultation-Liaison Psychiatry Service, Italy. Br. J. Psychiatry 2004, 184, 268–269. [Google Scholar] [CrossRef]
  8. Jansen, L.; van Schijndel, M.; van Waarde, J.; van Busschbach, J. Health-Economic Outcomes in Hospital Patients with Medical-Psychiatric Comorbidity: A Systematic Review and Meta-Analysis. PLoS ONE 2018, 13, e0194029. [Google Scholar] [CrossRef]
  9. Wood, R.; Wand, A.P.F. The Effectiveness of Consultation-Liaison Psychiatry in the General Hospital Setting: A Systematic Review. J. Psychosom. Res. 2014, 76, 175–192. [Google Scholar] [CrossRef]
  10. Borus, J.F.; Barsky, A.J.; Carbone, L.A.; Fife, A.; Fricchione, G.L.; Minden, S.L. Consultation-Liaison Cost Offset: Searching for the Wrong Grail. Psychosomatics 2000, 41, 285–288. [Google Scholar] [CrossRef]
  11. Ferrari, S.; Rigatelli, M. General Hospital Psychiatry in Italy: An Update. J. Psychosom. Res. 2006, 60, 217–218. [Google Scholar] [CrossRef]
  12. Gala, C.; Rigatelli, M.; De Bertolini, C.; Rupolo, G.; Gabrielli, F.; Grassi, L. A Multicenter Investigation of Consultation-Liaison Psychiatry in Italy. Italian C-L Group. Gen. Hosp. Psychiatry 1999, 21, 310–317. [Google Scholar] [CrossRef]
  13. Smith, G.C. From Consultation-Liaison Psychiatry to Integrated Care for Multiple and Complex Needs. Aust N. Z. J. Psychiatry 2009, 43, 1–12. [Google Scholar] [CrossRef] [PubMed]
  14. Strain, J.J.; Blumenfield, M. Challenges for Consultation-Liaison Psychiatry in the 21st Century. Psychosomatics 2008, 49, 93–96. [Google Scholar] [CrossRef] [PubMed]
  15. Engel, G.L. The Need for a New Medical Model: A Challenge for Biomedicine. Science 1977, 196, 129–136. [Google Scholar] [CrossRef]
  16. Walker, A.; Barrett, J.R.; Lee, W.; West, R.M.; Guthrie, E.; Trigwell, P.; Quirk, A.; Crawford, M.J.; House, A. Organisation and Delivery of Liaison Psychiatry Services in General Hospitals in England: Results of a National Survey. BMJ Open 2018, 8, e023091. [Google Scholar] [CrossRef]
  17. Rothenhäusler, H.B.; Ehrentraut, S.; Kapfhammer, H.P. Changes in Patterns of Psychiatric Referral in a German General Hospital: Results of a Comparison of Two 1-Year Surveys 8 Years Apart. Gen. Hosp. Psychiatry 2001, 23, 205–214. [Google Scholar] [CrossRef]
  18. Lawrence, T.J.; Harsh, J.S.; Lyden, L. Physician and Behavioral Health Provider Diagnostic Agreement in a General Hospital Setting. Int. J. Psychiatry Med. 2020, 55, 249–254. [Google Scholar] [CrossRef]
  19. Otani, V.; Otani, T.; Freirias, A.; Calfat, E.; Aoki, P.; Cross, S.; Sumskis, S.; Kanaan, R.; Cordeiro, Q.; Uchida, R. Predictors of Disagreement Between Diagnoses from Consult Requesters and Consultation-Liaison Psychiatry. J. Nerv. Ment. Dis. 2019, 207, 1019–1024. [Google Scholar] [CrossRef]
  20. Canuto, A.; Gkinis, G.; DiGiorgio, S.; Arpone, F.; Herrmann, F.R.; Weber, K. Agreement between Physicians and Liaison Psychiatrists on Depression in Old Age Patients of a General Hospital: Influence of Symptom Severity, Age and Personality. Aging Ment. Health 2016, 20, 1092–1098. [Google Scholar] [CrossRef]
  21. Epstein, S.A.; Gonzales, J.J.; Onge, J.S.T.; Carter-Campbell, J.; Weinfurt, K.; Leibole, M.; Goldberg, R.L. Practice Patterns in the Diagnosis and Treatment of Anxiety and Depression in the Medically Ill: A Survey of Psychiatrists. Psychosomatics 1996, 37, 356–367. [Google Scholar] [CrossRef]
  22. Su, J.-A.; Tsai, C.-S.; Hung, T.-H.; Chou, S.-Y. Change in Accuracy of Recognizing Psychiatric Disorders by Non-Psychiatric Physicians: Five-Year Data from a Psychiatric Consultation–Liaison Service. Psychiatry Clin. Neurosci. 2011, 65, 618–623. [Google Scholar] [CrossRef] [PubMed]
  23. Clarke, D.M.; Mckenzie, D.P.; Smith, G.C. The Recognition of Depression in Patients Referred to a Consultation-Liaison Service. J. Psychosom. Res. 1995, 39, 327–334. [Google Scholar] [CrossRef]
  24. Clarke, D.M.; Smith, G.C. Consultation-Liaison Psychiatry in General Medical Units. Aust. N. Z. J. Psychiatry 1995, 29, 424–432. [Google Scholar] [CrossRef] [PubMed]
  25. Dilts, S.L.; Mann, N.; Dilts, J.G. Accuracy of Referring Psychiatric Diagnosis on a Consultation-Liaison Service. Psychosomatics 2003, 44, 407–411. [Google Scholar] [CrossRef] [PubMed]
  26. Ferrari, S.; Dreher, A.; Mattei, G.; Diefenbacher, A. Liaison psychiatry—Is it possible? In Psychiatry in Practice; Fiorillo, A., Volpe, U., Bhugra, D., Eds.; Oxford University Press: Oxford, UK, 2016; pp. 389–408. ISBN 978-0-19-872364-6. [Google Scholar]
  27. WHO, W.H.O. ICD-10: International Statistical Classification of Diseases and Related Health Problems: Tenth Revision; World Health Organization: Geneva, Switzerland, 2004; ISBN 978-92-4-154649-2. [Google Scholar]
  28. Leentjens, A.F.G.; Boenink, A.D.; Sno, H.N.; Strack van Schijndel, R.J.M.; van Croonenborg, J.J.; van Everdingen, J.J.E.; van der Feltz-Cornelis, C.M.; van der Laan, N.C.; van Marwijk, H.; van Os, T.W.D.P.; et al. The Guideline “Consultation Psychiatry” of the Netherlands Psychiatric Association. J. Psychosom. Res. 2009, 66, 531–535. [Google Scholar] [CrossRef]
  29. Huyse, F.J.; Herzog, T.; Lobo, A.; Malt, U.F.; Opmeer, B.C.; Stein, B.; Creed, F.; Crespo, M.D.; Gardoso, G.; Guimaraes-Lopes, R.; et al. European Consultation-Liaison Psychiatric Services: The ECLW Collaborative Study. Acta Psychiatr. Scand. 2000, 101, 360–366. [Google Scholar] [CrossRef]
  30. Cohen, J. A Coefficient of Agreement for Nominal Scales. Educ. Psychol. Meas. 1960, 20, 37–46. [Google Scholar] [CrossRef]
  31. McHugh, M.L. Interrater Reliability: The Kappa Statistic. Biochem. Med. 2012, 22, 276–282. [Google Scholar] [CrossRef]
  32. Goldberg, P.D.; Goldberg, D.; Huxley, D.P.; Huxley, P. (Eds.) Mental Illness in the Community: The Pathway to Psychiatric Care; Routledge: London, UK, 2001; ISBN 978-0-415-26451-8. [Google Scholar]
  33. Steel, Z.; Marnane, C.; Iranpour, C.; Chey, T.; Jackson, J.W.; Patel, V.; Silove, D. The Global Prevalence of Common Mental Disorders: A Systematic Review and Meta-Analysis 1980–2013. Int. J. Epidemiol. 2014, 43, 476–493. [Google Scholar] [CrossRef]
  34. Walker, J.; Burke, K.; Wanat, M.; Fisher, R.; Fielding, J.; Mulick, A.; Puntis, S.; Sharpe, J.; Esposti, M.D.; Harriss, E.; et al. The Prevalence of Depression in General Hospital Inpatients: A Systematic Review and Meta-Analysis of Interview-Based Studies. Psychol. Med. 2018, 48, 2285–2298. [Google Scholar] [CrossRef]
  35. Ferrari, S.; Mattei, G.; Marchi, M.; Galeazzi, G.M.; Pingani, L. Is Consultation-Liaison Psychiatry ‘Getting Old’? How Psychiatry Referrals in the General Hospital Have Changed over 20 Years. Int. J. Environ. Res. Public Health 2020, 17, 7389. [Google Scholar] [CrossRef] [PubMed]
  36. Hendlmeier, I.; Bickel, H.; Heßler-Kaufmann, J.B.; Schäufele, M. Care Challenges in Older General Hospital Patients: Impact of Cognitive Impairment and Other Patient-Related Factors. Z. Fur Gerontol. Und Geriatr. 2019, 52, 212–221. [Google Scholar] [CrossRef] [PubMed]
  37. Yamada, K.; Hosoda, M.; Nakashima, S.; Furuta, K.; Awata, S. Psychiatric Diagnosis in the Elderly Referred to a Consultation-Liaison Psychiatry Service in a General Geriatric Hospital in Japan. Geriatr. Gerontol. Int. 2012, 12, 304–309. [Google Scholar] [CrossRef] [PubMed]
  38. Hayashi, A.; Kobayashi, S.; Matsui, K.; Akaho, R.; Nishimura, K. The Accuracy of Delirium Assessment by Cardiologists Treating Heart Failure Inpatients: A Single Center Retrospective Survey. Biopsychosoc. Med. 2020, 14, 15. [Google Scholar] [CrossRef]
  39. Yasugi, D.; Tamune, H.; Sawamura, J.; Nishimura, K. Accuracy of Oncologist Assessments of Psychiatric Problems in Cancer Inpatients. Palliat. Support. Care 2018, 16, 41–49. [Google Scholar] [CrossRef]
  40. Weiss, A.; Scheeringa, M.S. Psychopharmacological Treatment of Delirium: Does Earlier Treatment and Scheduled Dosing Improve Outcomes? J. La. State Med. Soc. Off. Organ. La. State Med. Soc. 2014, 166, 242–247. [Google Scholar]
  41. Lee, S.; Gottlieb, M.; Mulhausen, P.; Wilbur, J.; Reisinger, H.S.; Han, J.H.; Carnahan, R. Recognition, Prevention, and Treatment of Delirium in Emergency Department: An Evidence-Based Narrative Review. Am. J. Emerg. Med. 2020, 38, 349–357. [Google Scholar] [CrossRef]
  42. Devasagayam, D.; Clarke, D. Evaluation of Consultation-Liaison Psychiatry Referrals from a Critical Care Unit of an Outer Suburban Hospital. Australas Psychiatry 2016, 24, 168–172. [Google Scholar] [CrossRef]
  43. Hassan, S.; Heinkel, S.; Burton, A.; Blackburn, R.; McCloud, T.; Ross, J.; Osborn, D.; Walters, K. A Qualitative Study Exploring the Barriers and Facilitators of Implementing a Cardiovascular Disease Risk Reducing Intervention for People with Severe Mental Illness into Primary Care Contexts across England: The “PRIMROSE” Trial. BMC Health Serv. Res. 2020, 20, 753. [Google Scholar] [CrossRef]
  44. Leentjens, A.F.G.; Rundell, J.R.; Wolcott, D.L.; Guthrie, E.; Kathol, R.; Diefenbacher, A. Reprint of: Psychosomatic Medicine and Consultation-Liaison Psychiatry: Scope of Practice, Processes, and Competencies for Psychiatrists Working in the Field of CL Psychiatry or Psychosomatics. A Consensus Statement of the European Association of Consultation-Liaison Psychiatry and Psychosomatics (EACLPP) and the Academy of Psychosomatic Medicine (APM). J. Psychosom. Res. 2011, 70, 486–491. [Google Scholar] [CrossRef]
  45. Wright, C.A.; Osborn, D.P.; Nazareth, I.; King, M.B. Prevention of Coronary Heart Disease in People with Severe Mental Illnesses: A Qualitative Study of Patient and Professionals’ Preferences for Care. BMC Psychiatry 2006, 6, 16. [Google Scholar] [CrossRef] [PubMed]
  46. Hansen, S.J.; Christensen, S.; Kongerslev, M.T.; First, M.B.; Widiger, T.A.; Simonsen, E.; Bach, B. Mental Health Professionals’ Perceived Clinical Utility of the ICD-10 vs. ICD-11 Classification of Personality Disorders. Personal. Ment. Health 2019, 13, 84–95. [Google Scholar] [CrossRef] [PubMed]
  47. Möller, H.-J. Systematic of Psychiatric Disorders between Categorical and Dimensional Approaches. Eur. Arch. Psychiatry Clin. Neurosci. 2008, 258, 48–73. [Google Scholar] [CrossRef] [PubMed]
  48. Campos, R.; Nieto, C.; Núñez, M. Research Domain Criteria from Neuroconstructivism: A Developmental View on Mental Disorders. Wiley Interdiscip. Rev. Cogn. Sci. 2019, 10, e1491. [Google Scholar] [CrossRef] [PubMed]
  49. National Institute of Mental Health. Research Domain Criteria (RDoC). Available online: https://www.nimh.nih.gov/research/research-funded-by-nimh/rdoc/index.shtml (accessed on 17 November 2020).
  50. Murray, S.B.; Nagata, J.M.; Griffiths, S.; Calzo, J.P.; Brown, T.A.; Mitchison, D.; Blashill, A.J.; Mond, J.M. The Enigma of Male Eating Disorders: A Critical Review and Synthesis. Clin. Psychol. Rev. 2017, 57, 1–11. [Google Scholar] [CrossRef] [PubMed]
  51. Zayas, L.V.; Wang, S.B.; Coniglio, K.; Becker, K.; Murray, H.B.; Klosterman, E.; Kay, B.; Bean, P.; Weltzin, T.; Franko, D.L.; et al. Gender Differences in Eating Disorder Psychopathology across DSM-5 Severity Categories of Anorexia Nervosa and Bulimia Nervosa. Int. J. Eat. Disord. 2018, 51, 1098–1102. [Google Scholar] [CrossRef]
  52. Vo, M.; Lau, J.; Rubinstein, M. Eating Disorders in Adolescent and Young Adult Males: Presenting Characteristics. J. Adolesc. Health 2016, 59, 397–400. [Google Scholar] [CrossRef]
  53. Mattei, G.; Moscara, M.; Balducci, J.; Cavana, S.; Cherubini, M.; Piemonte, C.; Ferrari, S.; Galeazzi, G.M. Stability of Psychiatric Diagnoses in Candidates to Liver Transplantation Referred to a Consultation-Liaison Psychiatry Service. J. Clin. Med. 2019, 8, 800. [Google Scholar] [CrossRef]
Table 1. Details of referrals.
Table 1. Details of referrals.
VariableN%
Gender
Female1018754.0
Male868546.0
Psychiatric anamnesis
Negative709750.6
Positive694049.4
Urgency
Non-urgent1189172.0
Urgent462228.0
Referring ward
Medical wards1371080.0
Surgical wards339820.0
Post-referral psychiatric admission
No1834797.1
Yes5412.9
Reason for referral
Depression493726.1
Agitation15348.1
Anxiety13797.3
Medically unexplained symptoms (MUS)12406.6
Alcohol or substance abuse9074.8
Delirium4362.3
Psychosis1730.9
Dementia780.4
Eating disorder630.3
Other814143.1
CL psychiatrist diagnosis
Depression418222.1
Adjustment disorder325017.2
Anxiety11836.3
Delirium11576.1
Alcohol or substance abuse11446.1
Dementia9575.1
Schizophrenia or psychosis5312.8
Somatization2181.2
Eating disorder1070.6
Other11546.1
None482826.2
MeanSD (Range)
Age57.818.1 (18–103)
N: Number (Frequency); %: percentages have been calculated on the subtotals, excluding missing values; CL: Consultation-liaison; SD: Standard deviation.
Table 2. Overall agreement on primary psychiatric diagnoses by CL psychiatrists and treating physicians.
Table 2. Overall agreement on primary psychiatric diagnoses by CL psychiatrists and treating physicians.
Reason for ReferralDiagnosisCohen’s Kappa
Abuse or intoxicationAlcohol or substance abuse/dependence0.574
Anxiety- Anxiety0.312
- Depression0.010
- Anxiety and depression0.134
- Adjustment disorder0.018
Depression- Anxiety<0.01
- Depression0.281
- Anxiety and depression0.223
- Adjustment disorder0.225
Anxiety and depression- Anxiety0.069
- Depression0.260
- Anxiety and depression0.305
- Adjustment disorder0.207
Eating disorderEating disorder0.315
- AgitationDelirium0.371
- Delirium0.342
- Agitation and delirium0.504
- AgitationDementia0.156
- Delirium0.030
- Dementia0.115
PsychosisSchizophrenia or psychosis0.202
MUSSomatization0.159
MUS: Medically unexplained symptoms.
Table 3. Comparison of inter-rater agreement: Referrals from medical wards vs. surgical wards.
Table 3. Comparison of inter-rater agreement: Referrals from medical wards vs. surgical wards.
Reason for ReferralDiagnosisCohen’s Kappa
Medical
Cohen’s Kappa
Surgical
Abuse or intoxicationAlcohol or substance abuse or dependence0.6010.415
Anxiety- Anxiety0.3220.319
- Depression<0.01<0.01
- Anxiety and depression0.0620.113
- Adjustment disorder0.019<0.01
Depression- Anxiety0.008<0.01
- Depression0.2840.258
- Anxiety and depression0.2630.224
- Adjustment disorder0.2250.289
Anxiety and Depression- Anxiety0.1350.153
- Depression0.2240.213
- Anxiety and depression0.3080.295
Adjustment disorder0.2070.267
Eating disorderEating disorder0.3100.545
- AgitationDelirium0.3640.414
- Delirium0.3530.345
- Agitation and delirium0.4910.566
- AgitationDementia0.177<0.01
- Delirium<0.01<0.01
- Dementia0.136<0.01
PsychosisSchizophrenia or psychosis0.2440.132
MUSSomatization0.1750.084
MUS: Medically unexplained symptoms.
Table 4. Comparison of inter-rater agreements: Urgent vs. non-urgent requests.
Table 4. Comparison of inter-rater agreements: Urgent vs. non-urgent requests.
Reason for ReferralDiagnosisCohen’s Kappa
Urgent
Cohen’s Kappa
Non-Urgent
Abuse or intoxicationAlcohol or substance abuse or dependence0.5420.583
Anxiety- Anxiety0.3860.274
- Depression<0.01<0.01
- Anxiety and depression0.188<0.01
- Adjustment disorder<0.01<0.01
Depression- Anxiety<0.01<0.01
- Depression0.2780.252
- Anxiety and depression0.2670.221
- Adjustment disorder0.1660.206
Anxiety and depression- Anxiety0.221<0.01
- Depression0.2060.200
- Anxiety and depression0.3710.250
- Adjustment disorder0.1330.198
Eating disorderEating disorder0.4320.287
- AgitationDelirium0.3820.342
- Delirium0.2860.379
- Agitation and delirium0.4980.497
- AgitationDementia0.1280.158
- Delirium<0.01<0.01
- Dementia<0.010.151
PsychosisSchizophrenia or psychosis0.2160.215
MUSSomatization0.1850.151
MUS: Medically unexplained symptoms.
Table 5. Comparison of inter-rater agreement: Positive psychiatric history vs. negative psychiatric history.
Table 5. Comparison of inter-rater agreement: Positive psychiatric history vs. negative psychiatric history.
Reason for ReferralDiagnosisCohen’s Kappa
Psy History+
Cohen’s KappaPsy
History−
Abuse or intoxicationAlcohol or substance abuse or dependence0.5560.556
Anxiety- Anxiety0.3780.264
- Depression<0.01<0.01
- Anxiety and depression<0.01<0.01
- Adjustment disorder<0.01<0.01
Depression- Anxiety<0.01<0.01
- Depression0.3120.194
- Anxiety and depression0.2830.166
- Adjustment disorder0.1950.224
Anxiety and depression- Anxiety0.1230.113
- Depression0.2550.122
- Anxiety and depression0.3480.192
- Adjustment disorder0.1830.212
Eating disorderEating disorder0.5240.125
- AgitationDelirium0.3460.434
- Delirium0.3100.292
- Agitation and delirium0.4440.560
- AgitationDementia0.179<0.01
- Delirium<0.01<0.01
- Dementia0.1420.134
PsychosisSchizophrenia or psychosis0.2290.191
MUSSomatization0.2400.110
MUS: Medically unexplained symptoms.
Table 6. Comparison of inter-rater agreement: 2000–2009 (first 10 years) vs. 2010–2019 (second 10 years).
Table 6. Comparison of inter-rater agreement: 2000–2009 (first 10 years) vs. 2010–2019 (second 10 years).
Reason for ReferralDiagnosisCohen’s Kappa 2000–2009Cohen’s Kappa 2010–2019
Abuse or intoxicationAlcohol or substance abuse or dependence0.5930.559
Anxiety- Anxiety0.1750.401
- Depression<0.01<0.01
- Anxiety and depression<0.01<0.01
- Adjustment disorder<0.01<0.01
Depression- Anxiety<0.01<0.01
- Depression0.1860.317
- Anxiety and depression0.1800.282
- Adjustment disorder0.1980.244
Anxiety and depression- Anxiety<0.010.160
- Depression0.1480.249
- Anxiety and depression0.1990.351
- Adjustment disorder0.1880.222
Eating disorderEating disorder<0.010.535
- AgitationDelirium0.1470.427
- Delirium0.3350.343
- Agitation and delirium0.3340.554
- AgitationDementia0.1850.141
- Delirium<0.01<0.01
- Dementia<0.010.189
PsychosisSchizophrenia or psychosis0.1190.293
MUSSomatization0.1410.227
MUS: Medically unexplained symptoms.
Table 7. Comparison of inter-rater agreement: Male vs. female patients.
Table 7. Comparison of inter-rater agreement: Male vs. female patients.
Reason for ReferralDiagnosisCohen’s Kappa MaleCohen’s Kappa Female
Abuse or intoxicationAlcohol or substance abuse or dependence0.5880.537
Anxiety- Anxiety0.3130.309
- Depression<0.01<0.01
- Anxiety and depression0.0710.065
- Adjustment disorder0.050<0.01
Depression- Anxiety0.022<0.01
- Depression0.2870.268
- Anxiety and depression0.2670.243
- Adjustment disorder0.2820.180
Anxiety and depression- Anxiety0.1520.118
- Depression0.2320.206
- Anxiety and depression0.3100.288
- Adjustment disorder0.2790.153
Eating disorderEating disorder0.4790.285
- AgitationDelirium0.3940.328
- Delirium0.3120.380
- Agitation and delirium0.5150.483
- AgitationDementia0.1320.185
- Delirium0.0220.037
- Dementia0.1020.127
PsychosisSchizophrenia or psychosis0.2410.163
MUSSomatization0.1750.150
MUS: Medically unexplained symptoms.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Back to TopTop