Next Article in Journal
Assessment of Neuromuscular and Psychological Function in People with Recurrent Neck Pain during a Period of Remission: Cross-Sectional and Longitudinal Analyses
Next Article in Special Issue
Allostatic Load as an Insight into the Psychological Burden after Primary Treatment in Women with Breast Cancer: Influence of Physical Side Effects and Pain Perception
Previous Article in Journal
Thrombosis Risk History and D-dimer Levels in Asymptomatic Individuals with Prader–Willi Syndrome
Previous Article in Special Issue
Triple-Negative Apocrine Breast Carcinoma Has Better Prognosis despite Poor Response to Neoadjuvant Chemotherapy
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Establishing an Expert Consensus on Key Indicators of the Quality of Life among Breast Cancer Survivors: A Modified Delphi Study

by
Izidor Mlakar
1,*,
Simon Lin
2,
Jama Nateqi
3,
Stefanie Gruarin
3,
Lorena Diéguez
4,
Paulina Piairo
4,
Liliana R. Pires
4,
Sara Tement
5,
Ilona Aleksandraviča
6,
Mārcis Leja
6,
Krista Arcimoviča
7,
Valérie Bleret
8,
Jean-François Kaux
9,
Philippe Kolh
10,
Didier Maquet
8,
Jesús Garcia Gómez
11,
Jesus García Mata
11,
Mercedes Salgado
12,
Matej Horvat
13,
Maja Ravnik
13,
Vojko Flis
13 and
Urška Smrke
1
add Show full author list remove Hide full author list
1
Faculty of Electrical Engineering and Computer Science, University of Maribor, 2000 Maribor, Slovenia
2
Data Science Department, Symptoma, 1030 Vienna, Austria
3
Medical Department, Symptoma, 4864 Attersee, Austria
4
RUBYnanomed, 4700-314 Braga, Portugal
5
Faculty of Arts, Department of Psychology, University of Maribor, 2000 Maribor, Slovenia
6
Institute of Clinical and Preventive Medicine of the University of Latvia, LV-1586 Riga, Latvia
7
Oncology Centre of Latvia, Riga East Clinical University Hospital, LV-1038 Riga, Latvia
8
Department of Senology, University Hospital of Liège, 4000 Liège, Belgium
9
Physical and Rehabilitation Medicine, University Hospital of Liège, 4000 Liège, Belgium
10
Department of Information Systems Management, University Hospital of Liège, 4000 Liège, Belgium
11
Oncology Department, University Hospital Complex of Ourense (SERGAS), 32005 Ourense, Spain
12
Department of Medical Oncology, Galician Health Services (SERGAS), 15703 Santiago de Compostela, A Coruña, Spain
13
Department of Oncology, University Medical Centre Maribor, 2000 Maribor, Slovenia
*
Author to whom correspondence should be addressed.
Submission received: 9 March 2022 / Revised: 1 April 2022 / Accepted: 4 April 2022 / Published: 5 April 2022
(This article belongs to the Collection Current Updates and Advances in Breast Cancer)

Abstract

:
(1) Background: The needs of cancer survivors are often not reflected in practice. One of the main barriers of the use of patient-reported outcomes is associated with data collection and the interpretation of patient-reported outcomes (PROs) due to a multitude of instruments and measuring approaches. The aim of the study was to establish an expert consensus on the relevance and key indicators of quality of life in the clinical practice of breast cancer survivors. (2) Methods: Potential indicators of the quality of life of breast cancer survivors were extracted from the established quality of life models, depicting survivors’ perspectives. The specific domains and subdomains of quality of life were evaluated in a two-stage online Delphi process, including an international and multidisciplinary panel of experts. (3) Results: The first round of the Delphi process was completed by 57 and the second by 37 participants. A consensus was reached for the Physical and Psychological domains, and on eleven subdomains of quality of life. The results were further supported by the additional ranking of importance of the subdomains in the second round. (4) Conclusions: The current findings can serve to optimize the use of instruments and address the challenges related to data collection and interpretation as the facilitators of the adaption in routine practice.

1. Background

The long-term effects of breast cancer and its treatment have been shown to have both positive and negative effects on the recovery and quality of life (QoL) of survivors [1,2], exceeding only physical effects. In developed countries, the mortality rate has declined significantly in recent years, due to improved screening, early diagnosis, and treatment programs [3,4]. Most patients seem to adjust well; however, over time, cancer survivors often start to suffer from decreased well-being [5,6]. The need to focus more on the QoL of cancer survivors is recognized by the EU Beating Cancer Plan [7], which supports the shift in focus from “‘how long’ people live after diagnosis, rather to ‘how well and how long’ they live” [6] (p. 21), and is recognized as one of the most important intervention areas to focus on by the European Commission’s Mission Board for Cancer [8].
QoL represents an essential end point in cancer survivorship, arguably as important as the therapy response, disease-free, and overall survival rates [9]. While there are a multitude of QoL definitions and models that, in focus, range from including only specific domains of QoL to approaches that emphasize the impact of cancer on persons’ health, it is clear that the definitions of the QoL of cancer survivors tend to be separated from those of cancer patients [10]. Ferrell et al. [11,12] developed a model of QoL specific to cancer survivors, which has been employed widely and consistently in the last two and a half decades. Even though since the first publication of the model, several variations and adaptations on it have been published [1,10,13,14], the four general domains are recognized consistently; i.e., the Physical, Psychological, Social, and Spiritual domains. Within the concept of four domains and subdomains, a multitude of questionnaires and patient-reported outcomes (PROs) were designed, for monitoring the well-being of breast and other cancer patients and survivors. The most widely used, such as the European Organization for Research and Treatment of Cancer core questionnaire (EORTC QLQ-C30) [15,16,17], Functional Assessment of Cancer Therapy—General (FACT-G) [18], and the BREAST—Q Patient-Reported Outcomes Instrument [19], focus predominantly on clinical over psychological factors. Other questionnaires, such as Cancer Problems in Living Scale (CPILS) [20], the multidimensional instrument measuring cancer-related fatigue (EORTC QLQ-FA12) [21], Quality of Life in Adult Cancer Survivors (QLACS) [22], and Quality of Life Cancer Survivors (QoL-CS) [11], have been developed to focus on psychosocial aspects and fatigue related to survivorship. These, however, do not include clinical or bodily/corporal condition-specific issues, and only limited information has been reported on their psychometric properties [23].
Patient-reported outcomes (PROs) are particularly important, since these tools can capture a patient’s subjective perception of the effect of their disease and treatment on the physical, psychological and social aspects of daily life [24] and can lead to person-centered survivorship, with a strong focus on prevention, early detection of late effects and timely intervention when health risks/conditions occur [25]. While individual questionnaires aim to capture the important QoL domains, in practice, where a global vision of a survivor would be favorable, an application of a multitude of these questionnaires to enable consideration of their targeted nuances of their overlapping domains is not feasible. Strongly differing approaches to the measurement of cancer patients’ and survivors’ well-being may also reflect a limited consensus of which domain(s) of the QoL should be monitored in detail. While little is known regarding the QoL of long-term breast cancer survivors, the issues resulting from breast cancer and its treatment are varied and complex, and those faced by survivors differ from the ones experienced by patients [26]. One of the main barriers to integrate PROs in clinical practice includes professionals’ lack of time and knowledge to interpret and integrate PRO data meaningfully into practice, and the inability for PRO data to be acted upon [27]. Furthermore, the issues are often explored in survivors living in the United States, limiting their generalizability to survivors in other countries [1]. Moreover, most of the existing questionnaires focus on the Physical and Psychological domains. However, the perspective of patients clearly highlights the importance of the four domains of survivor’s well-being, namely, Psychological, Social, Physical, and Spiritual [1,28]. Social and spiritual distress, including fertility preservation and family planning, are crucial issues yet to be addressed comprehensively by practice in all cancer patients and survivors, especially those of reproductive age [29,30,31].
The primary aim of this study is to establish an expert consensus on the key indicators of the QoL of breast cancer survivors from HCPs’ perspectives. The goal is not to replace existing tools, but to provide a consensus on the clinical importance of the domains and subdomains of QoL in the routine of breast cancer survivorship. This could, in turn, enable refining of the nature of existing, but especially, future questionnaires, and improve their integration by aligning them further with clinical practice. The already established domains and subdomains of QoL that depict cancer survivors’ perspectives were evaluated by healthcare professionals (HCPs), regarding their importance in the follow-up and monitoring of breast cancer survivors through a modified two-stage Delphi study. In order to aid to the generalizability of the findings in relation to the fields of expertise and healthcare systems and settings in the EU area, experts of various backgrounds involved in cancer care of long-term breast cancer survivors were involved from seven European countries.

2. Methods

The methodology of the present study consists of a modified Delphi procedure, adapted from related studies [32]. Similar to Tung et al. [33], a two-step strategy was applied to identify the most important domains and subdomains of QoL monitoring in the care of breast cancer survivors. First, a pool of potentially important subdomains of QoL was identified following the existing models of QoL applied to cancer patients and survivors. Second, an international multidisciplinary panel of experts evaluated these items in a two-round Delphi process, reaching a consensus on the most important subdomains of QoL.

2.1. QoL Domain and Subdomain Identification

A model of QoL in cancer survivors by Ferrell et al. [11] was chosen as a theoretical basis of the QoL domains and subdomains in this study. As several variations and adaptations, especially of its subdomains, exist, the first step of the study was the mapping of the subdomains among the variations of the model by Ferrell et al. [10,11,13,14], which enabled the identification of overlapping subdomains, as well as specific ones. The extracted subdomains were reviewed by the authors, and reformulated when needed to reach greater clarity, in order to represent an extensive list of clearly defined QoL subdomains. The resulting list was reviewed by HCPs and the researchers in the research team. Two additional subdomains, often observed in practice by the HCPs involved, were added (health distress in physical, and loss of interest in usual activities in the Psychological QoL domain), arriving at four general QoL domains (i.e., Physical, Psychological, Social, and Spiritual), and 35 subdomains, which formed the questionnaire items evaluated in Round 1 of the Delphi process.

2.2. QoL Domain and Subdomain Identification

The initial, preparatory phase of a Delphi process often consists of a qualitative, or a mix of qualitative and quantitative surveys, where experts are encouraged to provide insights into the researched topic [34,35]. In this case, the preparatory phase was carried out following a customizable approach [36]. As such, 8 researchers, clinical experts of the project Patients-centered SurvivorShIp care plan after Cancer treatments based on Big Data and Artificial Intelligence technologies (PERSIST) [37] carried out a review of the QoL models. The final questionnaire on the subdomains of QoL to be evaluated in the next phases was formulated based on an online discussion between the experts of the project PERSIST. In phase 2 an online survey was designed, evaluating the importance of the identified subdomains of the QoL, and conducted in two rounds. The two rounds were conducted in spring and fall 2020. In both rounds, potential participants received an invitation by e-mail explaining the study and a link to the online questionnaire. To be followed through both rounds, participants were given a unique ID at the beginning of the first round. Informed consent was sought at the beginning of each round. All procedures in this study were performed in accordance with the ethical standards of the Institutional and National Research Committees, and with the Helsinki Declaration and its amendments. A quantitative analysis was carried out in phase 3. The results of the analysis are reported in Section 3 of this research.
This study is part of a clinical study carried out under the project PERSIST [37], for which ethical approvals were obtained from the Institutional Ethics Committee of CHU de Liège (Approval Ref. No: 2020/248), Riga Eastern Clinical University Hospital Support Foundation Medical and Biomedical Research Ethics Committee (Approval Ref. No: 8-A/20), the National Ethics Committee, Ministry of Health, Slovenia (Approval Ref. No. 0120-352/2020/5), and the Pontevedra-Vigo-Ourense Research Ethics Committee (Approval Ref. No. 2020/394).

2.2.1. Participants

HCPs involved in the follow-up of breast cancer survivors were recruited for this study by an adapted method of Borgiel and colleagues [33,38]. Members of the research team acted as recruiters and contacted their professional peers, informing them about the study and inviting them to participate. Special emphasis was put on recruiting participants from various areas of expertise (e.g., Oncologists, Nurses, Psychologists, Physiotherapists). Since the healthcare systems and care paths for cancer patients and survivors can differ substantially between different countries, participants were recruited from seven European countries (i.e., Belgium, Italy, Latvia, Portugal, Slovenia, Spain, and Switzerland).
Altogether, 85 HCPs participated in the study. The Delphi method usually requires the inclusion of most of the experts in all survey rounds of the study. In the present study, the participation of experts involved in the first survey round was hindered significantly during the second quantitative round, due to the unavailability of many professionals during the COVID-19 pandemic. Therefore, only 15.8% of the participants in the first round were included in the second round of the study. The recruitment process of round 1 (email invitations) was repeated to obtain generalizable results. The impact of the low overlap between the first and second quantitative rounds is discussed further under Study Limitations.

2.2.2. Questionnaire

The questionnaire for the first round consisted of 39 subdomains identified in the review of existing QoL models, i.e., the variations of the model by Ferrell et al. [10,11,13,14] (see Section 2.1). Participants were asked to rate their importance in the follow-up of the breast cancer survivors on a 7-point scale (1—not important; 7—very important). For the second-round questionnaire, subdomains were retained that reached the consensus criterion (see Section 2.2.3) in the first round. Participants were provided feedback in the form of the median answer and percentage of participants giving that answer in the first round for each subdomain. Participants rated the importance for the retained subdomains again on the 7-point scale. In the second round, participants were additionally asked to rank the subdomains in order of importance.

2.2.3. Consensus Criterion and Analyses

While there is no generally accepted rule for establishing the criterion for consensus in Delphi studies, one of the most common approaches is setting a specific percentage level of agreement, which varies from 51 to 100% [34,35]. This approach was also followed in the present study, setting the criterion at 75% (similar to [39,40]).
In the first round, consensus for a subdomain was reached if at least 75% of participants evaluated it within the top three scores of a 7-point scale. A stricter criterion was applied in the second round. The consensus was reached if at least 75% of the participants evaluated a subdomain within the top two scores of the 7-point scale.
Intraclass correlation coefficients (ICC) based on a mean-rating 2-way mixed-effects model were calculated, to assess the consistency of the raters for each round. Since the second round included two groups of participants, namely, the experts who were already included in the first round and additional ones included only in the second round, t-tests were calculated for assessing the possible differences between the judgments of these two groups. Analyses were performed using R version 4.0.3 [41] (and the packages psych [42] and rstatix [43]).

3. Results

3.1. Round 1

The questionnaire for Round 1 of the study was completed by 57 experts (see Table 1). The results of interrater reliability analysis indicated good to excellent reliability [44] of the raters, with ICC (2, 57) = 0.90, 95% CI (0.86, 0.93).
The consensus was reached for three of the four general domains (75.00%; see Table 2), namely, Physical, Psychological, and Social QoL, and 30 of the 35 subdomains (85.71%): In the Physical and Psychological QoL domains, all the subdomains reached a consensus (i.e., 10, 100.00% for both domains). In the domain of Social QoL, 8 out of 10 subdomains (80.00%), and in the Spiritual QoL domain, 2 out of 5 (40.00%) subdomains reached a consensus.

3.2. Round 2

The questionnaire for Round 2 was completed by 9 participants (15.79%) who participated in Round 1 (Group 1), and an additional 28 participants (Group 2; see Table 1), resulting in a total of 37 participants with good reliability of their ratings [44], ICC (2, 37) = 0.85, 95% CI [0.78, 0.91]. Given that independent samples t-tests indicated (see Table 2) that the two groups did not differ significantly in their mean evaluations of the QoL subdomains, it was concluded that the results of Round 2 reflected the opinion of both groups.
The consensus was reached for two out of three general domains (66.67%), namely, Physical and Psychological QoL. The consensus reached on the level of subdomains, 11 of 30 (36.67%), were as follows: Physical QoL 7 out of 10 (70.00%), Psychological QoL 2 out of 10 (20.00%), Social QoL 1 out of 8 (12.50%), and Spiritual QoL 1 of 2 (50.00%). In Round 2, participants were also asked to rank the importance of the subdomains (see Table 3).
The questionnaire for Round 2 was completed by 9 participants (15.79%) who participated in Round 1 (Group 1), and an additional 28 participants (Group 2; see Table 1), resulting in a total of 37 participants with good reliability of their ratings [44], ICC (2, 37) = 0.85, 95% CI [0.78, 0.91]. Given that independent samples t-tests indicated (see Table 2) that the two groups did not differ significantly in their mean evaluations of the QoL subdomains, it was concluded that the results of Round 2 reflected the opinion of both groups.

4. Discussion

Breast cancer survivors have complex and specific needs, often not reflected in clinical practice. The use of PROs in clinical practice has the potential to mitigate this issue and promote patient-centered, personalized care. There are a multitude of PROs measuring QoL and patient experiences available; however, only limited consensus has been reported on the subdomains of QoL to be monitored. In practice this is reflected through a slow uptake of PROs in routine practice, due to issues related to data collection (i.e., multiple instruments to be filled in by participants), data interpretation, and regulatory challenges due to ubiquitous understanding of patient experiences. Further, the current QoL questionnaires focus mostly on the Physical and Psychological domains, and mostly disregard the Social and Spiritual domains, deemed important by survivors themselves. Therefore, the present study aimed to establish an expert consensus on the key indicators of QoL subdomains, among breast cancer survivors, to constitute person-centered breast cancer survivorship.
Only a part of the QoL subdomains was recognized as important for monitoring breast cancer survivors from the HCPs’ perspectives. After two rounds of the study, two out of four general domains (i.e., Physical and Psychological QoL) proved to be important from the perspective of HCPs in the monitoring of breast cancer survivors, suggesting a predominant focus on two domains in daily practice. However, on the level of subdomains, the consensus was reached for several of them—not only within the Physical and Psychological QoL, but also within the domains of Social and Spiritual QoL.
These results were mostly supported by mean ranks of the importance of subdomains from the second round, i.e., on the level of general domains, Physical, Psychological, and Spiritual QoL, where, in general, subdomains that reached a consensus also reached lower mean ranks scores, implying higher importance. Some discrepancies between ranking and consensus results were observed in the subdomains of Psychological QoL, where the anxiety subdomain did not reach a consensus but surpassed, in importance, the depression and psychological distress subdomains, for which a consensus was reached. Similarly, within the Social QoL domain, the subdomain of role limitations (the only one that reached a consensus), was surpassed in importance ranking by five other subdomains. Such discrepancies may reflect the aforementioned predominant focus on Physical QoL in clinical practice—with less focus on other areas, the experts’ opinion might not be as elaborated as for the Physical QoL, and could, therefore, be more sensitive to the method of reporting, or be formed in the process of participation in the survey. A general consensus on importance but missing consensus on specific subdomains might also reflect differences in the value systems of cultures, religions, social groups, etc., but also a lack of objective instruments to account for these differences.
Nevertheless, there are several tools available for assessing the QoL of breast cancer patients and survivors (for review, see [1]), but none were found that would somewhat specifically reflect the results of our study. Being breast cancer specific and on the level of general domains assessing the physical and psychological (and additionally, social) aspects of the QoL, the Functional Assessment of Cancer Therapy-Breast (FACT-B) [46] appears to be reasonably aligned with the key subdomains identified in this study (with some important differences, for instance, regarding the Spiritual subdomains). Further, also specific for breast cancer survivors is the European Organization for Research and Treatment of Cancer-Breast Module (EORTC QLQ-BR23) [47], but it focuses mainly only on the Physical domain of the QoL [1]. Other identified questionnaires are more general in the target population or specific to other cancer types and vary substantially in the subdomains covered.
To measure the key indicators of the QoL of breast cancer survivors effectively, further studies are needed; that is, on the level of consensus on the indicators between HCPs and survivors, and also on the level of questionnaires, reflecting these indicators. Monitoring in the role of supporting the QoL of breast cancer survivors can be improved with the established consensus and corresponding questionnaires.

Study Limitations

First, the low overlap of participants in both rounds represents a deviation from the standard Delphi methodology [34,35]. However, as Tung et al. [33] pointed out, the Delphi procedure is, to some extent, biased, as “the judgments of this expert panel may not be representative of all experts who were qualified to participate” [33] (p. 1225). Therefore, the inclusion of additional participants in the second round can help achieve a higher level of generalizability, which is also supported by the multidisciplinary and international make-up of the expert panel.
Second, the experts evaluated an already defined list of QoL subdomains, potentially limiting their own contributions to the topic. However, as Pietersma et al. [32] stated for a similar modification, evaluating a predefined set of domains can be less demanding cognitively, and it ensures that not only those domains are included that participants can think of easily. Additionally, since the included subdomains are based on QoL models for breast cancer patients, this represents a high probability that a sufficiently extensive pool of subdomains was included. Although the present study evaluates models of QoL, designed for and in collaboration with, breast cancer patients, the study did not involve patients directly. It reflects a subjective perception from the HCPs’ perspectives.
Third, age and the length of survivorship represent important confounders in further ranking on the importance of the subdomains of the QoL model. Namely, early survivorship represents a time-critical period, during which survivors of breast cancer attempt to resume functional activities and important life roles [48]. During this period, self-image, fatigue and the side effects of medication represent a significant burden, whereas, for long-term survivors, the highest unmet needs relate to the Health System and Information domain [49]. Furthermore, young cancer survivors are often burdened with fertility preservation and family planning [29], whereas older cancer survivors are faced with age-related declines in functioning, comorbid illnesses, and diminished social and economic resources [50,51].This limitation should be addressed in future studies.

5. Conclusions

The current Delphi study exploited the already established perspectives of breast cancer survivors on QoL, and through a two-round process, reached an expert consensus on the most important subdomains for the monitoring of breast cancer survivors. The goal of this study was to identify the key indicators of the QoL of breast cancer survivors from the experts’ perspectives, i.e., those that have an important impact on the design/delivery of the survivorship pathway. The results show clearly that consensus was reached on the Physical and Psychological domains, and on 11 of 30 subdomains. This study may serve as the baseline towards optimization and standardization of instruments to be used in the routine monitoring of breast cancer survivorship. The study clearly supports the notion that there is a certain level of mismatch between expert perception of what is important and the key indicators of QoL identified by patients. This study further highlights the importance of including both HCPs and patients when setting research priorities, and in designing a patient-centered approach to cancer survivorship care. Further studies, however, are needed, to establish a way for these findings to truly enhance the support breast cancer survivors receive. To truly appreciate the subjective perception of a patient, a comparative study with cancer patients and survivors should be carried out. In this way ‘a lack of value’ may be prevented, which is often perceived by patients [27]. Furthermore, differences in personal value systems of breast cancer survivors, depending both on their age and on the duration of survivorship, should be analyzed and reflected in further refinements of patient-centric QoL models.

Author Contributions

Conceptualization, I.M. and U.S.; Data curation, I.M.; Formal analysis, U.S.; Funding acquisition, I.M., J.N., L.D., M.L., P.K., M.S. and V.F.; Investigation, I.M. and U.S.; Methodology, I.M., S.L., J.N., S.G., L.D., P.P., L.R.P., S.T., I.A., M.L., K.A., V.B., J.-F.K., P.K., D.M., J.G.G., J.G.M., M.S., M.H., M.R., V.F. and U.S.; Project administration, I.M., J.N., L.D., M.L., P.K., M.S. and V.F.; Writing—original draft, I.M., L.D., S.T. and U.S.; Writing—review and editing, I.M., S.L., J.N., S.G., L.D., P.P., L.R.P., S.T., I.A., M.L., K.A., V.B., J.-F.K., P.K., D.M., J.G.G., J.G.M., M.S., M.H., M.R., V.F. and U.S. All authors have read and agreed to the published version of the manuscript.

Funding

This work received funding from the European Union Horizon 2020 Research and Innovation Program, the project PERSIST, supported under Grant Agreement no. 875406. The content of this paper does not reflect the official opinion of the European Union or any other institution. Responsibility for the information and views expressed therein lies entirely with the authors.

Institutional Review Board Statement

This study is part of a clinical study carried out under the project PERSIST, a study protocol registered under ISRCTN97617326, for which ethical approvals were obtained from the Institutional Ethics Committee of CHU de Liège (Approval Ref. No: 2020/248), the Riga Eastern Clinical University Hospital Support Foundation Medical and Biomedical Research Ethics Committee (Approval Ref. No: 8-A/20), the National Ethics Committee, Ministry of Health, Slovenia (Approval Ref. No. 0120-352/2020/5), and the Pontevedra-Vigo-Ourense Research Ethics Committee (Approval Ref. No. 2020/394).

Informed Consent Statement

Informed consent of the participants was sought at the beginning of the study. All procedures in this study were performed in accordance with the ethical standards of the Institutional and National Research Committees and with the Helsinki Declaration and its amendments.

Data Availability Statement

The dataset used and analyzed during the current study is available from the corresponding author upon reasonable request.

Conflicts of Interest

The authors declare no conflict of interest. At the time of submission, Jama Nateqi is CEO of Symptoma. Simon Lin and Stefanie Gruarinare were employed by Symptoma. At the time of submission, Lorena Diéguez is the CEO at RUBYnanomed. Paulina Piairo and Liliana R. Pires were employed by RUBYnanomed. The funder had no role in the design of the study, in the collection, analyses, or interpretation of data, in the writing of the manuscript, or in the decision to publish the results.

References

  1. Chopra, I.; Kamal, K.M. A systematic review of quality of life instruments in long-term breast cancer survivors. Health Qual. Life Outcomes 2012, 10, 1–15. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Ośmiałowska, E.; Misiąg, W.; Chabowski, M.; Jankowska-Polańska, B. Coping strategies, pain, and quality of life in patients with breast cancer. J. Clin. Med. 2021, 10, 4469. [Google Scholar] [CrossRef] [PubMed]
  3. Siegel, R.L.; Miller, K.D.; Jemal, A. Cancer statistics, 2019. CA Cancer J. Clin. 2019, 69, 7–34. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Wojtyla, C.; Bertuccio, P.; Wojtyla, A.; La Vecchia, C. European trends in breast cancer mortality, 1980–2017 and predictions to 2025. Eur. J. Cancer 2021, 152, 4–17. [Google Scholar] [CrossRef]
  5. Von Blanckenburg, P.; Seifart, U.; Conrad, N.; Exner, C.; Rief, W.; Nestoriuc, Y. Quality of life in cancer rehabilitation: The role of life goal adjustment. Psycho-Oncology 2014, 23, 1149–1156. [Google Scholar] [CrossRef]
  6. Lahousse, A.; Roose, E.; Leysen, L.; Yilmaz, S.T.; Mostaqim, K.; Reis, F.; Rheel, E.; Beckwée, D.; Nijs, J. Lifestyle and pain following cancer: State-of-the-art and future directions. J. Clin. Med. 2022, 11, 195. [Google Scholar] [CrossRef]
  7. European Commission (EC). Europe’s Beating Cancer Plan Communication from the Commission to the European Parliament and the Council; European Commission (EC): Brussels, Belgium, 2021; Available online: https://ec.europa.eu/health/system/files/2022-02/eu_cancer-plan_en_0.pdf (accessed on 1 March 2022).
  8. European Commission (EC). Research and Innovation. Conquering Cancer: Mission Possible Report of the Mission Board for Cancer; European Commission (EC): Luxembourg, 2020; Available online: https://ec.europa.eu/info/publications/conquering-cancer-mission-possible_en (accessed on 1 March 2022).
  9. Kurihara, M.; Shimizu, H.; Tsuboi, K.; Kobayashi, K.; Murakami, M.; Eguchi, K.; Shimozuma, K. Development of quality of life questionnaire in Japan: Quality of life assessment of cancer patients receiving chemotherapy. Psycho-Oncology 1999, 8, 355–363. [Google Scholar] [CrossRef]
  10. Lavdaniti, M.; Tsitsis, N. Definitions and conceptual models of quality of life in cancer patients. Health Sci. J. 2015, 9, 1–5. [Google Scholar]
  11. Ferrell, B.R.; Hassey Dow, K.; Grant, M. Measurement of the quality of life in cancer survivors. Qual. Life Res. 1995, 4, 523–531. [Google Scholar] [CrossRef]
  12. Mols, F.; Vingerhoets, A.J.J.M.; Coebergh, J.W.; van de Poll-Franse, L.V. Quality of life among long-term breast cancer survivors: A systematic review. Eur. J. Cancer 2005, 41, 2613–2619. [Google Scholar] [CrossRef] [Green Version]
  13. Muñoz, C.; Juarez, G.; Muñoz, M.L.; Portnow, J.; Fineman, I.; Badie, B.; Mamelak, A.; Ferrell, B. The quality of life of patients with malignant gliomas and their caregivers. Soc. Work Health Care 2008, 47, 455–478. [Google Scholar] [CrossRef] [PubMed]
  14. Mollica, M.; Newman, S.D. Breast cancer in African Americans: From patient to survivor. J. Transcult. Nurs. 2014, 25, 334–340. [Google Scholar] [CrossRef] [PubMed]
  15. Aaronson, N.K.; Ahmedzai, S.; Bergman, B.; Bullinger, M.; Cull, A.; Duez, N.J.; Filiberti, A.; Flechtner, H.; Fleishman, S.B.; De Haes, J.C.J.M.; et al. The European Organization for Research and Treatment of Cancer QLQ-C30: A quality-of-life instrument for use in international clinical trials in oncology. J. Natl. Cancer Inst. 1993, 85, 365–376. [Google Scholar] [CrossRef] [PubMed]
  16. Fayers, P.; Bottomley, A. Quality of life research within the EORTC—The EORTC QLQ-C30. Eur. J. Cancer 2002, 38, 125–133. [Google Scholar] [CrossRef]
  17. Van Leeuwen, M.; Husson, O.; Alberti, P.; Arraras, J.I.; Chinot, O.L.; Costantini, A.; Darlington, A.-S.; Dirven, L.; Eichler, M.; Hammerlid, E.B.; et al. Understanding the quality of life (QOL) issues in survivors of cancer: Towards the development of an EORTC QOL cancer survivorship questionnaire. Health Qual. Life Outcomes 2018, 16, 1–15. [Google Scholar] [CrossRef] [Green Version]
  18. Cella, D.F.; Tulsky, D.S.; Gray, G.; Sarafian, B.; Linn, E.; Bonomi, A.; Silberman, M.; Yellen, S.B.; Winicour, P.; Brannon, J.; et al. The Functional Assessment of Cancer Therapy scale: Development and validation of the general measure. J. Clin. Oncol. 1993, 11, 570–579. [Google Scholar] [CrossRef]
  19. Pusic, A.L.; Klassen, A.F.; Scott, A.M.; Klok, J.A.; Cordeiro, P.G.; Cano, S.J. Development of a new patient-reported outcome measure for breast surgery: The BREAST-Q. Plast. Reconstr. Surg. 2009, 124, 345–353. [Google Scholar] [CrossRef]
  20. Zhao, L.; Portier, K.; Stein, K.; Baker, F.; Smith, T. Exploratory factor analysis of the cancer problems in living scale: A report from the American Cancer Society’s Studies of Cancer Survivors. J. Pain Symptom Manag. 2009, 37, 676–686. [Google Scholar] [CrossRef]
  21. Weis, J.; Wirtz, M.A.; Tomaszewski, K.A.; Hammerlid, E.; Arraras, J.I.; Conroy, T.; Lanceley, A.; Schmidt, H.; Singer, S.; Pinto, M.; et al. Sensitivity to change of the EORTC quality of life module measuring cancer-related fatigue (EORTC QlQ-Fa12): Results from the international psychometric validation. Psycho-Oncology 2019, 28, 1753–1761. [Google Scholar] [CrossRef]
  22. Avis, N.E.; Ip, E.; Foley, K.L. Evaluation of the Quality of Life in Adult Cancer Survivors (QLACS) scale for long-term cancer survivors in a sample of breast cancer survivors. Health Qual. Life Outcomes 2006, 4, 1–92. [Google Scholar] [CrossRef]
  23. Muzzatti, B.; Annunziata, M.A. Assessing quality of life in long-term cancer survivors: A review of available tools. Support. Care Cancer 2013, 21, 3143–3152. [Google Scholar] [CrossRef] [PubMed]
  24. Sitlinger, A.; Zafar, S.Y. Health-related quality of life: The impact on morbidity and mortality. Surg. Oncol. Clin. N. Am. 2018, 27, 675–684. [Google Scholar] [CrossRef] [PubMed]
  25. Van Kalsbeek, R.J.; van der Pal, H.J.; Hjorth, L.; Winther, J.F.; Michel, G.; Haupt, R.; Uyttebroeck, A.; O’Brien, K.; Kepakova, K.; Follin, C.; et al. The European multistakeholder PanCareFollowUp project: Novel, person-centred survivorship care to improve care quality, effectiveness, cost-effectiveness and accessibility for cancer survivors and caregivers. Eur. J. Cancer 2021, 153, 74–85. [Google Scholar] [CrossRef] [PubMed]
  26. Doege, D.; Thong, M.S.-Y.; Koch-Gallenkamp, L.; Bertram, H.; Eberle, A.; Holleczek, B.; Pritzkuleit, R.; Waldeyer-Sauerland, M.; Waldmann, A.; Zeissig, S.R.; et al. Health-related quality of life in long-term disease-free breast cancer survivors versus female population controls in Germany. Breast Cancer Res. Treat. 2019, 175, 499–510. [Google Scholar] [CrossRef]
  27. Nguyen, H.; Butow, P.; Dhillon, H.; Sundaresan, P. A review of the barriers to using Patient-Reported Outcomes (PROs) and Patient-Reported Outcome Measures (PROMs) in routine cancer care. J. Med. Radiat. Sci. 2021, 68, 186–195. [Google Scholar] [CrossRef]
  28. Anderson, R.A.; Clatot, F.; Demeestere, I.; Lambertini, M.; Morgan, A.; Nelson, S.M.; Peccatori, F.; Cameron, D. Cancer survivorship: Reproductive health outcomes should be included in standard toxicity assessments. Eur. J. Cancer 2021, 144, 310–316. [Google Scholar] [CrossRef]
  29. Zaami, S.; Melcarne, R.; Patrone, R.; Gullo, G.; Negro, F.; Napoletano, G.; Monti, M.; Aceti, V.; Panarese, A.; Borcea, M.C.; et al. Oncofertility and reproductive counseling in patients with breast cancer: A retrospective study. J. Clin. Med. 2022, 11, 1311. [Google Scholar] [CrossRef]
  30. Selman, L.E.; Brighton, L.J.; Sinclair, S.; Karvinen, I.; Egan, R.; Speck, P.; Powell, R.A.; Deskur-Śmielecka, E.; Glajchen, M.; Adler, S.; et al. Patients’ and caregivers’ needs, experiences, preferences and research priorities in spiritual care: A focus group study across nine countries. Palliat. Med. 2018, 32, 216–230. [Google Scholar] [CrossRef] [Green Version]
  31. Sieverding, M.; Ungar, N.; Fleischmann, A.; Lee, M.; Zhang, H.; Mohnke, M.; Specht, N.K.; Weidner, G. Prevalence and frequency of self-management strategies among female cancer survivors: The neglected roles of social relations and conscious living. Support. Care Cancer 2020, 28, 607–616. [Google Scholar] [CrossRef]
  32. Pietersma, S.; de Vries, M.; van den Akker-Van Marle, M.E. Domains of quality of life: Results of a three-stage Delphi consensus procedure among patients, family of patients, clinicians, scientists and the general public. Qual. Life Res. 2014, 23, 1543–1556. [Google Scholar] [CrossRef] [Green Version]
  33. Tung, J.; Speechley, K.N.; Gofton, T.; Gonzalez-Lara, L.E.; Graham, M.; Naci, L.; Peterson, A.H.; Owen, A.M.; Weijer, C. Towards the assessment of quality of life in patients with disorders of consciousness. Qual. Life Res. 2020, 29, 1217–1227. [Google Scholar] [CrossRef] [PubMed]
  34. Hasson, F.; Keeney, S.; McKenna, H. Research guidelines for the Delphi survey technique. J. Adv. Nurs. 2000, 32, 1008–1015. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Powell, C. The Delphi technique: Myths and realities. J. Adv. Nurs. 2003, 41, 376–382. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  36. Beiderbeck, D.; Frevel, N.; von der Gracht, H.A.; Schmidt, S.L.; Schweitzer, V.M. Preparing, conducting, and analyzing Delphi surveys: Cross-disciplinary practices, new directions, and advancements. MethodsX 2021, 8, 101401. [Google Scholar] [CrossRef] [PubMed]
  37. Mlakar, I.; Lin, S.; Aleksandraviča, I.; Arcimoviča, K.; Eglītis, J.; Leja, M.; Salgado Barreira, Á.; Gómez, J.G.; Salgado, M.; Mata, J.G.; et al. Patients-centered SurvivorShIp care plan after Cancer treatments based on Big Data and Artificial Intelligence technologies (PERSIST): A multicenter study protocol to evaluate efficacy of digital tools supporting cancer survivors. BMC Med. Inform. Decis. Mak. 2021, 21, 1–14. [Google Scholar] [CrossRef]
  38. Borgiel, A.E.M.; Dunn, E.V.; Lamont, C.T.; Macdonald, P.J.; Evensen, M.K.; Bass, M.J.; Spasoff, R.A.; Williams, J.I. Recruiting family physicians as participants in research. Fam. Pr. 1989, 6, 168–172. [Google Scholar] [CrossRef]
  39. Vanmeerbeek, M.; Govers, P.; Schippers, N.; Rieppi, S.; Mortelmans, K.; Mairiaux, P. Searching for consensus among physicians involved in the management of sick-listed workers in the Belgian health care sector: A qualitative study among practitioners and stakeholders. BMC Public Health 2016, 16, 164. [Google Scholar] [CrossRef] [Green Version]
  40. Freitas, Â.; Santana, P.; Oliveira, M.D.; Almendra, R.; Bana E Costa, J.C.; Bana E Costa, C.A. Indicators for evaluating European population health: A Delphi selection process. BMC Public Health 2018, 18, 557. [Google Scholar] [CrossRef]
  41. R Core Team. R: A Language and Environment for Statistical Computing; R Foundation: Vienna, Austria, 2018; Available online: https://www.R-project.org/ (accessed on 1 March 2022).
  42. Revelle, W. Psych: Procedures for Psychological, Psychometric, and Personality Research (R Package Version 1.9.4). [Computer Software]; Northwestern University: Evanston, IL, USA, 2019. [Google Scholar]
  43. Kassambara, A. Rstatix: Pipe-Friendly Framework for Basic Statistical Tests; [Computer Software]; GitHub, Inc.: San Francisco, CA, USA, 2021; Available online: https://github.com/kassambara/rstatix (accessed on 1 March 2022).
  44. Koo, T.K.; Li, M.Y. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J. Chiropr. Med. 2016, 15, 155–163. [Google Scholar] [CrossRef] [Green Version]
  45. Benjamini, Y.; Hochberg, Y. Controlling the false discovery rate: A practical and powerful approach to multiple testing. J. R. Stat. Soc. Ser. B Methodol. 1995, 57, 289–300. [Google Scholar] [CrossRef]
  46. Basen-Engquist, K.; Bodurka-Bevers, D.; Fitzgerald, M.A.; Webster, K.; Cella, D.; Hu, S.; Gershenson, D.M. Reliability and validity of the functional assessment of cancer therapy–ovarian. J. Clin. Oncol. 2001, 19, 1809–1817. [Google Scholar] [CrossRef] [PubMed]
  47. Sprangers, M.A.; Groenvold, M.; Arraras, J.I.; Franklin, J.; te Velde, A.; Muller, M.; Franzini, L.; Williams, A.; De Haes, H.C.; Hopwood, P.; et al. The European Organization for Research and Treatment of Cancer breast cancer-specific quality-of-life questionnaire module: First results from a three-country field study. J. Clin. Oncol. 1996, 14, 2756–2768. [Google Scholar] [CrossRef] [PubMed]
  48. Keesing, S.; Rosenwax, L.; McNamara, B. The implications of women’s activity limitations and role disruptions during breast cancer survivorship. Women’s Health 2018, 14, 1745505718756381. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  49. Park, B.-W.; Hwang, S.Y. Unmet needs of breast cancer patients relative to survival duration. Yonsei Med. J. 2012, 53, 118–125. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  50. Krok-Schoen, J.L.; Naughton, M.J.; Noonan, A.M.; Pisegna, J.; DeSalvo, J.; Lustberg, M.B. Perspectives of survivorship care plans among older breast cancer survivors: A pilot study. Cancer Control 2020, 27, 1073274820917208. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  51. Bellizzi, K.M.; Mustian, K.M.; Palesh, O.G.; Diefenbach, M. Cancer survivorship and aging: Moving the science forward. In Proceedings of the Society of Behavioral Medicine preconference “Cancer and Aging: Challenges and Opportunities across the Cancer Control Continuum”, Washington, DC, USA, 21 March 2007; American Cancer Society: Atlanta, GA, USA, 2008; Volume 113. [Google Scholar]
Table 1. Participants’ characteristics. Group 1: Participants included in both rounds. Group 2: Participants included only in the 2nd round.
Table 1. Participants’ characteristics. Group 1: Participants included in both rounds. Group 2: Participants included only in the 2nd round.
Round 1Round 2Group 1Group 2
All Participants
f%f%f%f%
N 57 37 9 28
GenderFemale4070.182772.97777.782071.43
Male1729.821027.03222.22828.57
SpecialtyGynecology11.75------
Kinesitherapy11.75------
Medical oncology 1526.321027.03333.33725.00
Nuclear medicine23.51------
Nursing 23.51------
Oncology nursing 712.2812.70--13.57
(Oncology) Research 23.51-----
Pathology11.75------
Pharmacy 47.02------
Physiotherapy 11.75513.51--517.86
Psychiatry11.75------
Psychology 58.7738.11--310.71
Psychotherapy 23.51------
Radiology 35.2625.41--27.14
Radiotherapy 610.53718.92333.33414.29
Surgery 58.77513.51111.11414.29
Teacher11.75------
Volunteer11.75------
Other1628.07410.81222.2227.14
CountryBelgium1526.321745.95444.441346.43
Italy--410.81--414.29
Latvia47.02513.51111.11414.29
Portugal2849.1238.11111.1127.14
Slovenia47.0238.11111.1127.14
Spain 610.53410.81222.2227.14
Switzerland--12.70--13.57
Years in practiceM14.98 10.97 11.33 10.85
SD10.50 7.89 8.87 7.72
Table 2. Delphi Round 1 and 2: QoL subdomains, mean ratings with Standard Deviations, and consensus.
Table 2. Delphi Round 1 and 2: QoL subdomains, mean ratings with Standard Deviations, and consensus.
Round 1Round 2
All ParticipantsGroup 1 cGroup 2 dt-Test e
MSD% Agreement aCR bMSDMSDMSDAdj. p f% Agreement gCR h
General domains
Physical QoL6.400.898.3*6.700.786.890.336.640.870.91494.6*
Psychological QoL6.280.994.7*6.700.816.780.676.680.860.93189.2*
Social QoL5.671.1184.2*5.810.885.440.735.930.90.79967.6-
Spiritual QoL5.251.5768.4----------
Physical QoL
Functional ability and mobility6.130.8898.2*5.970.776.110.335.930.870.93188.9*
Activities of daily living6.050.9590.9*5.940.796.220.675.850.820.91486.1*
Fatigue/vitality6.130.9296.4*5.970.746.330.505.850.770.69891.7*
Sleep and rest6.040.9494.6*5.940.865.890.785.960.900.93175.0*
Pain and discomfort6.550.66100.0*6.810.586.890.336.780.640.93197.2*
Health perceptions5.651.1785.5*5.560.975.560.885.561.011.00058.3-
Physical symptoms6.220.9494.6*6.140.546.220.446.110.580.93197.2*
Health distress5.911.0990.9*5.920.845.890.605.930.920.94775.0*
Weight loss/gain5.691.2785.5*5.581.205.671.125.561.250.93163.9-
Physical health and comorbidities5.930.8894.6*5.751.085.780.835.741.160.94772.2-
Psychological QoL
Anxiety5.931.0390.9*5.910.855.781.095.960.770.93165.7-
Depression6.070.8894.6*5.860.976.110.65.771.070.91485.7*
Psychological distress5.851.1083.6*6.060.806.000.876.080.800.93177.1*
Cognitive functioning, concentration, and attention5.691.0987.3*5.630.915.220.835.770.910.79957.1-
Uncertainty5.311.1876.4*5.290.994.780.675.461.030.69837.1-
Fear of recurrence5.731.0190.9*5.570.955.440.885.620.980.93151.4-
Isolation/abandonment and feelings of belonging5.730.9389.1*5.540.925.330.875.620.940.93162.9-
Positive feelings and affect5.890.9692.7*6.140.946.001.006.190.940.93168.6-
Negative feelings and affect5.691.0785.5*5.771.176.001.005.691.230.93171.4-
Loss of interest in usual activities5.651.0085.5*5.890.875.780.675.920.930.93168.6-
Social QoL
Family functioning5.731.0387.3*5.480.975.330.505.541.100.93151.5-
Martial functioning5.401.1683.6*5.271.075.220.975.291.120.94748.5-
Affection/sexuality5.271.3072.7-
Self-concept/appearance5.711.0587.3*5.820.886.110.935.710.860.91463.6-
Enjoyment/leisure 5.780.9990.9*5.31.215.561.135.211.250.93151.5-
Social activity and limitations5.691.0585.5*5.760.835.670.875.790.830.93169.7-
Financial concerns5.161.2772.7-
Social support5.471.0981.8*5.641.065.890.65.541.180.91460.6-
Employment5.471.2380.0*5.611.005.001.225.830.820.79957.6-
Role limitations due to health or psychical problems5.760.9687.3*5.850.765.780.835.880.740.93175.8*
Spiritual QoL
Meaning of illness5.421.3276.4*5.480.945.560.885.460.980.93148.5-
Religiosity4.161.7350.9----------
Hope5.511.4180.0*6.121.026.220.836.081.100.93175.8*
Transcendence4.531.5954.6----------
Inner strength5.071.5167.3----------
a % of all participants within the top three measures on a 7-point scale. b * = consensus reached (criterion = 75.0% of the values on the top three measures on a 7-point scale), b - = consensus not reached. c Group 1: Participants included in both rounds of the Delphi study. d Group 2: Participants included only in the 2nd round of the Delphi study. e Independent samples t-test, 2-tailed, unequal variances assumed, p adjustment method = BH [45].f Adjusted p. g % of all participants within the top two measures on a 7-point scale. h * = consensus reached (criterion = 75.0% of the values on top two measures on a 7-point scale), h - = consensus not reached.
Table 3. Mean ranking of the QoL (sub)domains.
Table 3. Mean ranking of the QoL (sub)domains.
RankItemMean Rank Score aConsensus Reached (Round 2)
General domains
1Physical QoL1.38*
2Psychological QoL1.76*
3Social QoL2.86-
Physical QoL
1Functional ability and mobility3.19*
2Pain and discomfort3.42*
3Physical symptoms4.08*
4Fatigue/vitality4.56*
5Activities of daily living4.69*
6Physical health and comorbidities5.83-
7Sleep and rest6.31*
8Weight loss/gain7.61-
9Health distress7.64*
10Health perceptions7.67-
Psychological QoL
1Anxiety3.14-
2Depression3.37*
3Psychological distress3.89*
4Cognitive functioning, concentration, and attention4.77-
5Fear of recurrence5.31-
6Positive feelings and affect6.34-
7Loss of interest in usual activities6.54-
8Isolation/abandonment and feelings of belonging6.71-
9Uncertainty7.14-
10Negative feelings and affect7.77-
Social QoL
1Family functioning2.76-
2Self-concept/appearance3.79-
3Marital functioning3.94-
4Social activity and limitations4.00-
5Social Support4.88-
6Role limitations due to health or physical problems5.48*
7Enjoyment/leisure 5.55-
8Employment5.61-
Spiritual QoL
1Hope1.30*
2Meaning of illness1.70-
a Lower mean score indicates greater importance. * = consensus reached (criterion = 75.0% of the values on the top three measures on a 7-point scale), - = consensus not reached.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Mlakar, I.; Lin, S.; Nateqi, J.; Gruarin, S.; Diéguez, L.; Piairo, P.; Pires, L.R.; Tement, S.; Aleksandraviča, I.; Leja, M.; et al. Establishing an Expert Consensus on Key Indicators of the Quality of Life among Breast Cancer Survivors: A Modified Delphi Study. J. Clin. Med. 2022, 11, 2041. https://0-doi-org.brum.beds.ac.uk/10.3390/jcm11072041

AMA Style

Mlakar I, Lin S, Nateqi J, Gruarin S, Diéguez L, Piairo P, Pires LR, Tement S, Aleksandraviča I, Leja M, et al. Establishing an Expert Consensus on Key Indicators of the Quality of Life among Breast Cancer Survivors: A Modified Delphi Study. Journal of Clinical Medicine. 2022; 11(7):2041. https://0-doi-org.brum.beds.ac.uk/10.3390/jcm11072041

Chicago/Turabian Style

Mlakar, Izidor, Simon Lin, Jama Nateqi, Stefanie Gruarin, Lorena Diéguez, Paulina Piairo, Liliana R. Pires, Sara Tement, Ilona Aleksandraviča, Mārcis Leja, and et al. 2022. "Establishing an Expert Consensus on Key Indicators of the Quality of Life among Breast Cancer Survivors: A Modified Delphi Study" Journal of Clinical Medicine 11, no. 7: 2041. https://0-doi-org.brum.beds.ac.uk/10.3390/jcm11072041

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop