Next Article in Journal
Knowledge of and Barriers to Palliative Care Perceived by Healthcare Providers before and after Promotion of the Patient Autonomy Act: A Cross-Sectional Study
Next Article in Special Issue
“We’re Still Struggling a Bit to Actually Figure Out What That Means for Government”: An Exploration of the Policy Capacity Required to Oversee Robot Technologies in Australia and New Zealand Care Services
Previous Article in Journal
The Epidemiology of Injuries in Spanish Rugby Union División de Honor
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

User Perception of New E-Health Challenges: Implications for the Care Process

by
María Esther González-Revuelta
1,
Nuria Novas
2,
Jose Antonio Gázquez
2,*,
Manuel Ángel Rodríguez-Maresca
3 and
Juan Manuel García-Torrecillas
4,5,6
1
Grupo Investigación TIC019 Electrónica, Comunicaciones y Telemedicina (04120) Servicio Informática y Sistemas de Información, Equipo Provincial TIC, Hospital Universitario Torrecárdenas, 04009 Almería, Spain
2
Grupo Investigación TIC019 Electrónica, Comunicaciones y Telemedicina, Universidad de Almería, 04120 Almería, Spain
3
Unidad de Gestión Clínica Laboratorios, Hospital Universitario Torrecárdenas, 04009 Almería, Spain
4
Unidad de Investigación Biomedica, Hospital Universitario Torrecárdenas, 04009 Almería, Spain
5
CIBER de Epidemiología y Salud Pública (CIBERESP), 28029 Madrid, Spain
6
Instituto de Investigación Biomédica Ibs. Granada, 18012 Granada, Spain
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2022, 19(7), 3875; https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph19073875
Submission received: 30 January 2022 / Revised: 4 March 2022 / Accepted: 15 March 2022 / Published: 24 March 2022

Abstract

:
Establishing new models of health care and new forms of professional health-patient communication are lines of development in the field of health care. The onset of the COVID-19 pandemic has accelerated the evolution of information systems and communication platforms to guarantee continuity of care and compliance with social distancing measures. Our objective in this article was, firstly, to know the expectations of patients treated in the healthcare processes “cervical cancer” and “pregnancy, childbirth and puerperium” regarding online access to their clinical history and follow-up in the care process. Secondly, we analyzed times involved in the cervical cancer process to find points of improvement in waiting times when digital tools were used for communication with the patient. A descriptive cross-sectional study was carried out on 120 women included in any of the aforementioned processes using a hetero-administered questionnaire. The analysis of times was carried out using the Business Intelligence tool Biwer Analytics®. Patients showed interest in knowing their results before the appointment with the doctor and would avoid appointments with their doctor if the right conditions were met. Most recognized that this action would relieve their restlessness and anxiety. They were highly interested in receiving recommendations to improve their health status. It was estimated that there was room for improvement in the times involved in the care process, which could be shortened by 34.48 days if communication of results were through digital information access technologies. This would favor the optimization of time, resources and user perception.

1. Introduction

The current moment is characterized by continuous digital evolution. Our habits, way of working, communication and personal relationships in general have changed towards a new digital scenario thanks to the new technological ecosystems that have been generated.
The incorporation of Information and Communication Technologies (ICT) in any field is a process that represents an advance in work methodologies, response times, results and, in general, a development of the set of elements that make it possible [1]. The same is true in the field of health care. The use of ICT, as long as it is carried out properly, with criteria of quality and efficiency, will mean an improvement for the user, the professional and the health system as a whole. Documented analyses of the main barriers to and enablers of the implementation of e-Health services are detailed in [2], which lists ten fundamental barriers and six main enablers.
New technology based on their use through computer tools and mobile devices are causing a change in the doctor-patient relationship and actions by the healthcare center-citizen binomial. The ways of communicating and interacting and the need for the multidirectional transfer of information must be incorporated into the use of new tools. This implies addressing new challenges and dilemmas on the part of the organization, which entails the incorporation of new methodologies in their work models [3].
Some of these emerging technologies are the use of blockchain, artificial intelligence (AI), quantum computing, the medical internet of things (MIoT) and Big Data. Each of these technologies provides us with an opportunity to advance and improve in all areas of health and in digital medical care in particular. Many cases of use of these technologies can be found in the bibliography; we comment on some relevant ones.
MIoT facilitates the online monitoring and control of patient clinical data, such as medical images, heart rate, blood oxygen level, medication dose and history of health conditions, among others [4,5].
AI facilitates clinical decision support, patient management automating service provision, patient monitoring and health interventions [6].
Blockchain is a technology that ensures the security of the data collected and helps maintain your privacy. Various technologies such as industry 4.0, bio-sensors, 3D scanning, and multi-agent systems have been used in telemedicine for diabetic patients in the fight against the COVID-19 pandemic. Others include control of infectious diseases and prevention of the spread of the pandemic through contact tracing and movement of people. In March 2020. The World Health Organization (WHO) launched MiPasa, which is a platform based on blockchain technology that facilitates the totally private exchange of information between individuals, state authorities and health institutions [4,7].
Combining the development of these technologies with the use of appropriate tools will facilitate the exchange and interaction of information in real time.
Motivated on the one hand by the demands of users who handle technology more and more in their day-to-day life and given that the tools are increasingly accessible to anyone, organizations and companies themselves understand that they must respond to this demand and need; in relation to this, they are immersed in a process of analysis and evaluation of new developments to incorporate and promote the use of ICT in their operation [8]. The forms and means of contact between patient and healthcare professionals will increasingly be oriented towards the use of mobile devices. This, together with the increase in developer applications (APPs) [9], make it necessary to advance on this path and offer patients with resources and tools that allow them to have more direct and interactive communication, developing new relationship models, promoting autonomy of the patient and facilitating knowledge and interaction with their care process through ICT. In this context, one of the critical points in patient safety is the use of mobile devices to monitor their health status [10].
Communication between health professionals and patients plays a decisive role in the development and evolution of any healthcare process [11]. Adequate communication in a timely manner will provide a decrease in patient anxiety, a degree of improvement in adherence to treatment and interpretation of results, a minimization of additional diagnostic tests, a reduction in the number of claims, optimization of time and resources, improvement in the management of visits and, in general, an improvement in the patient’s perceived quality of the care process. The methodology used to carry out this communication is therefore also of vital importance throughout the process. Adapting it to new technologies is already a stated objective and an object of analysis and discussion [12].
New technologies tend to be assimilated with increased usefulness and efficiency, but some unknowns should be answered beforehand: do users have the same perception? What do users really think of the use of ICT to know the status of their care process? Do they use digital media to access their health histories? To what extent do they agree to replace current media with newer ones? It is considered important and convenient to analyze the proposals that are raised with methodological rigor and a critical spirit by assessing the opinion of users, which are one of the points of analysis and development in this work.
Through a survey, we evaluated the opinion of users regarding the use of digital tools to access their clinical information, specifically access to test results through tools such as APPs, access to Web Health portals, SMS, instant messaging or email. The analysis carried out for the process of cervical cancer can be extrapolated to many other processes in the field of health care.
We also evaluated the interest users presented in relation to several specific use cases; that is, at what point in their care process do they consider access to their information may be of greater interest to them.
On 11 March 2020, the outbreak of the disease caused by the corona-virus SARS-CoV-2 (COVID-19), was evaluated as a global pandemic by the World Health Organization (WHO). As a consequence of the activation of the pandemic, a series of provisions and containment measures were put in place in the face of the emerging health crisis (Order SND/234/14 March 2020) [13]. This has accelerated the implementation of measures and new forms of health care for patients that guarantee compliance with the measures imposed by the WHO. The development of patient communication platforms, information systems and support for decision-making has been promoted, in addition to new digital tools that facilitate communication and accessibility with the aim of preserving continuity in care, while containing the spread of the pandemic [14]. The field of informatics and biomedicine is playing a very prominent role in the fight against COVID-19 [15].
This work represents a feasibility and opportunity study. Therefore, the final objective was to know the opinion and expectations of users in relation to the use of information and communication technologies for the follow-up of their care process and the knowledge of their clinical health history. Having recognized the need to implement and promote digital platforms for the exchange of information in real time and whose progress has been accelerated by the pandemic, we focus on a specific practical use case, the cervical cancer care process, and calculate times involved in the care process, among them, the time of communication of the test results to the patient. We determined the bounding of the response times involved in the study, how they have been affected by the COVID-19 pandemic and how we could shorten the duration of a process and eliminate waiting times by making use of digital media to which we have referred.

2. Materials and Methods

The scope of this study focused on two care processes in specific areas of knowledge and hospital care, known as integrated care processes (ICPs). In this case, the ICPs “cervical cancer” and “pregnancy, childbirth and puerperium” were addressed [16,17]. A descriptive and cross-sectional study of the patients who attended the gynecology consultation and another group of patients who attended the laboratory consultation (extraction room) was carried out. Patients in the laboratory group came for gestational diabetes screening, as part of the universal screening protocol included in the PAI pregnancy, childbirth and puerperium for those patients with previously altered blood glucose levels. Patients in the gynecology group came for gynecological examination after clinical or diagnostic suspicion and undergo a molecular test for the detection of human papillomavirus (HPV).
The selection of the participants in the study was carried out randomly among all users who made use of any of the consultations during the period of patient inclusion from January to June 2018.
The sample size was estimated from a target population of 540 patients. To achieve a precision of 5% in the estimation of a proportion using a normal asymptotic two-sided 95%, confidence interval with correction for finite populations, assuming that the expected proportion of acceptance of ICT is 75% and that the total size of the population is 540, it would be necessary to include 120 patients in the study.
Subsequently, an analysis of the times involved during the cervical cancer care process was carried out. For this, two periods of analysis were chosen, of similar patient populations: a pre-pandemic period, from June to October 2019, with 227 patients and a period immersed in a pandemic, from May to July 2021, with 239 patients. To carry out the surveys, the identity of the patient was not revealed at any time, so it was not necessary to collect consent.

2.1. Methods

To respond to the objective of this work, a questionnaire was administered to 120 women randomly selected from among the consultants of both ICPs (pregnancy, childbirth and puerperium, as well as cervical cancer). The surveys were conducted by qualified persons.
A preliminary pilot test was carried out to homogenize and agree on the way in which the questionnaires were administered and thus reduce variability. There was no refusal to participate in the face of requests to answer the questionnaire (Table 1).
A Likert-type scale with five categories was used, including “Totally disagree/I am not interested in anything”; “Partially disagree/Not very interested”; “Indifferent (neither agree nor disagree)”; ”I partially agree/I am interested in something”; “Totally agree/I’m very interested.” These answers, evaluated as categories 1 to 5 respectively, were considered as ordinal for the statistical analysis [18].
The questionnaire was anonymous and distributed randomly (systematic random sampling with a choice of 1 out of 5 patients) among those who attended consultations until the calculated sample size was achieved.
The development of the survey was based on the TAM methodology (Technology Acceptance Model) [19]. It establishes the degree of acceptance by society before the introduction of new technologies and how the population reacts to changes. Elements such as perceived usefulness, perceived ease, attitude, and intention to use are valued. The TAM model is applicable to the object of development and analysis. Regarding the perceived usefulness, the highlighted question is: do users think that with the use of new technologies to monitor their process or their clinical history in general they will have improvements?
The issues were grouped into various dimensions or areas of interest. On the one hand, sociodemographic variables (sex and age), degree of interest in the use of technology to know results, in which cases would it be more interesting to use telematic means, which means they prefer and in which of them they would have more confidence to obtain information on their clinical history in general and their care process (email, mobile applications, web applications, SMS and others). On the other hand, it was also questioned whether the patient would dispense with his appointment with the doctor if once the result of any of the tests of the process was known and the consultation with the doctor was not strictly necessary.
In addition, the integrated care process of ‘cervical cancer’ was analyzed using a Business Intelligence (BI) tool. This tool allowed us to disaggregate the information at a high level of detail. We carried out a real analysis of the times involved in patient care throughout the process (entry-exit), applied to two periods, pre-pandemic and during the pandemic. The times analyzed were evaluated from the time the patient was summoned and goes to the gynecology consultation (1st appointment); a molecular test was required for the detection of HPV in a sample of cervical exudate, which was sent to the laboratory responsible for its processing. When the laboratory finished and validated the study, the patient was scheduled again for the gynecology consultation (2nd appointment) to communicate the results of the laboratory report and continue the care process based on the algorithms defined in the ICP.

2.2. Statistical Analysis

Statistical analysis was performed using SPSS statistical software. In the descriptive analysis, the qualitative variables are expressed as frequencies and percentages. Quantitative variables are expressed as meanS, standard deviationS (SD) or medianS accompanied by the interquartile range (IQR).
For the comparison between qualitative variables, Fisher’s exact test or Pearson’s chi-square test was used. For the comparison of the ordinal variables on the Likert scale of the questionnaire, the Mann-Whitney U test was used. All tests were performed with 95% confidence intervals.
Those variables where statistical significance was found are indicated with a (*), and those others with indications of statistical significance are indicated with a (&).
On the other hand, to carry out an analysis of the real times involved in the cervical cancer process, we defined several control points that make up part of the process, as can be seen in Figure 1.
The times involved in the process, as detailed in Figure 1, are conceptualized as follows:
MTR: mean time of HPV test request—the time in days that elapses from when the patient has her appointment in the gynecology consultation until the request for the HPV test is registered in the laboratory information system.
MTV: mean validation time—the time in days that elapses from when the request for the HPV test is registered in the laboratory information system until the test is validated by the laboratory, which means that the result is available.
MT2C: mean time of second consultation—the time in days that elapses from when the test result is available once validated until the patient has her appointment at the hospital to inform her of the result and continue the care process based on the result.
These times were calculated for patients with appointments for consultations in two periods to analyze a period prior to the pandemic (June to October 2019), with 227 cases of analysis, and a subsequent period once the pandemic was activated (May to July 2021), with 239 cases. The calculation periods included were selected as they were considered to be representative and the data obtained was extrapolatable to other periods, the results of which have been obtained in similar proportions.
The analysis was performed using the Biwer Analytics® BI tool with data from different sources, the Laboratory Information System (LIS), the appointment management information system, as well as the hospital information system.
Anonymized records were used to extract the data from the medical records, eliminating the identifying data. The guidelines provided by the ethics and research committee of the province of Almería (Spain) were followed.

3. Results

Of the total number of patients surveyed, 53.3% (n = 64) came from the gynecology consultations compared to 46.6% (n = 56) coming from the general laboratory. Age groups related to fertility and diagnosis of cervical cancer were considered. From the point of view of age distribution, the most prevalent group of patients who came from the laboratory consultation was the youngest group (≤35 years old), while the most prevalent for those from the gynecology consultations was the 36–65 year-old age group. Regarding the age distribution, statistically significant differences were found between the origin of consultations and the age groups analyzed (p < 0.001) (Figure 2).
The questions whose average score is greater than 4 (I’m partially agree/I am interested in something), considering that the assessment is made on a Likert-type scale from 1 to 5 (Totally disagree/I am not interested in anything to Totally agree/I’m very interested), included mainly five: P4, P6.3, P7, P9 and P10.
To the question: Would you be interested in knowing your results before your doctor’s appointment? (P4) It was observed that a majority of patients were interested in knowing the results before going to the face-to-face consultation with their doctor, presenting an overall mean of 4.08 (Table 2).
For the question: What other information related to the status of your analytics or your test would you like to know? related to “Results are now available” (P6.3), interviewees were interested in knowing the results before their appointment with the doctor with a score of 4.37 (Table 2).
For the question: Do you think that advance knowledge of the status of your analysis process and its results would alleviate your anxiety while waiting? (P7), the response reflects that the interviewees were interested in information related to the availability of the results of their tests, presenting an overall mean score of 4.08 (Table 2).
For the question: Would you like to avoid unnecessary appointments with your doctor, when your results were normal and you did not need any medical intervention, as long as the result was accompanied by an explanatory report? (P9), the response reflects that the interviewees would be interested in receiving the information avoiding unnecessary appointments with a score of 4.16 (Table 2).
For the question: Would you be interested in receiving information accompanied by laboratory reports on lifestyle habits, hygiene, care, etc., that would help you better control your disease? (P10), the response had a score of 4.61, indicating that the patients surveyed were interested in receiving recommendations to improve their state of health through healthy lifestyle habits (Table 2).
In a complementary way, Table 3 presents a summary of the percentages of respondents grouped for each option.
When the results were analyzed in more detail and those of one query were compared with the other (Table 4), interesting results were obtained, among which we highlight the following:
Regarding the first variable P1 (level of knowledge of the patient in relation to whom and how they will be informed of the results of their test), the score was higher in the patients who went to have the test performed at the laboratory than in the patients who went to the gynecology consultation (3 vs. 4), p ≤ 0.05.
On the other hand, statistically significant differences were detected in the variables P3, P4 and P56 (p ≤ 0.05). In these items, the same median value was found for both strata; however, their distribution behaved differently (Figure 3).
For each visit (gynecology and laboratory), we analyzed whether there were differences between age groups (≤36 years vs. >36 years) for each of the items (Table 5). For the gynecology consultation, a statistical significance was observed for the variable P5.2. In addition, items P1 and P5.1 showed signs of statistical significance with higher scores in patients ≤35 years. Finally, for the laboratory consultation, statistically significant differences were found with respect to age for the item (1 vs. 0, p ≤ 0.05). Item P8 presented higher values in those ≤36 years old (5 vs. 1, p ≤ 0.05).
After calculating the different periods analyzed in the care process, we obtained homogeneous and significant data (Table 6). The MTR is 15 days, the MTV is 9 days and the MT2C is 34.48 days.

4. Discussion

This study highlights the interest that patients present a priori in relation to the use of new technologies to monitor their care process, as well as to the amount of information about their next contact with the professional. In short, it indirectly exposes patients’ involvement in their care process, facilitating the doctor-patient relationship through new means of communication where new technologies prevail with computer tools for on-line access to their care data and recommendations for health habits and healthy living directly related to their illness or treatment [20].
In the analysis, two types of tests are differentiated: one performed in the laboratory consultation aimed at patients whose test is for the detection of gestational diabetes as part of the universal screening protocol within PAI pregnancy, childbirth and puerperium, and who have had previously altered blood glucose levels. The other case is for patients with some risk factor or clinical suspicion who came from a gynecology consultation (PAI cervical cancer).
The operative process (clinical-care) in both cases begins after the person’s contact with the health system through the different possible entrances, Primary Care (PC) or Hospital Care (HC). Considering the previous system, the care that professionals offer from different areas of action in PC and HC could be further supplemented by the continuity of patient/family care [21].
To adequately evaluate the results obtained, it is necessary to note that cervical cancer is the tenth most frequent cancer among Spanish women, and the second among 15–44-year-olds [22]. A woman diagnosed with cervical cancer does not abandon the care chain, as she requires regular follow-up. Patients who show signs of clinical and/or diagnostic suspicion after a gynecological examination carried out in consultations will undergo cytology. When faced with a pathological cytology, a series of actions are triggered, including an HPV test, aimed at a diagnosis and treatment that should be carried out within a reasonable period. This period on certain occasions is long, with the aggravating circumstance that the patient is unaware of the results. Integrating the use of new technologies into the process could be key and help in initiatives such as screening programs and other routine processes [23]. Consultations whose information can be offered online to the patient could be reduced in favor of those that present cytological alterations and those that should be streamlined.
We start from the fact that this group of patients was specifically taken as the object of study, considering that the development of the phases of the process admitted the possibility of incorporating the complementary use of ICT and new digital media.
For this type of patient, the times involved in part of their care process were calculated. The results reveal the existence of a significant time gap that could be avoided or minimized; this gap runs from when the test that is requested from the patient (HPV) is performed and validated by the laboratory until they have the next appointment at the hospital for the gynecology consultation (MT2C), when the result of the test is communicated. and the process continues. The average time that elapses is 34.48 days. In cases in which there is no cytological alteration or complication, the result could be made available to the patient from the moment the test is validated by the laboratory, in this way, the use of digital media and ICT would contribute to reducing the patient’s waiting time, reducing the number of second visits, and avoiding face-to-face visits as much as is convenient, something that is recommended by the authorities in times of crisis, as is the current case in favor of containment of the spread of the pandemic. These freed spaces could be occupied by patients on the waiting list whose appointments were delayed due to the high volume of patients waiting to be seen.
In the case of the ICP for pregnancy, childbirth, and the puerperium, there is an extensive program of activities to follow up in an integrated manner between PC and AH, establishing a series of visits, appointments, and recommendations throughout the process that encourage the participation of women in its development. It is therefore feasible for technology to be used throughout to support and improve this process [24,25].
Providing the factors, information, and motivation for professionals to promote new means of communication and transmission of results are a determining factor for progress in this line [26].
In the present work, the attitude and predisposition towards the use of ICTs is considered, assessing whether patients will be willing to incorporate the change in their form of contact with the health specialist and whether they will have a proactive attitude [9,27]. Results presented by other authors who have conducted patient surveys show that more than 60% of the respondents were interested in the possibility of accessing their Electronic Health Records in general and even 50% of them were willing to pay for it [28].
The results and previous studies support a clear interest on the part of the population in receiving recommendations, for example, to improve their health status through healthy lifestyle habits. A total of 54.2% of the general population seeks information on food, nutrition, or healthy lifestyles [12]. The score of the patients analyzed was one of the highest, recognizing the degree of interest with an average score of more than 4.6. Therefore, there is a clear congruence between the population-based findings and those from this study sample.
In this area, the development and promotion of the use of mobile devices, such as wearables, would facilitate both the reception of this information and the transmission of constants to the health professional, which would allow better diagnoses to be made and the recommendations to be adapted and focused on the case of each patient [29,30].
Even though almost 85% of the population in the 25–34 year-old age group is aware of the existence of devices that can measure and provide data on their health status, they are only used by one in four women, especially those with chronic pathology.
It should be noted that the use of mobile applications (APPs) by patients to monitor their health is only 4.3%, with a little more notoriety being used for monitoring physical activity, healthy living, and well-being of personnel, with 8.6%. This low interest is reflected in the analyzed surveys, where the score in relation to the preference in knowing the results of their care process or of their test through an APP has one of the lowest values (1.44 mean). The health professional does not yet have a high level of confidence in this type of application. The percentage of health professionals who have recommended websites is only 6.4% and 7.5% in the case of APPs [1]. From the foregoing, we can infer that although users are interested in using the new communication channels, they are somewhat reluctant to use them regularly, probably waiting for their doctor to be the one to transmit and promote it.
Patients in general have difficulties when viewing their clinical information through portals, APPs and the use of new computer tools in general, mainly due to the lack of ease of navigation, interpretation of results, ignorance of the parameters, if they are included in a range of normality or not, next steps, etc. [31]. The lack of validity, reliability, rigour, accreditation, usefulness, relevance, credibility, accuracy, and ignorance of the tools themselves, are some of the limitations for the expansion in the use of these technologies both for patients and professionals.
Just over half of the people who have used them confirm that their use has avoided unnecessary visits to the hospital or health center, which leads to cost savings for the Health System and an improvement in the management of appointments face-to-face. In addition, 55.2% agree that these technologies have helped them improve or prevent health problems [32].
The results show that there is an interest in knowing the data as soon as possible (knowing the results in advance would alleviate the anxiety of the patients with a score of 4.08 in item P7), even without a face-to-face appointment; however, it cannot be inferred which would be the most appropriate method, since when asking about the different technological means (APPs, WhatsApp instant messaging, SMS, Web, etc.) there is no determining score (all oscillate around an average of 2.5 out of 5).
Regarding the degree of interest, it is also observed that there is a difference between the patients in the laboratory consultation and those who present some risk factor or suspected pathology (who attended the gynecology consultation). In both cases, the value of the median is 5 (Totally agree/I’m very interested), indicating that they are interested in knowing the results before the appointment; however, those coming from a laboratory consultation have more knowledge of the times of their process with a value of the median of 4 (I partially agree/I am interested in something) points for the knowledge of how and who will inform him and 5 (Totally agree/I’m very interested) for the knowledge of the date of his next appointment. Possibly in these cases the information will be given by her PC doctor and therefore the patient knows better who and how she will be informed following the traditional procedure; in addition, they show greater interest in the use of other technological means that speed up and advance information. Those considered unhealthy or immersed in a more complex process prefer direct information from their doctor [33].
Some of the analyzed variables are conditioned on age. When stratifying by age, specifically, those over 36 years of age who attend the gynecology consultation usually have less information about who and how they are going to be informed. In relation to the above, all patients show a high interest in knowing the results before the appointment, although women who attended the gynecology consultation and especially those over 36 years of age showed median values of 0 and 1, respectively. They have little interest in knowing the results via email, SMS, instant messaging, mobile applications, or other digital means. This could be since these patients are usually immersed in more complex processes, with a risk factor, and prefer to receive a direct explanation from their doctor, not only because of the difficulty in understanding the results, but also because of the anxiety and fear that they carry with them about receiving a diagnosis that could be positive or negative. However, laboratory patients that are asymptomatic with no risk factor have a banal process in the highest percentage of cases.
Regarding the means that laboratory patients prefer to know the results, with a median of 4.5 through Web pages for those over 36 years of age and with a median of 5 through instant messaging. This is currently the most widespread means for this type of case.
The limitations of this study are fundamentally found in the fact that the population under study includes only women, and gender can be considered a determining factor. The specialties and processes chosen made it possible to compare the involvement of the patient in a banal process versus a more complex process. However, contrasting the results of this study with those of others, it can be deduced that they can be extrapolated to other processes with similar characteristics, although there are other factors that can also be considered decisive in the results, such as sociodemographic indicators, pathology, chronicity, sex, cultural level, socio-professional situation and others [34]. It remains therefore as future work to propose the expansion of the analysis under study in the aforementioned context.
The use of telemedicine, telehealth and, in general, digital means for accessing and monitoring healthcare processes, as well as clinical history in general, has been incentivized by the pandemic. Simply, patient care systems have the potential to take advantage of information technologies. This crisis has been an opportunity to promote the use of information technologies in the health field [35].
The need to adapt information systems that support citizen health in general and digital health histories has been highlighted, although their acceleration has caused situations of deregulation and has made visible the deficiencies and limitations in guaranteeing the safety, privacy and general quality of care [10,36,37].
The level of acceptance, continuity and progress of the new media and services promoted remains to be verified and whether the progress produced will be a solid base for continuing to advance in this line at a sufficient pace offers great potential, but at the same time also has great limitations that will have to be addressed. Given the overload of care demand that the health system is experiencing, it is very important to distribute the workload among professionals efficiently and safely. The analysis that we have carried out in this work and the current situation provides objective information on the need to continue advancing in the development of new forms of health care and promotion using digital media and, in general, the promotion of information technologies and communication for eHealth [38].
Finally, we must point out some limitations to the above. These include barriers responsible for inhibiting the development and application of information technologies in health care. Some of the variables related to these barriers are the efficiency of doctors and care professionals, patient preferences for receiving face-to-face care, an inadequate legal framework, a deficiency of explicit standards, lack of adequate resources, inadequate telecommunications technology and infrastructure, interoperability, implementation problems, socio-administrative problems, violations of privacy and confidentiality, and insufficient research in this area [39].

5. Conclusions

The development of care processes allows for a comprehensive approach to health problems. The inclusion of new technologies and digital progress incorporates key improvements in the development of the processes.
eHealth applications offer the patient a possibility for improving the control and monitoring of their health status, streamlining circuits, bringing them closer to the treatment of their process and involving them through new tools. Knowing the opinion of users is essential for their evolution. We focused our study on the analysis of the opinion of patients involved in two high-impact care processes.
Moving towards a doctor-patient digital ecosystem, taking advantage of the opportunities that technology offers, and prioritizing the patient’s quality of life would allow optimization of time and resources for both the professional and the patient in situations that the health professional deems appropriate. Using a Business Intelligence tool, we analyzed the duration of a process and identified time intervals that can be reduced. For those situations in which the absence of disease must be communicated without the need to provide other types of complex clinical information, unnecessary consultations could be avoided and users could receive the information accurately and with the immediacy of digital environments. This would result in a reduction in anxiety and concern of patients, shortening unnecessary waiting times. It would also help reduce the number of face-to-face consultations, improving the availability of resources in the field of care.
All these means and actions are complementary ways and tools to support the healthcare work of the professional, while always safeguarding the fundamental rights of information, intimacy and confidentiality of the patient.
The evolution of the e-informed patient and the “health professional-patient” relationship represents one of the future challenges in health care.
With the onset of the pandemic, in many cases it has been the health professionals themselves who have seen the potential offered by the use of technology for care in circumstances such as those experienced, and who have facilitated the expansion and use of telematic health systems. However, the extraordinary expansion of the implementation of telehealth and its use cases highlights the need to carry out an exhaustive analysis of the real effects produced in patients and health models.
The use of information technologies and analysis through Business Intelligence tools as detailed in this article help us obtain results that guide us to take measures and implement actions that address the improvement of health care, minimize response times, facilitate accessibility and optimize available resources.

Author Contributions

Conceptualization: M.E.G.-R. and M.Á.R.-M.; methodology: J.M.G.-T.; software and validation: M.E.G.-R.; investigation, data curation and writing—original draft preparation: M.E.G.-R. and J.M.G.-T.; writing—review and editing: M.E.G.-R., N.N., J.A.G., M.Á.R.-M. and J.M.G.-T. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Ethics Committee of Torrecádenas University Hospital (Almería, Spain).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to ethical restrictions.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. ONTSI. Observatorio Nacional de las Telecomunicaciones y de la Sociedad de la Información. Los Ciudadanos Ante la E-Sanidad. 2016. Available online: https://www.ontsi.red.es/ontsi/es/estudios-informes/los-ciudadanos-ante-la-e-sanidad-opiniones-y-expectativas-de-los-ciudadanos-sobre- (accessed on 25 January 2021).
  2. Schreiweis, B.; Pobiruchin, M.; Strotbaum, V.; Suleder, J.; Wiesner, M.; Bergh, B. Barriers and facilitators to the implementation of eHealth services: Systematic literature analysis. J. Med. Internet Res. 2019, 21, e14197. [Google Scholar] [PubMed] [Green Version]
  3. Guise, V.; Anderson, J.; Wiig, S. Patient safety risks associated with telecare: A systematic review and narrative synthesis of the literature. BMC Health Serv. Res. 2014, 14, 588. [Google Scholar]
  4. Jabarulla, M.Y.; Lee, H.N. A blockchain and artificial intelligence-based, patient-centric healthcare system for combating the COVID-19 pandemic: Opportunities and applications. Healthcare 2021, 9, 1019. [Google Scholar] [PubMed]
  5. Ye, J. The role of health technology and informatics in a global public health emergency: Practices and implications from the COVID-19 pandemic. JMIR Med. Inform. 2020, 8, e19866. [Google Scholar]
  6. Reddy, S.; Fox, J.; Purohit, M.P. Artificial intelligence-enabled healthcare delivery. J. R. Soc. Med. 2019, 112, 22–28. [Google Scholar] [PubMed]
  7. Shah, R.; Chircu, A. IOT and ai in healthcare: A systematic literature review. Issues Inf. Syst. 2018, 19, 33–41. [Google Scholar]
  8. Huguet, X.B.; Ramírez, E.L.; Lombardo, F.C. Propuestas para la atención domiciliaria del siglo XXI. Aten. Primaria 2018, 50, 264–266. [Google Scholar]
  9. Baldwin, J.L.; Singh, H.; Sittig, D.F.; Giardina, T.D. Patient portals and health apps: Pitfalls, promises, and what one might learn from the other. Healthcare 2017, 5, 81–85. [Google Scholar] [PubMed] [Green Version]
  10. Oh, S.-R.; Seo, Y.-D.; Lee, E.; Kim, Y.-G. A comprehensive survey on security and privacy for electronic health data. Int. J. Environ. Res. Public Health 2021, 18, 9668. [Google Scholar] [PubMed]
  11. Recomendaciones de la Agencia de Calidad Sanitaria de Andalucía. Habilidades de Comunicación Eficaz. Agosto/2018. Available online: https://www.acsa.junta-andalucia.es/agenciadecalidadsanitaria/archivo/infografia-recomendacion-36-habilidades-de-comunicacion-eficaz.pdf (accessed on 15 June 2021).
  12. Mira, J.J. Tecnologías móviles e inalámbricas para cuidar nuestra salud. J. Healthc. Qual. Res. 2018, 33, 183–186. [Google Scholar] [PubMed]
  13. Zhu, N.; Zhang, D.; Wang, W.; Li, X.; Yang, B.; Song, J.; Zhao, X.; Huang, B.; Shi, W.; Lu, R.; et al. A Novel Coronavirus from Patients with Pneumonia in China, 2019. N. Engl. J. Med. 2020, 382, 727–733. [Google Scholar] [PubMed]
  14. Martín Fernández, A. Role of the information systems and e-health in the COVID-19 pandemic. A call to action [Papel de los sistemas de información y la salud electrónica en la pandemia de COVID-19. Una llamada a la acción]. Rev. Esp. Salud Pública 2021, 95, e1–e15. [Google Scholar]
  15. Bakken, S. Informatics is a critical strategy in combating the COVID-19 pandemic. J. Am. Med. Inform. Assoc. 2020, 27, 843–844. [Google Scholar] [PubMed]
  16. Centro de Salud, Guías de Lectura Rápida de Procesos Asistenciales Integrados: Cáncer de Cuello de útero. Servicio Andaluz de Salud Consejería de Salud Junta de Andalucía Sevilla. 2003. Available online: https://web.sas.junta-andalucia.es/servicioandaluzdesalud/sites/default/files/sincfiles/wsas-media-pdf_publicacion/2020/CarteradeServiciosPAI.pdf (accessed on 15 June 2021).
  17. Centro de Salud, Embarazo, Parto y Puerperio: Proceso Asistencial Integrado. Sevilla: Consejería de Salud, Junta de Andalucía. 2014. Available online: https://juntadeandalucia.es/export/drupaljda/salud_5af1956fa966b_embarazo_parto_puerperio_septiembre_2014.pdf (accessed on 15 June 2021).
  18. Alaminos Chica, A.; Castejón Costa, J.L. Elaboración, Análisis e Interpretación de Encuestas. Vicerrectorado de Calidad y Armonización Europea Instituto de Ciencias de la Educación Universidad de Alicante. 2016. Available online: https://rua.ua.es/dspace/bitstream/10045/20331/1/Elaboraci%C3%B3n,%20an%C3%A1lisis%20e%20interpretaci%C3%B3n.pdf (accessed on 15 June 2021).
  19. Kim, D.-Y.; Park, J.; Morrison, A.M. A Model of Traveller Acceptance of Mobile Technology. Int. J. Tour. Res. 2008, 10, 393–407. [Google Scholar]
  20. Bujnowska-Fedak, M.M.; Węgierek, P. The impact of online health information on patient health behaviours and making decisions concerning health. Int. J. Environ. Res. Public Health 2020, 17, 880. [Google Scholar]
  21. Torrejón, R.; Fernández, C.; Rita, M. Cáncer de Cérvix: Proceso Asistencial Integrado. Sevilla: Junta de Andalucía Consejería de Salud. 2010. Available online: https://www.juntadeandalucia.es/servicios/publicaciones/detalle/72496.html (accessed on 15 June 2021).
  22. Campo Giménez, M.D.; Villarín Castro, A. Implementation of population screening for cervical cancer in Castilla-La Mancha [La implantación del cribado poblacional del cáncer de cuello uterino en Castilla-La Mancha]. Rev. Clin. Med. Fam. 2018, 11, 125–127. [Google Scholar]
  23. Castillo, M.; Astudillo, A.; Clavero, O.; Velasco, J.; Ibáñez, R. Evaluation of mortality after the analysis of the screening history in women diagnosed with infiltrating cervical cancer. Aten. Primaria 2018, 50, 151–158. [Google Scholar] [PubMed]
  24. Kerr, D.; Axelrod, C.; Hoppe, C. Patient inputs for mobile health systems for type 1 diabetes care. Diabetes Technol. Ther. 2017, 19, 201–202. [Google Scholar] [PubMed]
  25. Baldwin, D.M.; Quintela, J.; Duclos, C.; Staton, E.W.; Pace, W.D. Patient preferences for notification of normal laboratory test results: A report from the ASIPS Collaborative. BMC Fam. Pract. 2005, 6, 11. [Google Scholar]
  26. Kim, J.; Mathews, H.; Cortright, L.M.; Zeng, X.; Newton, E. Factors Affecting Patient Portal Use among Low-Income Pregnant Women: Mixed-Methods Pilot Study. JMIR Form. Res. 2018, 2, e6. [Google Scholar] [PubMed] [Green Version]
  27. Verhees, B.; Van Kuijk, K.; Simonse, L. Care model design for E-health: Integration of point-of-care testing at dutch general practices. Int. J. Environ. Res. Public Health 2018, 15, 4. [Google Scholar]
  28. Bujnowska-Fedak, M.M.; Wysoczański, Ł. Access to an electronic health record: A polish national survey. Int. J. Environ. Res. Public Health 2020, 17, 1–17. [Google Scholar]
  29. Monteagudo Peña, J.L. Telemedicine and primary care. Aten. Primaria 2009, 41, 129–130. [Google Scholar] [PubMed] [Green Version]
  30. Shaw, R.J.; Steinberg, D.M.; Bonnet, J.; Modarai, F.; George, A.; Cunningham, T.; Bosworth, H.B. Mobile health devices: Will patients actually use them? J. Am. Med. Inform. Assoc. 2016, 23, 462–466. [Google Scholar]
  31. Giardina, T.D.; Baldwin, J.; Nystrom, D.T.; Sittig, D.F.; Singh, H. Patient Perceptions of Test Result Notification via the Patient Portal. AMIA J. Am. Med. Inform. Assoc. 2016. Available online: https://knowledge.amia.org/amia-63300-1.3360278/t005-1.3362920/f005-1.3362921/2500016-1.3364094/2492745-1.3364089?qr=1 (accessed on 15 June 2021).
  32. Jutel, A.; Lupton, D. Digitizing diagnosis: A review of mobile applications in the diagnostic process. Diagnosis 2015, 2, 89–96. [Google Scholar] [PubMed] [Green Version]
  33. MS, A.; GF, H.; SHE, L.; ANSJ, J. EMR Access and Confidentiality Based on Patient and Hospital Staff Perspectives. Open Public Health J. 2018, 11, 533–545. [Google Scholar]
  34. Sotillos-González, B.; Buiza-Camacho, B.; Herrera-Usagre, M.; Escobar-Ubreva, Á.; Fernández-Bermejo, M.; Santana-López, V.; Ferrero-Álvarez-Rementería, J. Visión ciudadana sobre la prescripción de aplicaciones móviles de salud y el uso de tecnologías de la información y la comunicación en el entorno sanitario en Andalucía. J. Healthc. Qual. Res. 2018, 33, 225–233. [Google Scholar] [PubMed]
  35. Pérez Acuña, C.; Contreras Gutiérrez, J.; Mattoli Chiavarelli, M. Hyperconnected healthcare as an effect of COVID-19 pandemic [La conversión a un mundo digital hiperconectado en salud impulsado por la pandemia del COVID-19]. Rev. Med. Chile 2020, 148, 1223–1224. [Google Scholar] [PubMed]
  36. Dehling, T.; Gao, F.; Schneider, S.; Sunyaev, A. Exploring the far side of mobile health: Information security and privacy of mobile health apps on iOS and Android. JMIR mHealth uHealth 2015, 3, e8. [Google Scholar] [PubMed]
  37. Bhaskar, S.; Bradley, S.; Chattu, V.K.; Adisesh, A.; Nurtazina, A.; Kyrykbayeva, S.; Sakhamuri, S.; Moguilner, S.; Pandya, S.; Schroeder, S.; et al. Telemedicine as the new outpatient clinic gone digital: Position paper from the pandemic health system REsilience PROGRAM (REPROGRAM) international consortium (Part 1). Front. Public Health 2020, 8, 556720. [Google Scholar]
  38. Adly, A.S.; Adly, A.S.; Adly, M.S. Approaches based on artificial intelligence and the internet of intelligent things to prevent the spread of COVID-19: Scoping review. J. Med. Internet Res. 2020, 22, e19104. [Google Scholar]
  39. Scott Kruse, C.; Karem, P.; Shifflett, K.; Vegi, L.; Ravi, K.; Brooks, M. Evaluating barriers to adopting telemedicine worldwide: A systematic review. J. Telemed. Telecare 2018, 24, 4–12. [Google Scholar] [PubMed] [Green Version]
Figure 1. Times involved in part of the cervix cancer care process.
Figure 1. Times involved in part of the cervix cancer care process.
Ijerph 19 03875 g001
Figure 2. Age groups according to type of consultations (p < 0.001).
Figure 2. Age groups according to type of consultations (p < 0.001).
Ijerph 19 03875 g002
Figure 3. Box-Plot of the items 3, 4 and 56.
Figure 3. Box-Plot of the items 3, 4 and 56.
Ijerph 19 03875 g003
Table 1. Patient Survey.
Table 1. Patient Survey.
Tell Us Your Age before You StartYear
P11Do you know how or who will inform you of your test results?12345
P22Do you know how long your results will take?12345
P33Do you already have the date of the next appointment with your doctor to inform him of the results?12345
P44Would you be interested in knowing your results before your doctor’s appointment?12345
P55By what means would you like to be able to access your lab results?
P5.1
  • Email (Gmail, etc.)
12345
P5.2
  • SMS
12345
P5.3
  • Whatsapp type instant messaging
12345
P5.4
  • Access to a secure WEB page
12345
P5.5
  • Through an APP
12345
P5.6
  • Others Tell us how
12345
P66What other information related to the status of your analytics or your test would you like to know?
P6.1
  • The sample has arrived correctly at the laboratory
12345
P6.2
  • The analysis is being processed by the laboratory equipment
12345
P6.3
  • Results are now available
12345
P6.4
  • An error has occurred in the process and you must contact the laboratory
12345
P77Do you think that advance knowledge of the status of your analysis process and its results would alleviate your anxiety while waiting?12345
P88Would you like to avoid unnecessary appointments with your doctor, when your results are normal and you do not need any medical intervention?12345
P99Would you like to avoid unnecessary appointments with your doctor, when your results were normal and you did not need any medical intervention, as long as the result was accompanied by an explanatory report?12345
P1010Would you be interested in receiving information accompanied by laboratory reports on lifestyle habits, hygiene, care, etc., that would help you better control your disease?12345
P11 Want to help us start this project?YESNO
Table 2. Description of age and survey items.
Table 2. Description of age and survey items.
TotalItem Description
Consultation Gynecologal n (%)64 (53.33)Origin of the respondent
Laboratory n (%)56 (46.67)
Three age ranges
≤35 n (%)58 (48.3)
36–55 n (%)47 (39.2)
>55 n (%)6 (5)
Unknown n (%)9 (7.5)
ÍtemsAverage (Standard deviation)
P13.30 (1.67)Know how/who will inform you
P23.58 (1.54)Know the waiting time for results
P33.86 (1.68)Know the appointment date for results
P44.08 (1.59)You are interested in knowing results before the appointment
P5.12.94 (2.24)You prefer to know the result by email
P5.21.90 (2.12)Preference for knowing the result via SMS
P5.32.21 (2.21)Preference for knowing the result via instant messaging (WhatsApp, others)
P5.42.57 (2.56)Preference for knowing the result through the website
P5.51.44 (1.89)Preference for knowing the result through the app
P5.60.66 (1.56)Preference for knowing the result by other means
P6.12.93 (2.04)Interest in knowing if the sample is in the laboratory
P6.22.35 (1.99)Interest in knowing if the sample is processed
P6.34.37 (1.41)Interest in knowing if the results are available
P74.08 (1.26)Anticipating knowledge of sample status and results alleviates anxiety
P94.16 (1.39)If the results are normal and accompany a report, do you think you would avoid a medical appointment?
P104.61 (0.94)Interest in receiving information on healthy lifestyle habits related to your case
Table 3. Frequency of questionnaire items.
Table 3. Frequency of questionnaire items.
VariablesResponseGynecologyLaboratoryVariablesGynecologyLaboratory
Count%Count%Count%Count%
P112132.81018.2P62512.0126.8
257.847.383.8147.9
31117.247.3188.72011.3
4710.91120.02311.11810.2
52031.32647.313464.411363.8
P211625.058.9P769.447.1
269.4610.734.700.0
369.4814.31015.61119.6
4914.11323.257.81526.8
52742.22442.94062.52646.4
P311727.0712.5P81320.6611.1
234.835.457.935.6
346.311.8914.323.7
434.858.900.0916.7
53657.14071.43657.13463.0
P41813.335.6P9914.147.1
223.311.934.735.4
3711.747.4710.958.9
435.023.746.335.4
54066.74481.54164.14173.2
P515728.23217.1P1034.711.8
2115.4179.111.611.8
3136.42412.846.347.1
4105.0168.646.358.9
511155.09852.45281.34580.4
Table 4. Scores by Origin [Medians (RIQ) and p-value]. * Statistically significant differences.
Table 4. Scores by Origin [Medians (RIQ) and p-value]. * Statistically significant differences.
VariablesGynecologyLaboratoryp
P13 (4)4 (3)≤0.05 (*)
P24 (3.5)4 (2)0.278
P35 (4)5 (1)≤0.05 (*)
P45 (2)5 (0)≤0.05 (*)
P5.12 (5)5 (5)0.207
P5.21 (5)1 (4.5)0.679
P5.31 (5)2 (5)0.435
P5.41 (5)3.5 (5)0.141
P5.50 (2.5)1 (3)0.550
P5.60 (1)0 (0)≤0.05 (*)
P64.5 (1)5 (0)0.480
P6.14 (4)3 (5)0.645
P6.22 (5)2 (4)0.561
P6.35 (0)5 (0)0.771
P6.45 (4)5 (3)0.940
P75 (2)4 (2)0.355
P85 (3)5 (1)0.326
P95 (2)5 (1)0.246
P105 (0)5 (0)0.982
Table 5. Scores according to origin and age [Medians (RIQ) and p-value]. * Statistically significant differences and those others with indications of statistical significance are indicated with a (&).
Table 5. Scores according to origin and age [Medians (RIQ) and p-value]. * Statistically significant differences and those others with indications of statistical significance are indicated with a (&).
GinecologyLaboratory
VariablesAge ≤ 36Age > 36pAge ≤ 36Age > 36p
P13 (3)2 (3)0.083 (&)4 (3)4.5 (2)0.786
P25 (4)4 (3)0.5494 (2)5 (1)0.147
P35 (4)5 (3)0.5305 (1)5 (1)0.989
P45 (2)5 (4)0.2145 (0)5 (1)0.561
P5.15 (4)1 (5)0.065 (&)5 (4.5)5 (1)0.622
P5.21 (4)0 (1)≤0.05 (*)2 (4.5)1 (5)0.963
P5.31 (5)1 (5)0.4131.5 (5)5 (4)0.165
P5.43 (5)0.5 (5)0.1801 (3)4.5 (1)0.352
P5.51 (4)0 (1)0.1260 (0)0 (1)0.383
P5.60 (1)0 (5)0.4855 (0)0 (0)0.369
P6-5 (0)-3.5 (4.5)--
P6.14 (3)3 (4)0.5503 (4)2.5 (4)0.248
P6.23 (4)1.5 (5)0.4093 (4)2 (4)0.553
P6.35 (0)5 (0)0.9575 (0)5 (0)0.878
P6.45 (1)5 (4)0.6125 (3.5)5 (3)0.762
P75 (2)5 (2)0.9404 (1.5)4 (2)0.600
P85 (3)5 (4)0.9305 (1)3.5 (4)≤0.05 (*)
P95 (2)5 (2)0.9855 (0)5 (2)0.259
P105 (0)5 (0)0.8535 (0)5 (0)0.401
Table 6. Cases analyzed with time delay (in days) during the care process.
Table 6. Cases analyzed with time delay (in days) during the care process.
Number of Cases
(1st Visit Number of Patients)
Number of Patients (1st Visit Requiring) HPVNo. of Patients with 2nd VisitMTR
(Days)
MTV
(Days)
MT2C
(Days)
1st Períod22714413716.368.2639.70
2nd Períod2391049411.849.8031.50
Both periods46624817514.668.8734.48
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

González-Revuelta, M.E.; Novas, N.; Gázquez, J.A.; Rodríguez-Maresca, M.Á.; García-Torrecillas, J.M. User Perception of New E-Health Challenges: Implications for the Care Process. Int. J. Environ. Res. Public Health 2022, 19, 3875. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph19073875

AMA Style

González-Revuelta ME, Novas N, Gázquez JA, Rodríguez-Maresca MÁ, García-Torrecillas JM. User Perception of New E-Health Challenges: Implications for the Care Process. International Journal of Environmental Research and Public Health. 2022; 19(7):3875. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph19073875

Chicago/Turabian Style

González-Revuelta, María Esther, Nuria Novas, Jose Antonio Gázquez, Manuel Ángel Rodríguez-Maresca, and Juan Manuel García-Torrecillas. 2022. "User Perception of New E-Health Challenges: Implications for the Care Process" International Journal of Environmental Research and Public Health 19, no. 7: 3875. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph19073875

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop