Next Article in Journal
Angry Drivers Take Risky Decisions: Evidence from Neurophysiological Assessment
Previous Article in Journal
Recovery Degree of the Natural Flow Regimes and the Corresponding Economic Costs for Reservoir Operation in Fish Spawning Seasons
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Acceptability of HPV Vaccines and Perceptions of Vaccination against HPV among Physicians and Nurses in Hong Kong

1
School of Nursing, Hong Kong Polytechnic University, Hong Kong, China
2
The Jockey Club School of Public Health and Primary Care, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong, China
3
School of Public Health, Zhejiang University, Zhejiang 310058, Zhejiang Province, China
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2019, 16(10), 1700; https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph16101700
Submission received: 30 March 2019 / Revised: 4 May 2019 / Accepted: 10 May 2019 / Published: 14 May 2019
(This article belongs to the Section Environmental Health)

Abstract

:
Background: Human papillomavirus (HPV) is one of the most common sexually transmitted infections nationwide. Methods: This is the first cross-sectional survey assessing physicians’ and nurses’ knowledge of HPV and recording their attitudes to HPV vaccination in Hong Kong. Survey questions were derived from the Health Belief Model. Results: 1152 clinicians (170 physicians and 982 nurses) aged 21 and 60 participated in this study. A multiple stepwise regression model was used to examine associations between cognitive factors (clinicians’ attitudes) and subjects’ intention to HPV vaccine uptake. Results showed that only 30.2% of physicians and 21.2% nurses found vaccinating for HPV acceptable. Conclusions: Perceived self-efficacy was the only significant background and cognitive variable associated with physicians’ and nurses’ accepting HPV vaccines. Further, when nurses found HPV vaccination acceptable, cues to action was featured as a significant background variable in their choice.

1. Introduction

Human papillomavirus (HPV) is a well-known cause of cervical cancer and anogenital warts. HPV-16 and HPV-18 are the most common high-risk HPV forms associated with cervical cancer [1]; HPV-6 and HPV-11 are lower-risk viruses causing anogenital warts. Genital HPV infections are mainly transmitted by sexual contact (both vaginal and anal) with an infected person [2]. In order to prevent HPV infection, people can either abstain from sex or practice safer sex using condoms. They can further cut the risk of infection by having fewer sexual partners. However, epidemiologic studies suggest that up to 75% of all sexually active people will eventually become infected with HPV at some point during their lifetime [3].
In 2015, 500 new cases of cervical cancer were diagnosed at a crude incidence rate was 12.7 per 100,000 women in Hong Kong. Cervical cancer is the seventh commonest cancer among Hong Kong women. It accounts for 3.3% of all new cancer cases in females and is the ninth leading cause of all female cancer deaths. In 2016, a total of 151 women died of cervical cancer, representing 2.6% of female cancer deaths in Hong Kong [1]. Nevertheless, results from a recent Population Health Survey in 2014/15 found that the percentages of the relevant population between the ages of 25 and 64 (those ever screened and screened within the past three years) getting a cervical smear stood at 59% and 47%, respectively [4,5].
A recent systematic review (28 studies) [6] examined the acceptability of the HPV vaccination among adolescents (together with factors associated with its uptake and with adolescents declining the vaccine). Results showed the rate of vaccination across settings ranged from 2.4% to 94.4%. Scotland had the highest HPV vaccination uptake, while Hong Kong had the lowest (2.4% to 9.1%).
A recent local study asked 300 parents their views on the acceptability of HPV vaccination for their children (162 boys, 138 girls) aged 9 to 13. Results showed that the prevalence of HPV vaccination was very low (0.6% for boys against 2.2% for girls) [7].
Yuen et al. [8] conducted a local study examining the facilitators of, and barriers preventing, HPV vaccination. A total of 1229 girls aged 9 to 14 participated and were offered bivalent dose at 0 and 6 months for the period of a year. The vaccine uptake was 81.4% for the first HPV dose and 80.8% for the second. Yuen and colleagues found that two factors (the desire to prevent cervical cancer and doctors’ recommendation) were significantly associated with parents’ decision to vaccinate their daughters. Parents who had never heard of the HPV vaccine, had concerns about vaccination costs or preferred for their children to be vaccinated in a private clinic were less likely to allow their daughters to join the programme. The main reason parents refused to allow their daughters the shots was that they were worried about side effects. Another study conducted by Wang et al. [9] found that anxiety about their daughters getting cervical cancer was the most significant predictor of parental intention to get their daughters vaccinated among Chinese mothers in Hong Kong. Social influences and beliefs also affect parental intention regarding vaccination.
Past research on the acceptability of vaccination against HPV has focused on men having sex with men (SMS) [10], on female attitudes [11], parental attitudes [12,13,14,15,16,17], maternal attitudes [8,9,18,19]), and the views of baccalaureate students [20], secondary school pupils and adolescent girls [8,21,22,23]. Other research has focused on physicians’ attitudes towards prescribing HPV vaccines to patients [24,25]. Very little research examines physicians’ and nurses’ attitudes towards the acceptability of HPV vaccination or the barriers physicians have encountered in recommending HPV vaccination in the last decade [26]. Physicians and nurses are role models, whose advice is central in the promotion of good health among their patients. An understanding of clinicians’ knowledge of, and attitudes towards, HPV vaccination may begin to explain the low rate of HPV vaccine uptake in Hong Kong. The study aims to examine doctors’ and nurses’ views on the acceptability of vaccination against HPV and to determine associations between their perceptions of HPV and separately specifiable factors.

The Health Belief Model and Outcome Measures

Extensive research has been conducted using the Health Belief Model (HBM) to examine attitudes to and beliefs about HPV and HPV vaccination. This study incorporated the HBM to explain and predict health behaviour. The HBM is a theoretical framework commonly used to guide public health interventions [27]. Its presumption is that individuals who feel susceptible to consequences in terms of their health may change their behaviour when the benefits outweigh the barriers to change or costs of adopting a new behavior [28]. Their perceived vulnerability to ill health, the perceived severity of disease (or discomfort), perceived benefit of changing, perceived barriers to change, cues to action, and self-efficacy (perceived effectiveness of their actions) are the constructs of the HBM.

2. Materials and Methods

2.1. Design, Setting and Participants

The study implemented a cross-sectional self-administrative survey using purposive sampling. Participants were recruited from public hospitals in Hong Kong. To be included, subjects needed to be male or female, licensed physicians or qualified nurses, aged between 21 and 60, and currently working full-time under the Hospital Authority (the key healthcare provider in Hong Kong). They needed to be able to read the survey language, Chinese. Part-time employees and non-readers of Chinese were excluded from the study. Participants were recruited in the hospital communal areas by research assistants who introduced the study’s aims and objectives. Respondents’ confidentiality and anonymity were assured. Participants were given a self-addressed blank envelope containing an information sheet and our survey. They were asked to return completed surveys in a sealed envelope to the research assistants on-site. Returning a completed survey implied consent. A total of 1152 eligible participants were recruited to participate in this study from June to July 2017.

2.2. Main Study Measures

The survey filled in by participants had 21 items and closely followed the format of Lau’s comparable study [10]. It solicited socio-demographic information including any personal history of sexually transmitted infection (STI) (both symptoms and diagnoses) and participants’ number of sexual partners over the past six months. Participants expressed views on the acceptability of vaccination on a 5-point Likert scale ranging from 0–5 (0: they found vaccination highly acceptable, or it was “very likely” they would take up vaccination, to 5: it was “very unlikely” they would take up vaccination). Four questions were asked concerning whether participants had suffered HPV-related symptoms in the past year including (1) Did you experience any burning sensation in voiding or micturition? (yes/no); (2) Did you notice any presence of white / yellowish urethral secretion? (yes/no); (3) Have you experienced any prominent growth around the genital skin or mucosa? (yes/no), and (4) Have you had any prominent lumps around the genital skin or mucosa? (yes/no). The survey also asked respondents what they knew about, and how they thought about, HPV and HPV vaccines (or how they “cognized” these, in terms of the HBM). Six composite indicator variables were constructed by counting the number of affirmative item responses reflecting how far respondents believed they were susceptible to infection by HPV (0 to 3), how severe they believed the infection was (0 to 3), whether they perceived vaccination could benefit them (0 to 5), how hard they thought it would be for get vaccinated (0 to 5), whether they thought they could vaccinate themselves easily (0 to 2) and whether they were cued to take the HPV vaccination by the media, doctors and peers (0 to 2).

2.3. Data Management and Statistical Analysis

The statistical analysis was carried out separately among physicians and nurses because each had a different role in HPV vaccination (i.e., prescribing as against administration). Univariate logistic regression was conducted to select significant background variables, as well as significant composite cognitive indicator variables associated with the intention to take up HPV. Odds ratios were first presented in the course of univariate analysis (ORU). A multiple stepwise regression model was then established using the significant univariate background variables as candidates; this allowed the calculation of multivariate odds ratios (ORm). Relationships between the cognitive indicator variables and dependent variable (respondents’ intention of taking up HPV vaccination) were then assessed, adjusting for those background variables found to be significant in the multivariate analysis; adjusted odds ratios (AOR) were also determined. Odds ratios at 95% confidence intervals (CI) were presented. Statistical analyses were performed using the statistical software SAS 9.2, with p values of 0.05 taken as statistically significant.

2.4. Ethics

This study was approved by the Human Subjects Ethics Sub-committee, the Institutional Review Board of a local university in Hong Kong (reference no: HSEARS20170418004).

3. Results

3.1. Socio-Demographic Background Characteristics of the Participants

A total of 1152 participants (170 physicians and 982 nurses) took part in this study. Most physician participants were male (62.9%) and most nurse participants were female (76.3%). About two-thirds (63.5%) of physicians and 54.2% of nurses were single. Over 80% of physicians (86.4%) and nurses (83.7%) were below 40 years old, with the rest of participants ranged from 41 and 60 years old. Approximately half of the participants were not religious. All the physicians had at least a bachelor’s degree, while only 56.7% of nurses had this level of qualification. Over half of the participants (57.1% physicians and 50.3% nurses) had less than five years clinical experience. Less than 30% of the physicians and nurses had more than 10 years of experience. Over 90% of physicians and nurses were frontline staff. 84.1% of physicians had a monthly income of HK$60,000 (~USD 7645) or more; however, about three quarters of the nurses (72.7%) had a monthly income of less than HK$60,000.
The doctors had on average more than 50% more sexual partners than the nurses (1.2 average for the physicians against 0.6% for the nurses). However, more nurses (19.9%) reported more than ten sexual partners than the doctors (17.6%). 6.6% of nurses and 4.2% of physicians exhibited had exhibited symptoms relating to STD in the past 6 months (Table 1).

3.2. Intention to Take Up HPV Vaccines (Acceptability), Knowledge on HPV Vaccines and Perceived Self-Efficacy

A total of 30.2% of physicians and 21.2% nurses reported an intention to get vaccinated against HPV (Table 2). Less than 40% of physicians (36%, n = 64) obtained ≥ five correct responses on knowledge of HPV vaccine compared to 44.4% of nurses (n = 436). 70% of physicians and 63% of nurses disagreed that they were not motivated in the HPV vaccine uptake. Rather, 37–41% of nurses and physicians respectively believed that they should take the HPV vaccination. Both physicians and nurses had a relatively high percentage of perceived self-efficacy to complete the full treatment (82% versus 85%) and a significant proportion of physicians and nurses (94% versus 97%) alleged that they were fully autonomous to take up the HPV vaccination if indicated. Physicians and nurses received peer support (76.5% versus 70.5%) and family support to take up the HPV vaccination (78.2% versus 69.3%).

3.3. Knowledge on HPV

The proportion giving a correct answer on individual knowledge items on HPV ranged from 50.6% to 95.3% among physicians and 51.6% to 93.6% in nurses (Table 3). Both groups had misconceptions about HPV, for instance, that the virus could not be transmitted through sex, and infection was totally curable, and that HPV 16 was able to cause genital warts. Nurses also believed that HPV could be controlled by antibiotics, that HPV was hereditary, and that HPV 18 could cause genital warts (Table 3).
Regarding perceived susceptibility, 52.4% of physicians and 49.0% of nurses saw the risk of HPV infection among women as high or very high. By contrast, 37.1% of physicians and 24.7% of nurses thought that men could easily catch the disease. 54.7% of physicians and 42.5% nurses believed that HPV was highly infectious. Yet only 9.4% of physicians and 5.7% of nurses thought they had a high or very high chance of catching HPV. 19.4% of physicians and over one-third of nurses (34.7%) were aware their knowledge of HPV was lacking. Exactly half and over half of the physicians and nurses (50.0% vs 59.8%) understood that the HPV virus could harm persons’ physical health (Table 3).

3.4. Cognitions on HPV Vaccine

The proportions of physicians and nurses who provided correct answers on items regarding knowledge of HPV vaccines (availability, price, the 3-shot requirement, expected duration of protection, the preferred age range for vaccination) varied, ranging from 21.2% to 93.5% in physicians and 23.6% to 79.5% in nurses. The prevalence of correct responses regarding the perceived benefits of vaccination for the physicians and nurses were similar: 71.2% (physicians) and 52.1% (nurses) knew it could prevent genital warts; 90.0% and 70.5% knew it could prevent, HPV-induced cancers (90.0% vs 70.5%); 25.9% vs 33.1% knew it could prevents STDs other than HPV; and 11.8% vs 13.8% knew it could treat genital warts. 11.8% of physicians and 14.8% of nurses knew the shots could treat HPV-induced cancers (11.8% vs 14.8%) (Table 3).
Physicians disagreed more often than nurses with statements suggesting there were serious barriers to vaccination. ‘‘HPV vaccines are expensive’’, had a 67.6% agreement rate in physicians and a 70.5% in nurses. ‘‘There are side effects’’ came in at 20.0% for physicians and 32.8% for nurses; ‘‘it is embarrassing to take up HPV vaccines’’, at 11.8% vs 18.1%, respectively; "private hospitals do not provide HPV vaccines", 10.0% vs 23.8%; "public hospitals do not provide HPV vaccination", 52.4% against 60.5%; and ‘‘getting vaccinated against HPV means you are promiscuous’’, 5.3% against 7.9%. 17.6% of doctors and 23.0% of nurses thought it was easier for healthcare professionals to be infected with HPV. 25.3% of doctors and 36.3% of nurses agreed that "healthcare professionals are less motivated to take up HPV vaccination", while also thinking (40.6% doctors, 37.1% nurses) that "healthcare professionals should take up HPV vaccination". The level of perceived self-efficacy in taking up HPV vaccination was high in physicians (82.4% and 94.1%) and nurses (85.1% and 96.7%). Both groups thought their peers (78.2% and 76.5%) and family members (69.3% and 70.5%). The rate of responses regarding cues to action among physicians and nurses were that media reports (76.5% vs 78.4%) were likely to encourage them to take up vaccination, as were doctors (52.4% vs 39.1%) and to some extent, peers (47.1% vs 46.3%). 82.9% of physicians would recommend their patients or patients’ family members to take up HPV vaccines, compared to only 59.1% of nurses (Table 3).

3.5. Factors Associated with Acceptability of HPV Vaccines

We found that gender was the only statistically significant background variable among physician participants. After adjusting for gender, the results showed four cognitive composite indicator variables as statistically significant. They were the perceived severity of disease (AOR = 2.689, 95% CI = 1.034–6.990), perceived self-efficacy in preempting it (AOR = 5.408, 95% CI = 1.466–19.945), perceived support (from family or peers) (AOR = 3.468, 95% CI = 1.191–10.099) and cues to action (AOR = 3.688, 95% CI = 1.165–11.675) (Table 4).
Adjusting for these four variables, results showed that six of the composite cognitive indicator variables were statistically significant. These were knowledge of HPV vaccines (AOR = 2.588, p < 0.01), perceived susceptibility to HPV (AOR = 1.779, p < 0.05), the perceived benefits of vaccination (AOR = 1.815, p < 0.05), perceived self-efficacy (AOR = 2.772, p < 0.01), perceived support (AOR = 2.206, p < 0.01) and cues to action (AOR = 2.703 to 6.960, p < 0.05) (Table 4). In addition, the study fitted a multiple logistic regression model containing all the significant composite cognitive indicator variables and adjusted for significant background variables.
Four background variables were statistically significant among the nurse participants: (1) Gender (ORm = 1.764, 95% CI = 1.129–2.759), (2) age group (“21–29”: ORm = 4.095, 95% CI = 2.187–7.669; “30–39”: ORm =1.627, 95% CI = 0.802–3.301, reference group was “40 & over”), (3) having STD-related symptoms (ORm = 2.230, 95% CI = 1.779–7.446), and (4) number of sexual acts in the past 6 months (“0”: ORm = 1.854, 95% CI = 1.153–2.981; “1–5”: ORm = 2.166, 95% CI = 1.305–3.597, the reference group was “6 or more”). After fitting a multiple logistic regression model containing all the significant cognitive composite indicator variables, and adjusting for the same significant background variable, only perceived self-efficacy and cutes to action emerged as the only significant composite cognitive variables (Table 5).

4. Discussion

Results of multiple logistic regression suggest that self-efficacy is the only significant composite cognitive variable associated with physicians’ and nurses’ intention get vaccinated themselves against HPV. Nurses, further, are more likely to get vaccinated when they perceive that there are positive cues to action. We found that female physicians are three times more likely than male physicians to take up HPV vaccination. This finding is unsurprising: 37.1% of respondents giving this answer were female physicians, and 86.4% (of both genders) were below 40 years old; of this group, 59.6% had been sexually active in the past 6 months. Female physicians broadly exhibited a fundamental knowledge of HPV and other sexually-transmitted diseases and cervical cancers. The main driver of their behaviour in getting vaccinated, then, is likely to be to avoid infection [29].
The acceptability of the HPV vaccine among physicians and nurses in this study is relatively low (30.2% as against 21.2%). We speculate that this low rate of acceptability may be attributed to 1) respondents having little or no exposure to STD-related symptoms themselves; 2) their having limited exposure to HPV in their clients in clinical settings; 3) their not knowing the risks of acquiring HPV transmission; 4) a misconception that HPV can be completely cured. One of the predictors for the acceptability of HPV vaccine take up is knowledge of HPV [30]. Some researchers have found that poor HPV knowledge is positively correlated with a low incidence of the intention to get vaccinated [31]. Our findings echoed Poole’s claim. It is noteworthy that only 43% of physicians and nurses answered six or more questions on HPV correctly. This ignorance among physicians and nurses in this study was unexpectedly high. Clinical specialty may also contribute to participants’ intention to take up an HPV vaccine. The possibility exists that our respondents rarely deal with young adolescents or are not confronted with patients with HPV in their clinical settings [25].
Lee and Wang [26] found that only 41.8% of healthcare providers (28 doctors and 70 nurses) would recommend HPV vaccination to their patients in sexually transmitted disease (STD) clinics in Hong Kong. It is interesting that physicians in the public hospitals were more willing to prescribe HPV vaccination than those working in STD clinics. It is encouraging to note that 82.9% of physician participants would recommend the HPV vaccination to their patients, despite rarely stating an intention to get the shots themselves. The large variation between physicians’ recommendations and individual attitudes towards the acceptability of HPV vaccination may suggest that, knowing their own behaviour, clinicians suppose themselves less at risk. It may also suggest they take pride in their efficacy as clinicians to administer all three doses.
Hong Kong is a developed part of Asia with generally high incomes. Nevertheless, there is some evidence to suggest that the general public, in both high- and low-income countries, may know little about HPV, the risk factors for cervical cancer and genital warts [32]. Decisions whether to be vaccinated for HPV are affected by individual knowledge, beliefs about vulnerability, perception of the vaccine’s effectiveness, family physicians’ views, sexual practices, cultural norms, and the cost of vaccination [33,34]. Young adolescents may rely on their peers, parents, the mass media, private general practitioners or primary healthcare providers for cues to take proactive steps to take the vaccine [20]. Of all groups, parents are most important in encouraging children to take the shots. Wang et al. [12] used telephone interviews to assess the attitudes of 1996 Chinese parents of 12 to 17-year-old unvaccinated girls towards HPV vaccination. At a 1-year follow-up, less than 10% (n = 97 out of 979 parents) of these participants’ daughters had received at least one dose of HPV vaccines. Wang’s findings suggest that parents’ ignorance risks their daughters’ future health.
A healthcare provider’s recommendation is one of the strongest, most consistent predictors of HPV vaccination, as evidenced by Chow et al. [33]’s survey of 480 physicians and 1,617 randomly selected mothers in Korea, Malaysia, Taiwan and Thailand. 94% of women surveyed were ignorant about HPV; 58% of women asserted that doctors should initiate the conversation about HPV vaccination. In contrast, 61% of general practitioners, 28% obstetrician-gynecologists, and 56% pediatricians claimed to be incompetent to initiate a conversation about HPV vaccination with their clients in the absence of further training. This knowledge deficit may inevitably mean that physicians fail to prescribe HPV vaccine to their clients. This only suggests the need for physicians to keep up-to-date with the science relating to STDs to reduce the risk of HPV-related diseases [35].
The study sought to determine which factors were related to a physician’s likelihood of initiating a conversation about HPV vaccination. They were likely to do so if they believed that, as professionals, they had a proactive role to play in educating women about cervical cancer and preventive health measures; if they had basic knowledge of HPV infections and vaccines; and felt comfortable raising the subject. Those less knowledgeable and with negative attitudes towards cervical cancer were less liable to begin a conversation about HPV vaccination. Some physicians may see discussions of HPV vaccination as burdensome, comparing to bringing up other vaccines offered adolescents [36]. Personal subjective bias and preferences in prescribing behaviour may lead to unnecessary delays in immunising adolescents.
It is interesting that nurses in our study suggested that ‘cues to action’ may increase their likelihood of taking up HPV vaccination. We speculate that these nurses are unlikely to come across clients suffering from STD-related diseases in their work. Their limited clinical exposure may reduce their effectiveness in caring for their own health. Tay et al. [36] surveyed 1622 nurses’ intention of getting vaccinated and examined why women might decline HPV vaccination. Results showed very few nurses (8.8%) had been vaccinated against HPV, although 12.5% planned to get vaccinated in the next 12 months. A significant proportion (44.5%) were undecided. A total of 557 (34.3%) nurses turned down HPV vaccination. The most commonly cited reasons for declining included inadequate information (49.4%), the belief that the vaccine was unproven (23.5%) and being the wrong age (25.5%). Tay’s findings [36] suggest that a professional background did not necessarily affect individuals’ perceptions of HPV vaccination as these determine their own health choices.

5. Limitations

We used the questions extracted by previous researchers in the HPV studies [20,29] but these questions had not been validated. There is a potential risk that some of these questions might not accurately measure of what we aimed to measure. Thus, results emerged from this study might not be generalized to similar replicated studies across countries.

6. Conclusions

It is evident that Hong Kong’s physicians and nurses have a very low acceptability towards HPV vaccination themselves, and that their general knowledge of HPV vaccination is barely adequate. Physicians and nurses play a pivotal role in shaping public views of HPV vaccination and correcting any misconceptions the public may have. These clinicians are often portrayed as proactive role models in infectious disease control and in preventing outbreaks in the community. The success of HPV prevention and control relies on concerted effort from stakeholders, policymakers, primary-secondary-tertiary care physicians and nurses. It is thus crucial for primary care providers to refresh their knowledge of HPV and to educate their patients about the importance of HPV vaccination in any clinical encounter.

Author Contributions

Conceptualization, J.Y.S.H.; methodology, J.Y.S.H. and T.C..; formal analysis, T.C.; investigation, T.C., P.M. and J.W.; data curation, C.K.S., R.T.H.C.; writing—original draft preparation, T.C.; writing—P.M., J.Z.W. and J.T.F.L.; supervision, J.Y.S.H.; project administration, J.H.; All authors contributed equally to this manuscript.

Funding

This research received no external funding.

Acknowledgments

The authors would like to thank all the physicians and nurses who participated in this study.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. National Cancer Institute. HPV and Cancer. Available online: http://www.cancer.gov/cancertopics/factsheet/Risk/HPV (accessed on 19 May 2012).
  2. Schiffman, M.; Castle, P.E.; Jeronimo, J.; Rodriguez, A.C.; Wacholder, S. Human papillomavirus and cervical cancer. Lancet 2007, 370, 890–907. [Google Scholar]
  3. Giuliano, A.R.; Palefsky, J.M.; Goldstone, S.; Moreira, E.D.; Penny, M.E.; Aranda, C.; Vardas, E.; Moi, H.; Jessen, H.; Hillman, R.; et al. Efficacy of Quadrivalent HPV Vaccine against HPV Infection and Disease in Males. N. Engl. J. Med. 2011, 364, 401–411. [Google Scholar] [CrossRef] [Green Version]
  4. Centre for Protection Department of Health, Hong Kong Special Administrative Region. Cervical Cancer. Available online: https://www.chp.gov.hk/en/healthtopics/content/25/56.html (accessed on 3 March 2019).
  5. Department of Health, Hong Kong SAR, Hong Kong. Statistics: Cervical Screening Coverage. Available online: https://www.chp.gov.hk/en/healthtopics/content/25/56.html (accessed on 3 March 2019).
  6. Loke, A.Y.; Kwan, M.L.; Wong, Y.-T.; Wong, A.K.Y. The Uptake of Human Papillomavirus Vaccination and Its Associated Factors Among Adolescents: A Systematic Review. J. Prim. Care Community Health 2017, 8, 349–362. [Google Scholar] [Green Version]
  7. Wang, Z.; Wang, J.; Fang, Y.; Gross, D.L.; Wong, M.C.S.; Wong, E.L.Y.; Lau, J.T.F. Parental acceptability of HPV vaccination for boys and girls aged 9–13 years in China—A population-based study. Vaccine 2018, 36, 2657–2665. [Google Scholar]
  8. Yuen, W.W.Y.; Lee, A.; Chan, P.; Tran, L.; Sayko, E. Uptake of human papillomavirus (HPV) vaccination in Hong Kong: Facilitators and barriers among adolescent girls and their parents. PLoS ONE 2018, 13, e0194159. [Google Scholar]
  9. Wang, L.D.L.; Lam, W.W.T.; Wu, J.; Fielding, R. Psychosocial determinants of Chinese parental HPV vaccination intention for adolescent girls: Preventing cervical cancer. Psycho-Oncol. 2015, 24, 1233–1240. [Google Scholar]
  10. Lau, J.; Wang, Z.; Kim, J.; Lau, M.; Lai, C.; Mo, P. Acceptability of HPV Vaccines and Associations with Perceptions Related to HPV and HPV Vaccines Among Men Who Have Sex with Men in Hong Kong. PLoS ONE 2013, 8, e57204. [Google Scholar]
  11. Lee, P.W.H.; Kwan, T.T.C.; Tam, K.F.; Chan, K.K.L.; Young, P.M.C.; Lo, S.S.T.; Cheung, A.N.Y.; Ngan, H.Y.S. Beliefs about cervical cancer and human papillomavirus (HPV) and acceptability of HPV vaccination among Chinese women in Hong Kong. Prev. Med. 2007, 45, 130–134. [Google Scholar]
  12. Wang, L.D.-L.; Lam, W.W.T.; Fielding, R. Determinants of human papillomavirus vaccination uptake among adolescent girls: A theory-based longitudinal study among Hong Kong Chinese parents. Prev. Med. 2017, 102, 24–30. [Google Scholar]
  13. Kepka, D.L.; Coronado, G.; Rodriguez, H.; Thompson, B. Development of a radionovela to promote HPV vaccine awareness and knowledge among Lation parents. Public Health Rep. 2012, 127, 130–138. [Google Scholar]
  14. Lindley, M.C.; Jeyarajah, J.; Yankey, D.; Curtis, C.R.; Markowitz, L.E.; Stokley, S. Comparing human papillomavirus vaccine knowledge and intentions among parents of boys and girls. Hum. Vaccines Immunother. 2016, 12, 1519–1527. [Google Scholar] [Green Version]
  15. Gerend, M.A.; Shepherd, M.A.; Shepherd, J.E. The Multidimensional Nature of Perceived Barriers: Global Versus Practical Barriers to HPV Vaccination. Health Psychol. 2013, 32, 361–369. [Google Scholar]
  16. Perkins, R.B.; Tipton, H.; Shu, E.; Marquez, C.; Belizaire, M.; Porter, C.; Clark, J.A.; Pierre-Joseph, N. Attitudes Toward HPV Vaccination Among Low-Income and Minority Parents of Sons: A Qualitative Analysis. Clin. Pediatr. 2013, 52, 231–240. [Google Scholar]
  17. Siu, J.Y.-M. Perceptions of and barriers to vaccinating daughters against Human Papillomavirus (HPV) among mothers in Hong Kong. Acta Vet. Scand. 2014, 14, 73. [Google Scholar]
  18. Wong, Y. Facilitators and barriers to the acceptance of human papillomavirus (HPV) vaccination among adolescent girls: A comparison between mothers and their adolescent daughters in Hong Kong. BMC Res. Notes 2017, 10, 390. [Google Scholar]
  19. Choi, H.C.W.; Leung, G.M.; Woo, P.P.S.; Jit, M.; Wu, J.T. Acceptability and uptake of female adolescent HPV vaccination in Hong Kong: A survey of mothers and adolescents. Vaccine 2013, 32, 78–84. [Google Scholar]
  20. Cheung, T.; Lau, J.T.F.; Wang, J.Z.; Mo, P.K.H.; Ho, Y.S. Acceptability of HPV vaccines and associations with perceptions related to HPV and HPV vaccines among male baccalaureate students in Hong Kong. PLoS ONE 2018, 13, e0198615. [Google Scholar]
  21. Blumenthal, J.; Frey, M.K.; Worley, M.J.; Tchabo, N.E.; Soren, K.; Slomovitz, B.M. Adolescent Understanding and Acceptance of the HPV Vaccination in an Underserved Population in New York City. J. Oncol. 2012, 2012. [Google Scholar] [CrossRef]
  22. Kwan, T.T.C.; Chan, K.K.L.; Yip, A.M.W.; Tam, K.F.; Cheung, A.N.Y.; Young, P.M.C.; Lee, P.W.H.; Ngan, H.Y.S. Barriers and facilitators to human papillomavirus vaccination among Chinese adolescent girls in Hong Kong: A qualitative-quantitative study. Sex. Transm. Infect. 2008, 84, 227–232. [Google Scholar]
  23. Lee, A.; Ho, M.; Cheung, C.K.M.; Keung, V.M.W. Factors influencing adolescent girls’ decision in initiation for human papillomavirus vaccination: A cross-sectional study in Hong Kong. BMC Public Health 2014, 14, 925. [Google Scholar]
  24. Kahn, J.A.; Zimet, G.D.; Bernstein, D.I.; Riedesel, J.M.; Lan, D.; Huang, B.; Rosenthal, S.L. Pediatricians’ intention to administer human papillomavirus vaccine: The role of practice characteristics, knowledge, and attitudes. J. Adolesc. Health 2005, 37, 502–510. [Google Scholar]
  25. De Carvalho, N.S.; Teixeira, L.M.; Pradel, E.M.; Gabardo, J.; Joly, C.; Urbanetz, A.A. Vaccinating against HPV: Physicians’ and medical students’ point of view. Vaccine 2009, 27, 2637–2640. [Google Scholar]
  26. Lee, Y.Y.; Wang, Z. Facilitators and barriers for healthcare providers to recommend HPV vaccination to attendees of public sexually transmitted diseases clinics in Hong Kong, China. PLoS ONE 2019, 14, e0209942. [Google Scholar]
  27. Sundstrom, B.; Carr, L.A.; Demaria, A.L.; Korte, J.E.; Modesitt, S.C.; Pierce, J.Y. Protecting the Next Generation: Elaborating the Health Belief Model to Increase HPV Vaccination Among College-Age Women. Soc. Mark. Q. 2015, 21, 173–188. [Google Scholar]
  28. Mehta, P.; Sharma, M.; Lee, R.C. Designing and Evaluating a Health Belief Model-Based Intervention to Increase Intent of HPV Vaccination among College Males. Int. Q. Community Health Educ. 2014, 34, 101–117. [Google Scholar]
  29. Mortensen, G.L. Drivers and barriers to acceptance of human-papillomavirus vaccination among young women: A qualitative and quantitative study. BMC Public Health 2010, 10, 68. [Google Scholar]
  30. Black, L.L.; Zimet, G.D.; Short, M.B.; Sturm, L.; Rosenthal, S.L. Literature review of human papillomavirus vaccine acceptability among women over 26 years. Vaccine 2009, 27, 1668–1673. [Google Scholar]
  31. Poole, D.; Tracy, J.; Levitz, L.; Rochas, M.; Sangare, K.; Yekta, S.; Tounkara, K.; Aboubacar, B.; Koita, O.; Lurie, M.; et al. A Cross-Sectional Study to Assess HPV Knowledge and HPV Vaccine Acceptability in Mali. PLoS ONE 2013, 8, e56402. [Google Scholar]
  32. LaMontagne, D.S.; Barge, S.; Le, N.T.; Mugisha, E.; Penny, M.E.; Gandhi, S.; Janmohamed, A.; Kumakech, E.; Mosqueira, N.R.; Nguyen, N.Q.; et al. Human papillomavirus vaccine delivery strategies that achieved high coverage in low- and middle-income countries. Bull. World Health Organ. 2011, 89, 821–830. [Google Scholar]
  33. Chow, S.-N.; Soon, R.; Park, J.S.; Pancharoen, C.; Qiao, Y.L.; Basu, P.; Ngan, H.Y.S. Knowledge, attitudes, and communication around human papillomavirus (HPV) vaccination amongst urban Asian mothers and physicians. Vaccine 2010, 28, 3809–3817. [Google Scholar]
  34. Oh, J.-K.; Lim, M.K.; Yun, E.H.; Lee, E.-H.; Shin, H.-R. Awareness of and attitude towards human papillomavirus infection and vaccination for cervical cancer prevention among adult males and females in Korea: A nationwide interview survey. Vaccine 2010, 28, 1854–1860. [Google Scholar]
  35. Gilkey, M.B.; Moss, J.L.; Coyne-Beasley, T.; Hall, M.E.; Shah, P.D.; Brewer, N.T. Physician communication about adolescent vaccination: How is human papillomavirus vaccine different? Prev. Med. 2015, 77, 181–185. [Google Scholar] [Green Version]
  36. Tay, K.; Tay, S.K.; Tesalona, K.C.; Rashid, N.M.R.; Tai, E.Y.S.; Najib, S.J.M. Factors affecting the uptake of cervical cancer screening among nurses in Singapore. Int. J. Gynecol. Obstet. 2015, 130, 230–234. [Google Scholar]
Table 1. Frequency distributions of the background variables (N = 1152).
Table 1. Frequency distributions of the background variables (N = 1152).
VariablePhysician (N = 170)Nurse (N = 982)
N%N%
Gender
Male10762.923323.7
Female6337.174976.3
Age group
21–299958.252853.8
30–394828.229429.9
40–60 2313.516016.3
Education Level
Higher Diploma00.028529.0
Degree14484.755756.7
Master or Above2615.314014.3
Marital Status
Unmarried10863.553254.2
Married6236.545045.8
Occupation
Doctor15691.800.0
Psychiatrist21.200.0
Houseman127.100.0
RN (General)00.079781.2
EN (General)00.0909.2
RN (Psychiatric)00.0686.9
EN (Psychiatric)00.0141.4
Midwife00.0131.3
Income (HK$)
20,001–40,00084.731732.3
40,001–60,0001911.239740.4
60,001–80,0006035.315315.6
80,001–100,0003218.8737.4
>100,0015130.0424.3
Religion
Yes7845.947748.6
No9254.150551.4
Years of experience
0–59757.149450.3
6–104124.126226.7
11–202715.914114.4
21–4052.9858.7
Main duties
Clinical16798.290191.8
Research42.410.1
Administration21.2262.6
Community00.0444.5
STD-related symptoms
Yes74.2646.6
No15995.891093.4
Number of sex partners (past 6 months)
06540.432733.7
19458.463865.7
≥221.260.6
Sexual behaviors (past 6 months)
06643.136237.7
1–53724.223624.6
6–102315.017217.9
≥102717.619119.9
Table 2. Perceptions related to HPV vaccines and intention to take up to HPV vaccines.
Table 2. Perceptions related to HPV vaccines and intention to take up to HPV vaccines.
VariablePhysician (N = 170)Nurse (N = 982)
N%N%
Knowledge on HPV vaccines
 Availability of effective HPV vaccines
  No/Don’t know116.520120.5
  Yes *15993.578179.5
 Availability of HPV 2/4/9 valent
  Yes *14384.169170.4
  No/Don’t know2715.929129.6
 Perceived price per shot (HK$: 1US$ = 7.8HK$)
  <800/>1500/Don’t know8650.650251.1
  800–1500 *8449.448048.9
 Number of shots required
  1–2/Don’t know6236.537237.9
  3 *10863.561062.1
 Duration of protection
  <2 year/2–5 years/Lifelong/Don’t know13478.875076.4
  6–10 years *3621.223223.6
 Age group suggested for HPV vaccination
  Above 30 years old/Don’t know2514.725726.2
  Below 30 years old *14585.372573.8
 Number of appropriate responses to the above questions on knowledge of HPV vaccines
  084.718819.1
  121.290.9
  2137.6343.5
  32212.910710.9
  46135.920821.2
  ≥56437.643644.4
Perceived benefits of HPV Vaccines for preventing and treating diseases related to HPV
 Perceived efficacy in preventing genital warts
  No/Neutral4928.847047.9
  Yes12171.251252.1
 Perceived efficacy in preventing HPV-induced cancers
  No/Neutral1710.029029.5
  Yes15390.069270.5
 Perceived efficacy in preventing STD other than genital warts
  No/Neutral12674.165766.9
  Yes4425.932533.1
 Perceived efficacy in treating genital warts
  No/Neutral15088.284686.2
  Yes2011.813613.8
 Healthcare professionals are less motivation to take HPV vaccination
  Totally disagree/disagree11970.061963.0
  Totally agree/agree4325.335636.3
  Don’t know84.770.7
 Healthcare professionals should take HPV vaccination
  Totally disagree/disagree9354.760962.0
  Totally agree/agree6940.636437.1
  Don’t know84.790.9
 Number of item responses to the above nine questions reflecting perceived barriers related to HPV φ
  0148.2818.2
  14526.5899.1
  23520.622322.7
  33520.622222.6
  42313.516216.5
  ≥51810.620520.9
Perceived self-efficacy to take up HPV vaccines
 I can complete the full treatment14614.9
  Disagree3017.683685.1
  Agree14082.4
 I have autonomy on whether taking up HPV vaccines323.3
  Disagree105.995096.7
  Agree16094.1
 Number of item responses to the above 2 questions reflecting perceived self-efficacy φ 293.0
  074.112012.2
  12615.383384.8
  213780.6
Perceived support to take up HPV vaccines
 Family members support me to take up HPV vaccines68169.3
  Yes13378.2414.2
  No42.426026.5
  Don’t know3319.4
Peers support me to take up HPV vaccines69270.5
  Yes13076.5333.4
  No74.125726.2
  Don’t know3319.4
 Number of item responses to the above 2 questions reflecting perceived supports φ 24725.2
  03319.4979.9
  1116.563865.0
  212674.1
Cue to action
 Doctor recommended me to take up HPV vaccines
  Yes8952.438439.1
  No2212.918218.5
  Don’t know5934.741642.4
 Peers recommended me to take up HPV vaccines
  Yes8047.145546.3
  No3319.424625.1
  Don’t know5733.528128.6
 I have watched media reports promoting HPV vaccines
  Yes13076.577078.4
  No137.611411.6
  Don’t know2715.99810.0
 I will recommend my patients/their family members to take up HPV vaccines
  Yes14182.958059.1
  No2917.140240.9
 Number of item responses to the above four questions reflecting cue to action received φ
  01710.011912.1
  11911.217718.0
  24224.724424.8
  33118.224424.8
  46135.919820.2
Behavioral intention to take up HPV vaccines
 Intention to take up HPV vaccines
  Very likely86.9334.6
  Quite likely2723.311916.6
  Not quite likely5950.943160.1
  Not likely2219.013418.7
* Appropriate response. φ Number of affirmative responses (totally agree/agree, yes).
Table 3. Frequency distributions of variables related to HPV-related perceptions (N = 1152).
Table 3. Frequency distributions of variables related to HPV-related perceptions (N = 1152).
VariablePhysician (N = 170)Nurse (N = 982)
N%N%
Knowledge on HPV
Whether males or female could be affected by HPV
Only Male21.240.4
Only Female42.4444.5
Both *16295.391993.6
Don’t know21.2151.5
Route of HPV transmission
Both sexual and Mother-to-infant transmission *8650.650751.6
Other route/Don’t know8449.447548.4
HPV6 & HPV11 cause Genital Warts
Yes *14283.558659.7
No/Don’t know2816.539640.3
HPV16 causes Genital Warts
Yes/Don’t know4526.543644.4
No *12271.853554.5
HPV18 causes Genital Warts
Yes/Don’t know116.519319.7
No *15993.578980.3
HPV could be controlled by antibiotics
Yes/Don’t know116.519319.7
No *15993.578980.3
HPV could be completely cured
Yes/Don’t know6638.841942.7
No *10461.256357.3
HPV is hereditary
Yes/Don’t know1911.216917.2
No *15188.881382.8
Number of appropriate responses to the above questions on knowledge related to HPV φ
000.030.3
100.070.7
242.4343.5
3137.6626.3
42816.518618.9
55230.627227.7
≥67342.941842.6
Perceived severity of HPV infection
Perceived chance of contracting HPV in the future
Low/very low7946.550851.7
Moderate7544.141842.6
Very high/high169.4565.7
Perceived damages of HPV infection on physical health
Low/very low95.3363.7
Moderate7644.735936.6
Very high/high8550.058759.8
Perceived infectivity of HPV
Low/very low00.011211.4
Moderate7745.345346.1
Very high/high9354.741742.5
Number of appropriate responses to the above questions reflecting perceived severity φ
05029.433233.8
15532.426627.1
≥26538.238439.1
Perceived susceptibility of HPV infection
Perceived knowledge on HPV
Low/very low3319.434134.7
Moderate11064.757758.8
Very high/high2715.9646.5
Perceived prevalence of HPV infection among male
Low/very low1810.617517.8
Moderate8952.456457.4
Very high/high6337.124324.7
Perceived prevalence of HPV infection among female
Low/very low84.7373.8
Moderate7342.946447.3
Very high/high8952.448149.0
Number of appropriate responses to the above questions reflecting perceived susceptibility φ
07242.446046.8
13319.428529.0
≥26538.223724.1
* Appropriate response. φ Number of affirmative responses (very high/high).
Table 4. Associations between composite cognitive indicator variables and intention to take up HPV vaccines.
Table 4. Associations between composite cognitive indicator variables and intention to take up HPV vaccines.
Physician aRow %ORU (95%CI)AOR (95%CI)
Perceived severity of HPV (number of items with affirmative responses)
017.111
≥137.32.894 (1.132, 7.396) *2.689 (1.034, 6.990) *
Perceived self-efficacy to take up HPV (number of items with affirmative responses)
0 or 110.311
236.85.042 (1.413, 17.992) *5.408 (1.466, 19.945) *
Perceived support to take up HPV (number of items with affirmative responses)
0 or 114.311
237.03.529 (1.237, 10.072) *3.468 (1.191, 10.099) *
Cue to action to take up HPV (number of items with affirmative responses)
0 or 112.511
≥236.94.093 (1.313, 12.767) *3.688 (1.165, 11.675) *
Nurse b
Perceived susceptibility of HPV (number of items with affirmative responses)
018.411
1 21.81.242 (0.808, 1.908)1.204 (0.765, 1.896)
≥227.11.653 (1.062, 2.573) *1.779 (1.109, 2.853) *
Knowledge on HPV vaccines (number of items with correct answer)
012.511
1 or 27.50.568 (0.160, 2.014)0.656 (0.179, 2.404)
319.51.700 (0.838, 3.449)2.013 (0.958, 4.274)
≥426.52.465 (1.472, 4.129) ***2.588 (1.515, 4.421) **
Perceived benefits to take up HPV (number of items with affirmative responses)
016.811
114.20.822 (0.463, 1.461)0.860 (0.462, 1.600)
2 20.01.241 (0.691, 2.229)1.011 (0.544, 1.880)
≥331.12.241 (1.367, 3.676) **1.815 (1.076, 3.063) *
Perceived self-efficacy to take up HPV (number of items with affirmative responses)
0 or 19.711
223.62.884 (1.544, 5.387) ***2.772 (1.422, 5.401) **
Perceived support to take up HPV (number of items with affirmative responses)
012.711
1 24.12.181 (1.133, 4.200) *1.915 (0.965, 3.798)
224.92.289 (1.446, 3.625) ***2.206 (1.360, 3.576) **
Cue to action to take up HPV (number of items with affirmative responses)
05.511
113.02.575 (1.004, 6.607) *2.703 (1.032, 7.082) *
≥228.06.664 (2.852, 15.570) ***6.960 (2.918, 16.597) ***
* p < 0.05; ** p < 0.01; *** p < 0.001. a AOR: adjusted OR, odds ratios after adjusting gender, which was the significant background variable. b AOR: adjusted OR, odds ratios adjusted for all multivariate significant background variables, including gender, age group, STD-related symptoms and number of sexual behaviors in the past 6 months. ORU: univariate odds ratios. Univariate non-significant variables, not considered in the model. 95% CI: 95% confidence interval.
Table 5. Multiple logistic regression result—associations between composite cognitive indicator variables and intention to take up HPV vaccines.
Table 5. Multiple logistic regression result—associations between composite cognitive indicator variables and intention to take up HPV vaccines.
VariableβSEAOR (95%CI)
Physician a
Perceived severity of HPV (number of items with affirmative responses)
0Reference 1
≥10.9890.5352.689 (0.943, 7.667) +
Perceived self-efficacy of HPV (number of items with affirmative responses)
0 or 1Reference 1
21.51820.7364.564 (1.079, 19.311) *
Perceived support to take up HPV (number of items with affirmative responses)
0 or 1Reference 1
21.16620.6303.210 (0.934, 11.026) +
Cue to action to take up HPV (number of items with affirmative responses)
0 or 1Reference 1
≥20.07710.7131.080 (0.267, 4.373)
Nurse b
Perceived susceptibility of HPV (number of items with affirmative responses)
0Reference 1
10.374 0.250 1.453 (0.89, 2.373)
≥20.479 0.271 1.615 (0.95, 2.746) +
Knowledge on HPV vaccines (number of items with appropriate answer)
0Reference 1
1−0.529 0.695 0.589 (0.151, 2.300)
20.407 0.413 1.502 (0.669, 3.371)
30.569 0.298 1.767 (0.986, 3.166) +
Perceived benefits to take up HPV (number of items with affirmative responses)
0Reference 1
1−0.480 0.346 0.619 (0.314, 1.219)
2−0.242 0.336 0.785 (0.407, 1.515)
≥30.309 0.291 1.362 (0.77, 2.412)
Perceived self-efficacy of HPV (number of items with affirmative responses)
0 or 1Reference 1
≥20.902 0.374 2.464 (1.185, 5.124) *
Perceived support to take up HPV (number of items with affirmative responses)
0Reference 1
1−0.114 0.390 0.892 (0.415, 1.918)
20.151 0.287 1.163 (0.663, 2.041)
Cue to action to take up HPV (number of items with affirmative responses)
0Reference 1
10.699 0.517 2.012 (0.73, 5.546)
≥21.432 0.492 4.185 (1.595, 10.98) **
* p < 0.05; ** p < 0.01. *** p < 0.001. + 0.05 < p < 0.1; a AOR: adjusted OR, odds ratios after adjusting gender and simultaneously for all involved variables. STD-related symptoms and number b AOR: adjusted OR, odds ratios after adjusting simultaneously for all involved variables and the significant background variables which include gender, age group, number of sexual behaviors in the past 6 months. 95%CI: 95% confidence interval. SE: Standard error.

Share and Cite

MDPI and ACS Style

Cheung, T.; Lau, J.T.F.; Wang, J.Z.; Mo, P.; Siu, C.K.; Chan, R.T.H.; Ho, J.Y.S. The Acceptability of HPV Vaccines and Perceptions of Vaccination against HPV among Physicians and Nurses in Hong Kong. Int. J. Environ. Res. Public Health 2019, 16, 1700. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph16101700

AMA Style

Cheung T, Lau JTF, Wang JZ, Mo P, Siu CK, Chan RTH, Ho JYS. The Acceptability of HPV Vaccines and Perceptions of Vaccination against HPV among Physicians and Nurses in Hong Kong. International Journal of Environmental Research and Public Health. 2019; 16(10):1700. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph16101700

Chicago/Turabian Style

Cheung, Teris, Joseph T.F. Lau, Johnson Z. Wang, Phoenix Mo, C.K. Siu, Rex T.H. Chan, and Janice Y.S. Ho. 2019. "The Acceptability of HPV Vaccines and Perceptions of Vaccination against HPV among Physicians and Nurses in Hong Kong" International Journal of Environmental Research and Public Health 16, no. 10: 1700. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph16101700

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop