Next Article in Journal
The Outcome and Implications of Public Precautionary Measures in Taiwan–Declining Respiratory Disease Cases in the COVID-19 Pandemic
Next Article in Special Issue
Modelling the Effectiveness of Epidemic Control Measures in Preventing the Transmission of COVID-19 in Malaysia
Previous Article in Journal
Environmental Risks Perception Among Citizens Living Near Industrial Plants: A Cross-Sectional Study
Previous Article in Special Issue
A Model for the Spread of Infectious Diseases in a Region
 
 
Erratum published on 18 December 2020, see Int. J. Environ. Res. Public Health 2020, 17(24), 9493.
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Cluster-Based Analysis of Infectious Disease Occurrences Using Tensor Decomposition: A Case Study of South Korea

School of Electrical Engineering, Korea University, 145 Anam-ro, Seongbuk-gu, Seoul 02841, Korea
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2020, 17(13), 4872; https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph17134872
Submission received: 9 June 2020 / Revised: 1 July 2020 / Accepted: 4 July 2020 / Published: 6 July 2020
(This article belongs to the Special Issue Infectious Disease Modeling in the Era of Complex Data)

Abstract

:
For a long time, various epidemics, such as lower respiratory infections and diarrheal diseases, have caused serious social losses and costs. Various methods for analyzing infectious disease occurrences have been proposed for effective prevention and proactive response to reduce such losses and costs. However, the results of the occurrence analyses were limited because numerous factors affect the outbreak of infectious diseases and there are complex interactions between these factors. To alleviate this limitation, we propose a cluster-based analysis scheme of infectious disease occurrences that can discover commonalities or differences between clusters by grouping elements with similar occurrence patterns. To do this, we collect and preprocess infectious disease occurrence data according to time, region, and disease. Then, we construct a tensor for the data and apply Tucker decomposition to extract latent features in the dimensions of time, region, and disease. Based on these latent features, we conduct k-means clustering and analyze the results for each dimension. To demonstrate the effectiveness of this scheme, we conduct a case study on data from South Korea and report some of the results.

1. Introduction

Historically, infectious diseases have had devastating consequences for public health. For instance, according to the report published in 2018 by the World Health Organization (WHO) [1], three infectious diseases: lower respiratory infection, diarrheal disease, and tuberculosis were ranked in the top 10 causes of death worldwide. Further, although human immunodeficiency virus infection and acquired immune deficiency syndrome (HIV/AIDS) and malaria are not listed in the top 10, they have also caused numerous deaths. Infectious diseases have resulted in not only losses of lives but also serious social losses [2,3]. For instance, recent infectious diseases, such as Middle East respiratory syndrome (MERS), Zika virus infection, and coronavirus disease 2019 (COVID-19), have had high infection rates, significant mortality rates, and severe aftereffects. As soon as their outbreaks were reported, most economic and social activities were restricted due to the fear of infection, resulting in serious social losses and costs.
To reduce such losses and costs, most countries have established national health institutes and have carried out diverse activities, such as disinfection, vaccination, campaigns, and quarantines. One critical factor necessary to improve the effectiveness of such activities is to analyze the previous occurrences of infectious diseases [4]. Based on the analysis results, governments and national health institutes in various countries can predict disease occurrences in the near future and take measures to reduce the risk of the expected infectious diseases, which includes vaccine production, effective regulations, and prevention campaigns. Hence, a variety of methods from statistical approaches to machine learning-based approaches have been used to analyze the occurrence of infectious diseases [5,6,7]. One representative goal in the analysis was to reveal the relationships between infectious diseases and factors in diverse fields, such as meteorology, sociology, and geography. The results of the analysis could be used as a basis to select crucial factors or eliminate extraneous factors when predicting the occurrence of infectious diseases, improving prediction performance [8].
Rodó et al. [9] introduced several studies on disease prediction models using climate data and analyzed the effects of the climate on infectious disease occurrences. In addition, they indicated the need for a sophisticated climate model suitable for future climate changes to ensure the performance of the prediction models. Vazquez-Prokopec et al. [10] collected global positioning system (GPS) data and infectious disease occurrence data on citizens and constructed a model based on the data to determine the relationship between them. They proposed a few basic rules regarding human mobility and, using a case study, demonstrated that understanding individual movement patterns is critical in infectious disease dynamics. Goscé et al. [11] analyzed the relationship between public transportation and infectious disease occurrence in cities. They concluded that public transportation of citizens is associated with infectious disease transmission. Further, Grassly and Fraser [12] examined the causes and consequences of seasonality. They derived several results concerning the interpretation of disease occurrence data, such as the association of transmission mechanisms and their transmission routes, the effects of seasonality on disease occurrences, and mathematical analyses of vaccination programs.
However, the results of previous analytical studies on infectious disease occurrences are not yet sufficient. This is because it is challenging to evaluate the extent to which various factors known to be associated with the development of an epidemic, such as environment, culture, or climate [13], influenced the occurrence of a particular epidemic. Further, even with the same disease, the influence of these factors may vary depending on spatial conditions, such as the region or country, and temporal conditions. For instance, in temperate countries, influenza is correlated with changes in temperature and absolute humidity but exhibits less correlation in tropical countries [14]. Moreover, the influence of climate on infectious disease occurrences gradually varies according to global climate changes [15].
A clustering-based approach can be used to solve the aforementioned problems. Clustering involves grouping of similar elements of a given set of elements. By analyzing the clusters, we discover common or discriminative factors among the clusters that are likely to affect disease occurrence patterns. This approach has been applied in various fields, including business, education, and biology [16,17,18]. Further, to analyze infectious diseases, several studies based on this approach have been reported. For instance, Xiao et al. [19] collected individual contact data from a survey and grouped the individuals into clusters using the k-medoids clustering algorithm to explore whether clusters of contacts could better explain the transmission of infectious diseases. They demonstrated that their methodology could provide insight into the structures underlying infection transmission, particularly the role of age-assortative contacts. Sloan et al. [20] presented a clustering-based analysis method using a spatial scan statistic and spatiotemporal wavelet analysis to discover how local socioeconomic factors influence both the timing and intensity of influenza and concluded that socioeconomic factors heavily affect local patients with influenza. McCloskey and Poon [21] presented a method to identify potential outbreaks of infectious diseases based on clustering in the genetic sequences and evaluated their method using both simulated and actual HIV sequence datasets. Guilamet et al. [22] applied a cluster analysis to variables from patient characteristics, acuity of illness/clinical presentation, and infection characteristics to identify determinants associated with bloodstream infection.
The results of clustering are highly dependent on the features used. Unlike the aforementioned work, we use infectious disease occurrence data as features to group elements with similar occurrence patterns. More specifically, we arrange the data by time, region, and infectious disease to analyze infectious disease occurrences effectively. However, rather than using them as they are, we extract latent features from the data and exploit them for clustering, which leads to a fast, robust, and general analysis [23,24,25]. This can be done easily by organizing data into tensors, decomposing them for feature extraction, and clustering the extracted latent features.
To demonstrate the effectiveness of the proposed scheme, we conduct a case study using the infectious disease occurrence data provided by the Infectious Diseases Portal [26] of the Korea Centers for Disease Control and Prevention (KCDC) in South Korea.
The contributions of the paper are summarized as follows:
  • We propose an analysis scheme for infectious disease occurrences based on the Tucker decomposition and k-means clustering by identifying elements with similar patterns of disease occurrence in terms of time, region, and disease.
  • We show how to interpret the commonalities and differences between clusters in terms of time, region, and disease. By doing so, we can discover possible factors that can affect the pattern of disease occurrences.
  • We reveal the effectiveness of our scheme by conducting a case study on the infectious disease occurrence patterns in South Korea.
The rest of the paper is organized as follows. We describe the clustering-based analysis scheme based on the Tucker decomposition and k-means clustering in Section 2. We demonstrate and discuss the analytical results in Section 3. Finally, we present the conclusions in Section 4.

2. Methods

Figure 1 illustrates the overall flow of the proposed scheme. The scheme consists of three main steps: dataset preprocessing, tensor decomposition, and clustering. We first describe how to collect the dataset of disease occurrences and preprocess them in Section 2.1. Then, we explain how to decompose the data using tensors and perform clustering in Section 2.2 and Section 2.3, respectively.

2.1. Dataset Collection and Preprocessing

The infectious disease occurrence data we used for analysis contained data on the infectious disease, region, and number of reported patients by date. For instance, in January 2016, the number of patients with cholera in Busan was zero, the number of patients with typhoid fever in Seoul was one, and the number of patients with mumps in Gyeonggi-do was 216. We focused on three elements: region, time, and infectious disease denoted as the R, T, and I dimensions, respectively. Further, we denoted the number of elements in each dimension by NR, NT, and NI, respectively. Figure 2 illustrates the occurrence data organized by place and disease on a specific date in the three-dimensional (3D) space.
In this paper, we used the infectious disease occurrence data from South Korea, provided by the Infectious Diseases Portal [26] of the KCDC. This dataset is a collection of the number of newly reported patients for 59 infectious diseases every month. The numbers were based on the patients reported to public health agencies in 17 regions, and the occurrence region was determined based on the patients’ addresses. We collected the occurrence data from January 2016 to October 2019 and removed missing values in the collected data. The missing values were due to the change in the legal infectious diseases list for South Korea. Because KCDC focuses on monitoring the occurrence of legal infectious diseases, the disease occurrences before the designation were not provided, and their counts were zero in the Infectious Diseases Portal. We deleted the infectious disease data containing missing values, and as a result, 56 infectious diseases remained. The infectious diseases and regions contained in the dataset are listed in Table 1 and Table 2, respectively.
For the collected occurrence data, we performed normalization on the number of patients with infectious diseases to reduce the effect of more common infectious diseases that many patients have developed. Without normalization, the analysis results significantly depend on those diseases, while the other diseases have a trivial effect. However, some diseases that had few patients had a high mortality rate or high contagion. For instance, MERS is a rarely reported infectious disease in South Korea. However, when the outbreak of MERS was reported in 2015, it caused about 38 fatalities and a tremendous amount of economic damage in South Korea [27]. Therefore, we performed normalization because it was necessary to prevent the analysis results from being too dependent on a few specific diseases.
For normalization, we first determined the maximum number of patients during the period for each disease and region pair and then divided the number of patients by the maximum value. During the normalization process, the occurrence values in the dataset were converted into real numbers between zero and one. Figure 3 illustrates this process. In the figure, the occurrence values of 96, 64, and 48 for the pair Region1 and Disease2 were converted into 1.0, 0.67, and 0.5, respectively, after normalization, as the maximum value is 96.
More specific reasons for using normalization are the following. We can reduce the influence of diseases that have significantly more patients compared to other diseases, as mentioned above. If we normalize the number of patients without considering their relative differences, the problem remains unsolved. Thus, we used the maximum patient number for each infectious disease. The normalized values of one disease are determined only by the maximum number of patients with the disease, no matter how many patients are infected with other diseases. For instance, in Figure 3, Disease1 has more patients than Disease2 and Disease3. If we perform the normalization, Disease1 has 1.0, 0.67, and 0.5 normalized values for Time1, Time2, and Time3, respectively, in Region2, whereas Disease2 has 0.2, 1.0, and 0.2 normalized values for the same region at the respective times.
Moreover, we can suppress the effects of the difference in population between regions. The number of patients in the region tends to become larger as the population increases. Thus, dividing the data by the maximum number of patients in the region removes the effects of the population differences. Dividing the number of patients by the population might be one option. However, severe but rarely occurring diseases have few patients, while the population can be relatively numerous. Then, the normalized values become close to zero, and it is difficult to affect the analysis results.
To handle 3D data (region, infectious disease, and time) effectively, we represented the disease occurrence data using tensors. A tensor is a multidimensional array for dealing with data whose dimension is equal to or higher than three. In the case of disease occurrence data, the tensor M has three dimensions R, I, and T, and the resulting size is NR × NI × NT. The tensor contains normalized patient numbers according to R, I, and T.

2.2. Tensor Decomposition

By decomposing a tensor, we extracted diverse latent features from each tensor element. Compared with raw data-based clustering, latent feature-based clustering has the following advantages. (i) It can decrease computation time and memory requirements by reducing the data dimensionality [23]. (ii) It is also more robust to noise [24]. (iii) Finally, latent features can represent the data in a more general form than the raw data [25].
To extract latent features from the raw data, we used a tensor decomposition technique that divides a tensor into smaller tensors or matrices. Tensor decomposition has been commonly used to extract latent features from data whose form is a tensor and has demonstrated its effectiveness in data analysis [28,29]. Among various methods for tensor decomposition, we used the Tucker decomposition because it is a generalized form of tensor decomposition [30,31]. It has been widely used for latent feature extraction in diverse domains, such as vectorized electroencephalography signals [32], human behaviors [33], and drug responses to diseases [34].
Tucker decomposition divides a given tensor into four components: three matrices corresponding to each dimension and one core tensor. Equation (1) is the equation for the Tucker decomposition, and all components in the equation are generally obtained by high-order orthogonal iteration [35], where γ is a core tensor whose size is dR × dI × dT, ×D denotes a k-mode product for a dimension D, and AD is a matrix of D whose size is ND × dD.
M γ × R A R × I A I × T A T .
Figure 4 illustrates the details of the Tucker decomposition. Here, AD contains the latent features of the elements in dimension D, and these features consist of dD real values (i.e., each element is represented by a vector). For instance, in the region matrix AR, “Seoul” is represented by [ v 1 ,   1 , , v 1 ,   d R ] , and “Gyeonggi-do” is represented by [ v 2 ,   1 , , v 2 ,   d R ] . Similarly, “Polio” is represented by [ v N I ,   1 , , v N I ,   d I ] in the disease matrix AI, and “Feb. 2016” is represented by [ v 2 ,   1 , , v 2 ,   d T ] in the time matrix AT. We call these vectors element vectors. Although we cannot know what the values in the element vectors mean because they are latent features, the more similar two vectors are, the more similar their corresponding elements are. Based on this property, we performed clustering.

2.3. Clustering

We grouped similar elements using the matrices obtained from decomposition. For this purpose, we used k-means clustering, which is one of the most popular clustering algorithms. This algorithm separates a given set of data into k clusters based on the distance between data and the centers of the clusters. For each dimension D, the algorithm works as follows:
  • Acquire all element vectors in D from the matrix AD.
  • Set the number of clusters, k.
  • Generate center vectors of k clusters randomly.
  • For each element vector in D, calculate the Euclidean distances to the center vectors, and obtain the nearest center vector.
  • Assign each element vector to the cluster with the nearest center vector.
  • Recalculate the center vector of each cluster.
  • Repeat Steps 4 to 6 until no more changes occur in the cluster assignment.
Based on the results obtained using k-means clustering, we performed the data analysis. Compared with other clustering algorithms, k-means clustering is simple to implement and is suitable for low-dimensional data [36,37]. In contrast, the k-means clustering method requires prior knowledge about the optimal number of clusters [38], which is nearly impossible to achieve. Hence, we adopted the elbow method to estimate the optimal number of clusters [39,40]. That is, for k from 1 to ND/2, we iteratively ran k-means clustering and measured the sum of the squared error (SSE) between element vectors and their center vector. Then, we plotted a graph of SSE versus k and found k where the change in SSE value decreases considerably. This point is called an elbow point, and we used this k as the optimal number of clusters for D, kD. Hence, we obtained kD clusters as a clustering result for each dimension and analyzed these clusters.

3. Results

3.1. Experimental Setup

We conducted all the experiments in a Python environment. For the Tucker decomposition, we used the TensorLy [41] library, and its hyperparameters are the same as the default setting of the library except for the number of latent features. We set the number of latent features in each dimension, dR, dI, and dT, to four. To set the number of clusters for each dimension, kR, kI, and kT, we plotted graphs of SSE versus k for each dimension as illustrated in Figure 5 and selected six, six, and four for the optimal cluster numbers, respectively. All the hyperparameters of the proposed schemes are organized in Table 3.
From now on, we present the clustering and analytical results of the infectious disease, time, and region in turn.

3.2. Analysis of Disease-Based Clustering

Figure 6 illustrates the six disease clusters obtained by clustering in terms of infectious disease. In the figure, all diseases in each cluster are listed except for Cluster 1. Because Cluster 1 contained 30 diseases, we only listed some of them. Figure 7 presents the characteristics of each cluster, which is the spatiotemporal normalized occurrences of a representative disease in each cluster. In the graphs, the x-axis and y-axis indicate the time and normalized occurrences, respectively. In addition, the 17 lines in the graphs represent the regions contained in the data.
Cluster 1 contained the 30 most infectious diseases, including cholera, Japanese encephalitis, and hydrophobia. The diseases in Cluster 1 never occur or rarely occur in South Korea. For instance, from January 2016 to October 2019, hydrophobia was never reported. In the case of cholera, most of the patients were reported in 2018 with one or two patients in each region. Similarly, Cluster 2 contained rare diseases, such as measles, rubella, and Q fever. The difference between Cluster 1 and Cluster 2 was that the diseases in Cluster 1 had similar occurrence patterns in most regions, whereas those in Cluster 2 did not. Figure 7a,b presents the normalized occurrences of Japanese encephalitis in Cluster 1 and measles in Cluster 2, respectively. Japanese encephalitis periodically occurred in a few regions every July to October. In contrast, measles occurred irregularly in some regions from 2016 to 2018, and the number of patients suddenly increased in 2019. Meanwhile, Japanese encephalitis seemed to have patterns similar to severe fever with thrombocytopenia syndrome of Cluster 5 illustrated in Figure 7e. However, Japanese encephalitis was assigned to Cluster 1 rather than to Cluster 5 due to the relatively small number of reported cases.
Cluster 3 consisted of infectious diseases whose patients continue to be reported in most regions without seasonality. Figure 7c illustrates the normalized occurrences of acute hepatitis B in Cluster 3. Patients with acute hepatitis B were present consistently in all regions. However, the peak points in each region were slightly different from each other, which results in a relatively complicated graph, as shown in Figure 7c. Hepatitis A showed similar patterns except that the peak points of all regions appeared only in early 2016 or at the end of 2019.
Cluster 4 comprises three infectious diseases commonly categorized as “febrile illness during the fall” in South Korea. Figure 7d reveals the normalized occurrences of scrub typhus. The number of patients with the disease drastically increased during fall and early winter, and afterward, decreased rapidly. This occurrence pattern repeated every year, and the other infectious diseases in this cluster exhibited similar trends. Meanwhile, leptospirosis demonstrated both a pattern of Cluster 4 and a pattern similar to Cluster 5, presented in Figure 7e. This is because patients with leptospirosis were often reported during late summer.
Cluster 5 comprises infectious diseases frequently reported from spring to fall. The patients continued to develop diseases during that period, with a few cases reported in winter. Figure 7e presents the normalized occurrences of severe fever with thrombocytopenia syndrome, which illustrates that trend. Among the four diseases in Cluster 5, patients with enterohemorrhagic Escherichia coli infection had been reported more frequently in winter compared to the other diseases. Thus, its occurrence pattern was somewhat similar to that of Cluster 3.
Finally, Cluster 6 was composed of infectious diseases whose periodicity was roughly six months. The number of patients increased during the transition period from spring to summer and from fall to winter, with a similar trend in most regions. Chickenpox showed that trend perfectly, as shown in Figure 7f. Although pneumococcus and primary syphilis also showed such a trend, their peak points in each region were different from each other, and the peak-to-peak differences were relatively marginal, unlike those of chickenpox.

3.3. Analysis of Time-Based Clustering

Time is another important clustering criterion. To observe the temporal trend, we performed month-based clustering based on the disease occurrence pattern. Figure 8 depicts the results for 46 months from January 2016 to October 2019 where four clusters are represented using assorted colors. In the figure, Clusters 1 to 3 repeat from January 2016 to December 2018. More specifically, Clusters 1, 2, and 3 repeated from winter to early summer, in summer, and in fall, respectively. This tendency indicates that infectious diseases, such as scrub typhus and influenza, have seasonality [12,42]. When we considered the clusters obtained in the disease-based clustering, we could roughly connect the disease clusters and time clusters. For instance, diseases in disease Cluster 3 are closely related to those in time Cluster 3. Second, diseases in disease Clusters 5 and 6 were determinants of time Clusters 1 and 2.
However, the trends changed dramatically in 2019. A new cluster, Cluster 4, appeared in January 2019, which had not been previously observed. Cluster 4 spanned until April, and then, Cluster 1 appeared in May 2019. However, in the next month, Cluster 2 started, which was one month earlier than in the previous years. Further, Cluster 2 lasted for 5 months. This indicates that the pattern of infectious disease occurrences considerably changed in 2019. Such changes can be explained by investigating the main diseases and their occurrences.
Figure 9 presents some pairs of clusters where noticeable changes were observed in the normalized occurrences. In the graphs, the x-axis and y-axis represent the region and normalized occurrence, respectively, and the clusters were represented using the colors defined in Figure 8. Figure 9a illustrates the normalized occurrences of measles of Clusters 1 and 4. The average number of patients with measles was about 50 per month in early 2019 and increased to 260 in April. It was about two per month before 2019. In May 2019, the number of patients decreased and went back to the trend from Cluster 1. In the figure, the normalized occurrences of Cluster 1 were so small that the maximum among the regions was only about 0.1. However, all the normalized occurrences of Cluster 4 ranged from 0.3 to 0.7.
Another major change is the reduction in patients with scarlet fever. From January to April 2019, the reported cases of scarlet fever nationwide decreased by more than half of those reported in the same month in 2018, and in a few regions, the number was reduced to a quarter. This is shown in Figure 9b. In Figure 9b, we observe that the normalized occurrences of Cluster 1 were equal to or more than about twice those of Cluster 4 in most regions.
The second pair of clusters we investigated was Clusters 1 and 2. The total number of patients with shigellosis nationwide increased slightly in June 2019. Although the number was only about 20, it was nearly three times larger than the previous year. Further, the number of patients with hepatitis A drastically increased, which reached about 20 times the patient number in the previous year. Figure 9c,d reveals the normalized occurrences of shigellosis and hepatitis A, respectively. In Figure 9c, the normalized occurrences of Cluster 1 were close to zero except for a few regions. However, in June 2019, some regions had considerably large values compared to Cluster 1. Meanwhile, the differences between the two clusters in Figure 9d were more noticeable compared to those in Figure 9c.
Lastly, the number of patients with hepatitis A and measles increased, but the number of patients with scarlet fever decreased in October 2019, compared to the same month of the previous year. In addition, the number of patients with scrub typhus that frequently occurred in the fall declined significantly in 2019. This is presumed to be the primary reason October 2019 was assigned to Cluster 2 instead of Cluster 3. Figure 9e,f displays the normalized occurrences of hepatitis A and scrub typhus, respectively. In the figure, although the normalized occurrences of Cluster 3 were much lower than those of Cluster 2, the normalized occurrences of Cluster 3 were much larger than those of Cluster 2.

3.4. Analysis of Region-Based Clustering

The last clustering that we performed was in regions. Figure 10 reveals the results where six region clusters were created from 17 regions, represented using different colors. Generally, geographically adjacent regions were more likely to be grouped into the same cluster. For instance, Cluster 3 consisted of two adjacent regions, Chungcheongbuk-do and Chungcheongnam-do, and Cluster 1 comprised spacious and connected regions, such as Gangwon-do, Gyeongsangbuk-do, Jeollabuk-do, and Jeollanam-do. Although Jeju-do is not directly connected because it is an island, it was included in Cluster 1. Meanwhile, metropolises, such as Busan, Daegu, Ulsan, Gwangju, Daejeon, and Sejong, except for Incheon and Seoul, were grouped into Cluster 2 regardless of their locations. This result is consistent with previous studies, in that the degree of urbanization led to differences in the occurrence patterns of the infectious diseases [43,44].
However, we did not find significant differences between clusters, unlike the disease-based clusters or time-based clusters. That is, the difference in the occurrence of infectious diseases was too small to separate into clusters. We assume that this is because South Korea has a well-developed transportation system and is a small territory compared to other countries, such as the United States, Canada, and China. As the exchange of people between regions is active, regions tend to have similar characteristics in terms of disease occurrences.
One notable point is that Seoul belongs to Cluster 4 along with Gyeongsangnam-do. Although Seoul is the biggest metropolis in Korea, it was not grouped with other metropolises, such as Incheon and Gyeonggi-do, which are close to Seoul. Just by comparing the number of patients or normalized occurrences of regions, we could not find any significant difference between clusters. However, by constructing tensors from the extracted features of regions listed in Table 4 and comparing them, we observed some differences between the tensors. Using this methodology, we found that the normalized occurrences were roughly dependent on feature F1 in Table 4. From this viewpoint, Seoul (0.331) had an occurrence pattern that was more similar to Gyeonggi-do (0.337) than to Gyeongsangnam-do (0.261) for various infectious diseases, including hepatitis A, chickenpox, and scrub typhus. However, considering the rest of the features, Seoul and Gyeongsangnam-do formed a cluster (Cluster 4), and Gyeonggi-do formed another cluster (Cluster 5).
In Cluster 2, the features of Sejong were different from those of other regions. In particular, Sejong exhibited significant differences in F1 and F2 compared to the other regions in the cluster. For instance, the F1 and F2 values of Sejong were 0.132 and −0.587, respectively, while their cluster averages were 0.211 and −0.165, respectively. Hence, when we performed k-means clustering with k set to 7, Sejong formed a new cluster, and other clusters remained unchanged. When we investigated the occurrences of diseases in Sejong, we found that overall infectious disease occurrences in this city were fewer than that in the other cities. We think this is because Sejong has the smallest population among the regions. Jeju-do, which has the second smallest population, also had a similar F1 value.

4. Conclusions

In this paper, we proposed a clustering-based analysis scheme for investigating the occurrence patterns of infectious diseases. To do this, we collected disease occurrence data containing time, region, and infectious disease and constructed a tensor. Then, we extracted latent features from the tensor by using Tucker decomposition and performed k-means clustering for each dimension in the latent spaces. To demonstrate the effectiveness of the scheme and how to interpret the obtained results, we conducted a case study of South Korea and showed the resulting clusters for each dimension. We analyzed the results by comparing the raw data and extracted features. Some disease clusters had seasonality and periodicity, whereas other disease clusters showed an aperiodic occurrence pattern. Further, we explained the changes in disease occurrences over time. We observed the abrupt changes between 2019 and the previous years and derived the reason from the data. Lastly, we confirmed the differences in the occurrence patterns between region clusters, caused by the degree of urbanization and geographical adjacency.
In the future, we aim to extend our scheme on a global scale to analyze infectious disease occurrence patterns affecting a wide range of countries. In addition, we will investigate deep learning-based feature extraction methods to extract better features of the given data and use explainable artificial intelligence techniques for a more effective explanation of the analysis results.

Author Contributions

Conceptualization, S.J., J.M. and E.H.; methodology, S.J. and J.M.; software, S.J. and J.M.; validation, S.J., J.M. and E.H.; formal analysis, S.J.; investigation, S.J. and J.M.; resources, S.J. and J.M.; data curation, J.M.; writing—original draft preparation, S.J.; writing—review and editing, E.H.; visualization, S.J.; supervision, E.H.; project administration, E.H.; funding acquisition, E.H. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by Government-wide R&D Fund project for infectious disease research (GFID), Republic of Korea (grant number: HG19C0682).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. World Health Organization. Global Health Estimates 2016: Deaths by Cause, Age, Sex, by Country and by Region, 2000–2016. Geneva. Available online: https://www.who.int/healthinfo/global_burden_disease/estimates/en/ (accessed on 7 April 2020).
  2. Jang, B.; Lee, M.; Kim, J.W. PEACOCK: A Map-Based Multitype Infectious Disease Outbreak Information System. IEEE Access 2019, 7, 82956–82969. [Google Scholar] [CrossRef] [PubMed]
  3. Qiu, W.; Chu, C.; Mao, A.; Wu, J. The Impacts on Health, Society, and Economy of SARS and H7N9 Outbreaks in China: A Case Comparison Study. J. Environ. Public Health 2018, 2018, 2710185. [Google Scholar] [CrossRef] [PubMed]
  4. Jia, W.; Wan, Y.; Li, Y.; Tan, K.; Lei, W.; Hu, Y.; Ma, Z.; Li, X.; Xie, G. Integrating Multiple Data Sources and Learning Models to Predict Infectious Diseases in China. In Proceedings of the AMIA Joint Summits on Translational Science, San Francisco, CA, USA, 25–28 March 2019; pp. 680–685. [Google Scholar]
  5. Area, I.; Batarfi, H.; Losada, J.; Nieto, J.J.; Shammakh, W.; Torres, Á. On a Fractional Order Ebola Epidemic Model. Adv. Differ. Equ. 2015, 2015, 278. [Google Scholar] [CrossRef] [Green Version]
  6. Wang, L.; Wu, J.T. Characterizing the Dynamics Underlying Global Spread of Epidemics. Nat. Commun. 2018, 9, 218. [Google Scholar] [CrossRef] [Green Version]
  7. Kraemer, M.U.G.; Golding, N.; Bisanzio, D.; Bhatt, S.; Pigott, D.M.; Ray, S.E.; Brady, O.J.; Brownstein, J.S.; Faria, N.R.; Cummings, D.A.T.; et al. Utilizing General Human Movement Models to Predict the Spread of Emerging Infectious Diseases in Resource Poor Settings. Sci. Rep. 2019, 9, 5151. [Google Scholar] [CrossRef] [Green Version]
  8. Junqué de Fortuny, E.; Martens, D.; Provost, F. Predictive Modeling with Big Data: Is Bigger Really Better? Big Data 2013, 1, 215–226. [Google Scholar] [CrossRef]
  9. Rodó, X.; Pascual, M.; Doblas-Reyes, F.J.; Gershunov, A.; Stone, D.A.; Giorgi, F.; Hudson, P.J.; Kinter, J.; Rodríguez-Arias, M.; Stenseth, N.; et al. Climate Change and Infectious Diseases: Can We Meet the Needs for Better Prediction? Clim. Chang. 2013, 118, 625–640. [Google Scholar] [CrossRef]
  10. Vazquez-Prokopec, G.M.; Bisanzio, D.; Stoddard, S.T.; Paz-Soldan, V.; Morrison, A.C.; Elder, J.P.; Ramirez-Paredes, J.; Halsey, E.S.; Kochel, T.J.; Scott, T.W.; et al. Using GPS Technology to Quantify Human Mobility, Dynamic Contacts and Infectious Disease Dynamics in a Resource-Poor Urban Environment. PLoS ONE 2013, 8, e58802. [Google Scholar] [CrossRef] [Green Version]
  11. Goscé, L.; Johansson, A. Analysing the Link between Public Transport Use and Airborne Transmission: Mobility and Contagion in the London Underground. Environ. Health 2018, 17, 84. [Google Scholar] [CrossRef] [Green Version]
  12. Grassly, N.C.; Fraser, C. Seasonal Infectious Disease Epidemiology. Proc. R. Soc. Lond. B Biol. Sci. 2006, 273, 2541–2550. [Google Scholar] [CrossRef] [Green Version]
  13. Morse, S.S. Factors in the Emergence of Infectious Diseases. In Plagues and Politics; Palgrave Macmillan: London, UK, 2001; pp. 8–26. [Google Scholar]
  14. Deyle, E.R.; Maher, M.C.; Hernandez, R.D.; Basu, S.; Sugihara, G. Global Environmental Drivers of Influenza. Proc. Natl. Acad. Sci. USA 2016, 113, 13081–13086. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Wu, X.; Lu, Y.; Zhou, S.; Chen, L.; Xu, B. Impact of Climate Change on Human Infectious Diseases: Empirical Evidence and Human Adaptation. Environ. Int. 2016, 86, 14–23. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Wang, N.; Sun, S.; OuYang, D. Business Process Modeling Abstraction Based on Semi-Supervised Clustering Analysis. Bus. Inf. Syst. Eng. 2018, 60, 525–542. [Google Scholar] [CrossRef]
  17. Nen-Fu, H.; Hsu, I.; Chia-An, L.; Hsiang-Chun, C.; Jian-Wei, T.; Tung-Te, F. The Clustering Analysis System Based on Students’ Motivation and Learning Behavior. In Proceedings of the 2018 Learning with MOOCS (LWMOOCS), Madrid, Spain, 26–28 September 2018; pp. 117–119. [Google Scholar]
  18. Durán, A.H.; Greco, T.M.; Vollmer, B.; Cristea, I.M.; Grünewald, K.; Topf, M. Protein Interactions and Consensus Clustering Analysis Uncover Insights into Herpesvirus Virion Structure and Function Relationships. PLoS Biol. 2019, 17, e3000316. [Google Scholar]
  19. Xiao, X.; Van Hoek, A.J.; Kenward, M.G.; Melegaro, A.; Jit, M. Clustering of Contacts Relevant to the Spread of Infectious Disease. Epidemics 2016, 17, 1–9. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  20. Sloan, C.; Chandrasekhar, R.; Mitchel, E.; Ndi, D.; Miller, L.; Thomas, A.; Bennett, N.M.; Chai, S.; Spencer, M.; Eckel, S.; et al. Spatial and Temporal Clustering of Patients Hospitalized with Laboratory-Confirmed Influenza in the United States. Epidemics 2020, 31, 100387. [Google Scholar] [CrossRef] [PubMed]
  21. McCloskey, R.M.; Poon, A.F. A Model-Based Clustering Method to Detect Infectious Disease Transmission Outbreaks from Sequence Variation. PLoS Comput. Biol. 2017, 13, e1005868. [Google Scholar] [CrossRef] [Green Version]
  22. Guilamet, M.C.V.; Bernauer, M.; Micek, S.T.; Kollef, M.H. Cluster Analysis to Define Distinct Clinical Phenotypes among Septic Patients with Bloodstream Infections. Medicine 2019, 98, e15276. [Google Scholar] [CrossRef]
  23. You, C.Z.; Palade, V.; Wu, X.J. Robust Structure Low-Rank Representation in Latent Space. Eng. Appl. Artif. Intell. 2019, 77, 117–124. [Google Scholar] [CrossRef]
  24. Zhou, Y.; Gu, K.; Huang, T. Unsupervised Representation Adversarial Learning Network: From Reconstruction to Generation. In Proceedings of the 2019 International Joint Conference on Neural Networks (IJCNN), Budapest, Hungary, 14–19 July 2019; pp. 1–8. [Google Scholar]
  25. Liu, Y.; Jun, E.; Li, Q.; Heer, J. Latent Space Cartography: Visual Analysis of Vector Space Embeddings. Comput. Graph. Forum 2019, 38, 67–78. [Google Scholar] [CrossRef]
  26. Infectious Disease Portal. Available online: http://www.cdc.go.kr/npt/ (accessed on 7 April 2020).
  27. Oh, M.D.; Park, W.B.; Park, S.W.; Choe, P.G.; Bang, J.H.; Song, K.H.; Kim, E.S.; Kim, H.B.; Kim, N.J. Middle East Respiratory Syndrome: What We Learned from the 2015 Outbreak in the Republic of Korea. Korean J. Intern. Med. 2018, 33, 233. [Google Scholar] [CrossRef] [PubMed]
  28. Gahrooei, M.R.; Yan, H.; Paynabar, K.; Shi, J. Multiple Tensor-on-Tensor Regression: An Approach for Modeling Processes with Heterogeneous Sources of Data. Technometrics 2020, 1–23. [Google Scholar] [CrossRef]
  29. Xia, S.; Jiang, H.; Zhang, Y.; Peng, D. Internet Advertising Investment Analysis Based on Beijing and Jinhua Signaling Data. In Proceedings of the 2019 IEEE International Conference on Computational Science and Engineering (CSE) and IEEE International Conference on Embedded and Ubiquitous Computing (EUC), New York, NY, USA, 1–3 August 2019; pp. 419–426. [Google Scholar]
  30. Mitenkova, A.; Kossaifi, J.; Panagakis, Y.; Pantic, M. Valence and Arousal Estimation In-The-Wild with Tensor Methods. In Proceedings of the 2019 14th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2019), Lille, France, 14–18 May 2019; pp. 1–7. [Google Scholar]
  31. Ratre, A.; Pankajakshan, V. Tucker Tensor Decomposition-Based Tracking and Gaussian Mixture Model for Anomaly Localisation and Detection in Surveillance Videos. IET Comput. Vis. 2018, 12, 933–940. [Google Scholar] [CrossRef]
  32. Cong, F.; Lin, Q.H.; Kuang, L.D.; Gong, X.F.; Astikainen, P.; Ristaniemi, T. Tensor Decomposition of EEG Signals: A Brief Review. J. Neurosci. Methods 2015, 248, 59–69. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  33. Zhang, J.; Han, Y.; Jiang, J. Tucker Decomposition-Based Tensor Learning for Human Action Recognition. Multimed. Syst. 2016, 22, 343–353. [Google Scholar] [CrossRef]
  34. Chen, H.; Li, J. Modeling Relational Drug-Target-Disease Interactions via Tensor Factorization with Multiple Web Sources. In Proceedings of the World Wide Web Conference, San Francisco, CA, USA, 13–17 May 2019; pp. 218–227. [Google Scholar]
  35. De Lathauwer, L.; De Moor, B.; Vandewalle, J. On the Best Rank-1 and Rank-(r1, r2,…,rn) Approximation of Higher-Order Tensors. SIAM J. Matrix Anal. Appl. 2000, 21, 1324–1342. [Google Scholar] [CrossRef]
  36. Janson, S.; Merkle, D.; Middendorf, M. Molecular Docking with Multi-Objective Particle Swarm Optimization. Appl. Soft Comput. 2008, 8, 666–675. [Google Scholar] [CrossRef]
  37. Sesto-Castilla, D.; Garcia-Villegas, E.; Lyberopoulos, G.; Theodoropoulou, E. Use of Machine Learning for Energy Efficiency in Present and Future Mobile Networks. In Proceedings of the 2019 IEEE Wireless Communications and Networking Conference (WCNC), Marrakech, Morocco, 15–19 April 2019; pp. 1–6. [Google Scholar]
  38. Raykov, Y.P.; Boukouvalas, A.; Baig, F.; Little, M.A. What to Do When K-means Clustering Fails: A Simple Yet Principled Alternative Algorithm. PLoS ONE 2016, 11, e0162259. [Google Scholar] [CrossRef]
  39. Zhang, Y.; Wu, J.; Zhou, C.; Zhang, Q. Installation Planning in Regional Thermal Power Industry for Emissions Reduction Based on an Emissions Inventory. Int. J. Environ. Res. Public Health 2019, 16, 938. [Google Scholar] [CrossRef] [Green Version]
  40. Bholowalia, P.; Kumar, A. EBK-means: A Clustering Technique Based on Elbow Method and K-means in WSN. Int. J. Comput. Appl. 2014, 105, 17–24. [Google Scholar]
  41. Kossaifi, J.; Panagakis, Y.; Anandkumar, A.; Pantic, M. Tensorly: Tensor Learning in Python. J. Mach. Learn. Res. 2019, 20, 925–930. [Google Scholar]
  42. Wesolowski, A.; Zu Erbach-Schoenberg, E.; Tatem, A.J.; Lourenço, C.; Viboud, C.; Charu, V.; Eagle, N.; Engø-Monsen, K.; Qureshi, T.; Buckee, C.O.; et al. Multinational Patterns of Seasonal Asymmetry in Human Movement Influence Infectious Disease Dynamics. Nat. Commun. 2017, 8, 2069. [Google Scholar] [CrossRef] [PubMed]
  43. Neiderud, C.J. How Urbanization Affects the Epidemiology of Emerging Infectious Diseases. Infect. Ecol. Epidemiol. 2015, 5, 27060. [Google Scholar] [CrossRef]
  44. Feikin, D.R.; Olack, B.; Bigogo, G.M.; Audi, A.; Cosmas, L.; Aura, B.; Burke, H.; Njenga, M.K.; Williamson, J.; Breiman, R.F. The Burden of Common Infectious Disease Syndromes at the Clinic and Household Level from Population-Based Surveillance in Rural and Urban Kenya. PLoS ONE 2011, 6, e16085. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Overall steps for data analysis.
Figure 1. Overall steps for data analysis.
Ijerph 17 04872 g001
Figure 2. Disease occurrence data organized by date.
Figure 2. Disease occurrence data organized by date.
Ijerph 17 04872 g002
Figure 3. Normalization of the number of disease patients.
Figure 3. Normalization of the number of disease patients.
Ijerph 17 04872 g003
Figure 4. Tucker decomposition.
Figure 4. Tucker decomposition.
Ijerph 17 04872 g004
Figure 5. Graphs of the sum of the squared error (SSE) versus k for each dimension: (a) region, (b) infectious disease, and (c) time.
Figure 5. Graphs of the sum of the squared error (SSE) versus k for each dimension: (a) region, (b) infectious disease, and (c) time.
Ijerph 17 04872 g005
Figure 6. Infectious diseases in each disease cluster.
Figure 6. Infectious diseases in each disease cluster.
Ijerph 17 04872 g006
Figure 7. The normalized occurrences of infectious diseases in the respective regions: (a) Japanese encephalitis; (b) measles; (c) acute hepatitis B; (d) scrub typhus; (e) severe fever with thrombocytopenia syndrome; (f) chickenpox.
Figure 7. The normalized occurrences of infectious diseases in the respective regions: (a) Japanese encephalitis; (b) measles; (c) acute hepatitis B; (d) scrub typhus; (e) severe fever with thrombocytopenia syndrome; (f) chickenpox.
Ijerph 17 04872 g007aIjerph 17 04872 g007b
Figure 8. Clustering results by time.
Figure 8. Clustering results by time.
Ijerph 17 04872 g008
Figure 9. Comparison of normalized occurrences of infectious diseases between clusters: (a) measles in Clusters 1 and 4; (b) scarlet fever in Clusters 1 and 4; (c) shigellosis in Clusters 1 and 2; (d) hepatitis A in Clusters 1 and 2; (e) hepatitis A in Clusters 3 and 2; (f) scrub typhus in Clusters 3 and 2.
Figure 9. Comparison of normalized occurrences of infectious diseases between clusters: (a) measles in Clusters 1 and 4; (b) scarlet fever in Clusters 1 and 4; (c) shigellosis in Clusters 1 and 2; (d) hepatitis A in Clusters 1 and 2; (e) hepatitis A in Clusters 3 and 2; (f) scrub typhus in Clusters 3 and 2.
Ijerph 17 04872 g009aIjerph 17 04872 g009b
Figure 10. The region clusters.
Figure 10. The region clusters.
Ijerph 17 04872 g010
Table 1. A list of infectious diseases.
Table 1. A list of infectious diseases.
#Infectious Disease#Infectious Disease
1Cholera29Paratyphoid fever
2Enterohemorrhagic Escherichia coli infection30Diphtheria
3Tetanus31Mumps
4Polio32Chickenpox
5Haemophilus influenzae type b33Malaria
6Leprosy34Legionellosis
7Epidemic typhus35Scrub typhus
8Brucellosis36Hydrophobia
9Primary syphilis37Congenital syphilis
10Plague38Dengue fever
11Smallpox39Severe acute respiratory syndrome
12Novel swine-origin influenza A(H1N1)40Q fever
13Lyme disease41Melioidosis
14Emerging infectious diseases42Middle East respiratory syndrome coronavirus
15Typhoid fever43Shigellosis
16Hepatitis A44Pertussis
17Measles45Rubella
18Japanese encephalitis46Acute hepatitis B
19Pneumococcus47Scarlet fever
20Neisseria meningitidis48Vibrio vulnificus sepsis
21Murine typhus49Leptospirosis
22Anthrax50Hemorrhagic fever with renal syndrome
23Secondary syphilis51Creutzfeldt–Jakob disease (CJD)/variant CJD
24Yellow fever52Viral hemorrhagic fevers
25Botulinum toxin53Avian influenza
26Tularemia54West Nile fever
27Tick-borne viral encephalitis55Chikungunya fever
28Severe fever with thrombocytopenia syndrome56Zika virus infection
Table 2. A list of regions.
Table 2. A list of regions.
#Region#Region
1Seoul10Chungcheongbuk-do
2Busan11Chungcheongnam-do
3Daegu12Jeollabuk-do
4Incheon13Jeollanam-do
5Gwangju14Gyeongsangbuk-do
6Daejeon15Gyeongsangnam-do
7Ulsan16Jeju-do
8Gyeonggi-do17Sejong
9Gangwon-do
Table 3. A list of hyperparameters.
Table 3. A list of hyperparameters.
VariableDescriptionValue
NRThe number of elements in the region dimension17
NIThe number of elements in the infectious disease dimension56
NTThe number of elements in the time dimension46
dRThe number of latent features in the region dimension4
dIThe number of latent features in the infectious disease dimension4
dTThe number of latent features in the time dimension4
kRThe number of clusters in the region dimension6
kIThe number of clusters in the infectious disease dimension6
kTThe number of clusters in the time dimension4
Table 4. Extracted features of the regions.
Table 4. Extracted features of the regions.
ClusterRegionFeatures
F1F2F3F4
1Gangwon-do0.218−0.1530.269−0.212
Gyeongsangbuk-do0.258−0.0650.285−0.233
Jeollabuk-do0.234−0.2560.147−0.210
Jeollanam-do0.216−0.139−0.045−0.392
Jeju-do0.177−0.117−0.182−0.335
Average0.220−0.1460.095−0.277
2Daejeon0.216−0.0470.0040.193
Daegu0.243−0.044−0.162−0.034
Gwangju0.201−0.176−0.0980.238
Busan0.257−0.044−0.327−0.127
Ulsan0.214−0.093−0.3920.314
Sejong0.132−0.587−0.1920.136
Average0.211−0.165−0.1940.120
3Chungcheongbuk-do0.205−0.0980.2560.250
Chungcheongnam-do0.261−0.1870.3960.186
Average0.233−0.1430.3260.218
4Seoul0.3310.305−0.0030.352
Gyeongsangnam-do0.2610.201−0.1780.184
Average0.2960.253−0.0910.268
5Gyeonggi-do0.3370.4200.318−0.025
6Incheon0.2760.359−0.319−0.326

Share and Cite

MDPI and ACS Style

Jung, S.; Moon, J.; Hwang, E. Cluster-Based Analysis of Infectious Disease Occurrences Using Tensor Decomposition: A Case Study of South Korea. Int. J. Environ. Res. Public Health 2020, 17, 4872. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph17134872

AMA Style

Jung S, Moon J, Hwang E. Cluster-Based Analysis of Infectious Disease Occurrences Using Tensor Decomposition: A Case Study of South Korea. International Journal of Environmental Research and Public Health. 2020; 17(13):4872. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph17134872

Chicago/Turabian Style

Jung, Seungwon, Jaeuk Moon, and Eenjun Hwang. 2020. "Cluster-Based Analysis of Infectious Disease Occurrences Using Tensor Decomposition: A Case Study of South Korea" International Journal of Environmental Research and Public Health 17, no. 13: 4872. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph17134872

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop