Next Article in Journal
A Novel 3D Titanium Surface Produced by Selective Laser Sintering to Counteract Streptococcus oralis Biofilm Formation
Next Article in Special Issue
Application of Soft Computing Techniques to Estimate Cutter Life Index Using Mechanical Properties of Rocks
Previous Article in Journal
A Multi-Provider End-to-End Dynamic Orchestration Architecture Approach for 5G and Future Communication Systems
Previous Article in Special Issue
Use of the Gene-Expression Programming Equation and FEM for the High-Strength CFST Columns
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Classification of Imbalanced Travel Mode Choice to Work Data Using Adjustable SVM Model

1
School of Science, Hubei University of Technology, Wuhan 430068, China
2
Centre for Sustainable Urban Planning and Real Estate (SUPRE), Department of Urban and Regional Planning, Faculty of Built Environment, University of Malaya, Kuala Lumpur 50603, Malaysia
3
Department of Civil and Environmental Engineering, Universiti Teknologi PETRONAS, Seri Iskandar 32610, Perak, Malaysia
4
Department of Civil Engineering, College of Engineering, Taif University, Taif 21944, Saudi Arabia
5
Department of Industrial Engineering, College of Engineering, Kind Saud University, P.O. Box 800, Riyadh 11421, Saudi Arabia
6
Centre for Public Health, Queen’s University Belfast, Belfast BT12 6BA, UK
7
National Water Research Center, P.O. Box 74, Shubra El-Kheima 13411, Egypt
*
Authors to whom correspondence should be addressed.
Submission received: 21 October 2021 / Revised: 3 December 2021 / Accepted: 3 December 2021 / Published: 15 December 2021
(This article belongs to the Special Issue Novel Hybrid Intelligence Techniques in Engineering)

Abstract

:
The investigation of travel mode choice is an essential task in transport planning and policymaking for predicting travel demands. Typically, mode choice datasets are imbalanced and learning from such datasets is challenging. This study deals with imbalanced mode choice data by developing an algorithm (SVMAK) based on a support vector machine model and the theory of adjusting kernel scaling. The kernel function’s choice was evaluated by applying the likelihood-ratio chi-square and weighting measures. The empirical assessment was performed on the 2017 National Household Travel Survey–California dataset. The performance of the SVMAK model was compared with several other models, including neural networks, XGBoost, Bayesian Network, standard support vector machine model, and some SVM-based models that were previously developed to handle the imbalanced datasets. The SVMAK model outperformed these models, and in some cases improved the accuracy of the minority class classification. For the majority class, the accuracy improvement was substantial. This algorithm can be applied to other tasks in the transport planning domain that deal with uneven data distribution.

1. Introduction

A considerable amount of people’s daily trips is associated with their work. Transport planners and engineers attempt to discover work-related travel behaviors and establish strategies for reducing the adverse impacts of motorized transport on traffic, health, and the environment. One of these important behaviors is work mode choice which refers to the process where an individual chooses a certain mode for his/her trip to work. According to the literature, a variety of factors influence the work mode choice. Socioeconomic factors [1,2,3], household attributes e.g., [4], trip characteristics e.g., [5], job e.g., [6,7,8,9], and built environment [2,10,11] are some of these factors [3,11].
Mode choice data include a wide range of variables and samples. Typically, these data are complex and incomplete [12]. Furthermore, since motorized transport is dominant in most parts of the world, the travel surveys yield unbalanced mode choice classes; that is, there are more people who use cars than people who use other commute modes.
To date, many studies investigated the choice of travel mode to work (Table 1). These methods employed both traditional statistical methods and machine learning (ML) techniques. However, the former is criticized because of its linearity assumptions concerning mode choice data [13,14,15]. Thus, the employment of ML techniques has receieved more attention recently [16,17,18,19,20,21,22,23]. The classification of the new cases established concerning the existing samples is an essential task in ML models. If at least one of the categories comprises a smaller number of samples than other categories, the classification process becomes complex [24]. The class imbalance issue is simply an uneven data distribution amongst the different categories of the target. The precision of the classification algorithms will be unreliable when they are influenced by the majority class. In this case, the new samples are distributed to the majority category since the classification model tends to predict the minority category with less accuracy, which is an undesirable consequence [25].
Support vector machine (SVM) is a renowned ML technique for classification [26]. This algorithm also was used as a base to cope with imbalanced data. Batuwita and Palade [27] developed the fuzzy SVM model and dealt with imbalanced data in the presence of noises and outliers. Wang and Japkowicz [28] suggested boosting-SVMs with asymmetric cost. Their model runs by adjusting the classifier utilizing cost assignation, though it compensates the bias presented with adjustment through utilizing a combination system that is comparable, in effect, to adjust the distribution of data. Wu and Chang [29] suggested the class-boundary alignment algorithm to augment the SVM model to deal with imbalanced data. They modified the class boundary by converting the kernel function if data is represented in a vector space. This modification can also be performed by adjusting the kernel matrix if the data do not possess a vector-space representation. To enhance forecast performance, Liu et al. [30] suggested consolidating an integrated sampling system, which mixes both over-sampling and under-sampling, with an ensemble of SVM. These studies investigated the binary classification problem based on the SVM model; however, less examinations have been done concerning multiclass imbalanced classification based on this model.
Many studies in other domains, including medicine, economy, crash severity, and so on, tried to reduce the issues of imbalanced data, e.g., [31,32,33]. However, to the best of the authors’ knowledge, a very small number of studies have investigated the issues of imbalanced travel mode choice data and proposed a solution for it [33].
So far, many scholars have provided useful strategies to manage the issue of class imbalance. These strategies have been helpful and competent in explaining the issue partially through enhancing classifiers’ performance. The majority of models developed for binary category imbalance issues are improper for the multiclass imbalanced datasets like work mode choice. In addition, rare studies have provided a solution for the imbalanced mode choice datasets. The shortcomings mentioned above prompted the authors to cope with the multiclass imbalance mode choice data issue and contribute to the body of research on this topic. Thus, this study developed the adjustable kernel-based SVM classification algorithm (SVMAK) that is suitable for handling multiclass imbalanced data. Initially, the estimated hyperplane is obtained employing the regular SVM model. Subsequently, the parameter function and the weighting factor concerning each support vector in every iteration is determined. The likelihood-ratio chi-square test is utilized to estimate these parameters. Following this, the kernel transformation or the new kernel functions are determined. The unequal boundaries of class are enlarged, and data skewness is adjusted, thanks to this function of kernel conversion. Consequently, the estimated hyperplane is remedied through the developed model, and it also solves the problem of performance degradation.
The rest of this paper is structured as follows. In Section 2, the source of data, dataset characteristics, and methodology used for improving the performance of the SVM model for classification of imbalanced data are presented, and evaluation metrics are provided. Section 3 presents the results obtained with the model as well as a series of comparisons against other ML models and SVM-based models for classifying imbalanced datasets. Section 4 describes the sensitivity analysis method and its outcomes. Finally, a conclusion of the paper is presented in Section 5.
Table 1. Some investigation on work mode choice.
Table 1. Some investigation on work mode choice.
AuthorMain Factors UsedModelling Method
Lu and Kawamura [34]Mode preferences and responsiveness to level-of-serviceMultinomial logit
Badoe [4]Households (two-workers)Multinomial logit
Xie et al. [35]Sociodemographic and Level-of-service attributesMultinomial logit, Decision trees (DT), and Neural Networks (NN)
Patterson et al. [36]GenderMultinomial logit
Al-Ahmadi [37]Cultural, socioeconomic, safety, and religious parametersDisaggregate models and utility maximization
Gang [1]SocioeconomicMultinomial logit
Vega and Reynolds-Feighan [5]Travel time, travel cost, and employment destinationsBinary logit and GIS
Vega and Reynolds-Feighan [38]Central and non-central and suburban employment patterns.GIS and Cross-Nested Logit (CNL)
Day, Habib and Miller [6]Commuter trip timing, occupation groups, labor rates, work hour rules, free parking availability, and the spatial distribution of work locationsMultinomial logit
Habib [7]Work start time and work durationMultinomial logit
Heinen, Maat and van Wee [8]Office culture and colleagues’ and employers’ attitudesBinary logit
Hamre and Buehler [9]free car parking, public transportation benefits, showers/lockers, and bike parking at workMultinomial logit
Heinen and Bohte [39]Attitudes Toward Mode ChoiceMultinomial logit
Tran, Zhang, Chikaraishi and Fujiwara [10]Neighborhood and travel preferences, land use policy, land use diversity and population densityMultinomial logit
Kunhikrishnan and Srinivasan [40]Contextual heterogeneityBinary logit
Franco [41]Downtown parking supplySpatial general equilibrium
model
Simons, De Bourdeaudhuij, Clarys, De Geus, Vandelanotte, Van Cauwenberg and Deforche [2]Gender, socio-economic-status (SES) and living environment (urban vs. rural)Zero-inflated negative binomial (ZINB) regression
Indriany et al. [42]Risk and uncertaintyBinomial logit
Irfan et al. [43]Econometric ModelingMultinomial logit
Hatamzadeh et al. [44]GenderBinary logit

2. Methods and Data

2.1. Data

This study employed the 2017 National Household Travel Survey (NHTS)–California dataset. These data are provided by the US Federal Highway Administration and the California Department of Transportation and are freely available to all researchers and practitioners [45]. The NHTS is the definitive source on public travel behavior in the United States. It is the only national source of data that lets researchers and practitioners look at patterns in personal and household travel. This data comprises non-commercial travel information by all modes on a daily basis and the characteristics of the people who travel, their households, and their transport means. It appeared that 26,095 household samples of California were involved in this dataset. This research eliminated records that contained incomplete or inaccurate data. Additionally, the dataset included 458 variables. Thus, based on the literature, the authors selected those variables that linked to work mode choice. Finally, the dataset included 151,597 samples (based on the individuals’ records), 26 inputs, and one target variable (mode choice to work). However, at the same time, it was found that the target variable included uneven distribution of classes, which is called imbalanced data. Table 2 shows the composition of the dataset used in this study. The work mode choice had nine classes, and as expected, “car” is the majority class. The imbalance ratio is large (777.5). A list of variables used in this study is provided in Table 3.

2.2. Proposed Approach

The algorithm proposed in this study aims at dealing with the imbalanced mode choice data effectively. The theory of adjusting the kernel scaling method [46] is behind the model developed in this research to manage the multi-category imbalanced data. This study combines the SVM classification algorithm with the adjusting kernel scaling technique, which is named SVMAK.

2.2.1. Standard Support Vector Machine Model

Support Vector Machine (SVM) is a broadly employed and praised ML technique for classifying data [26]. The principal purpose of creating this model was to draw the input data into high dimensional space with the aid of the kernel function in such a way that the categories can be linearly divisible [47,48,49]. For the binary class issue, the greatest boundary that can divide the hyperplanes is as follows:
w · a + l = 0
The decision function for SVM based on the optimal pair (w0, l0) is expressed by:
f ( a ) = i S V λ i y i a , a i + l
where, λ i stands for support vector, a i denotes data sample and i = 1, 2, …, K. Concerning greater dimensional feature space, the value of 〈a.ai〉 is substituted by the kernel function Q 〈ai.aj〉, that is:
Q a i . a j = a i . a j
From the regular SVM, the kernel function was selected for estimating the boundaries’ space. In the beginning, the dataset S is divided into different samples, which are S1, S2, S3, …, Si, and subsequently, the kernel transformation function is implemented (Equation (4)).
f ( a ) = { e z 1 h ( a ) 2 ,   i f   a     S 1 e z 2 h ( a ) 2 ,   i f   a     S 2 . . . e z K h ( a ) 2 ,   i f   a     S K
where, h a = i S V λ i y i a , a i + l (where, λ i signifies support vector), Si refers to the ith sample of the training dataset, zi is calculated using likelihood-ratio chi-square, which is described in the following sections.

2.2.2. Likelihood-Ratio Chi-Square

Likelihood-ratio chi-square (G2) is a renowned non-parametric test which assesses the target-input independence and is suitable for categorial attributes. G2 ascertains a frequency distribution-based relationship among the categorical attribute assortments. To put it another way, it can be said that this technique should be employed to assess the association between the groups. The importance of determining the G2 is to ascertain the connection amongst the samples of every class and parameter zi. Equation (5) presents the analytical formulation for estimating G2.
G 2 = 2 D o l o g ( D o D e )  
where, Do and De signify observed and expected frequencies, respectively.

2.2.3. Calculating the Factor of Weighting

Ascertaining the factor of weighting is a challenging and vital task while handling an imbalanced category because finding a suitable weight is comparatively complicated. A practical technique to manage such issues is to assign smaller weight to the mainstream category and larger weight to the minority category through fulfilling the weight condition zi ∈ (0,1). For dealing with the multi-category imbalance issue in the SVMAK algorithm, this study employed Equation (6).
w i = N n i i = 1 K N n i
where, C and N express class and training sample sizes, respectively. ni symbolizes the size of each class when i = 1, 2, ..., K.
For computing the parameter zi, let S denotes the dataset that comprises the N number of samples and K classes. The zi parameter is estimated employing Equations (2) and (3). The G2 value in optimal distribution can be calculated as follows:
G 2 = 2 i = 1 K n i l o g ( n i N / K )
Let X i = n i l o g ( n i N / K ) .
Then,
G 2 = 2 i = 1 K A i
Hence, the parameter Zi can be characterized as
Z i = w i × A i G 2
In Equation (8), place the G2 value
Z i = w i × A i 2 i = 1 K A i
where, ni is the size of the sample in the ith class and I = 1, 2, …, K.

2.3. Model Development Steps

In the beginning, the NHTS data was prepared and cleansed. Later, these data were used for achieving the primary partition. Then, the authors determined the weighting factor (wi) value as well as Zi parameters for all support vectors in every iteration. The Zi value was estimated using the likelihood-ratio chi-square test. The kernel conversion function was estimated in the next step. Eventually, utilizing the newly estimated kernel matrix Kmt, the model was retrained. Figure 1 indicates the flowchart of the suggested algorithm.

2.4. Evaluation Metrics

This study employed four evaluation criteria to evaluate the performance of the models developed in this study. These criteria included accuracy, precision, recall, and F1 score. The formulas for calculating these criteria are shown in Equations (11)–(14). Accuracy refers to the ratio of the precisely forecasted class across the whole experiment class. Precision indicates the proportion of the true positive class over the whole number of an actual positive and false-positive category. Recall refers to the quantity of forecasted positive categories that fall out of whole positive cases in the data. F1 score shows the equilibrium between recall and precision.
A c c u r a c y = T P + T N T P + T N + F P + F N × 100
P r e c i s i o n = T P T P + F P
R e c a l l = T P T P + F N
F 1   s c o r e = 2 × ( p r e c i s i o n × r e c a l l ) p r e c i s i o n + r e c a l l
where, TP, TN, FP, and FN denote the number of true positives, true negatives, false positives, and false negatives, respectively.

3. Models’ Development and Evaluation

The authors of this study present the results of the SVMAK model as well as other classification models, including the standard SVM model, BN, ANN model, and some SVM-based models in literature proposed for handling the imbalance data.
It is a challenging task to determine the most suitable classification model for handling imbalance data issues. The travel mode choice dataset was taken for the empirical investigation. Figure 2 shows the nine classes plotted on the x-axis, and the size of samples in each class plotted on the y-axis. As can be seen in this figure, it is obvious that the NHTS dataset includes uneven category distribution; practically, it is called imbalance. Hence, it grows to be more complicated to manage such a circumstance through regular classification techniques. The category-wise distributions of the dataset based on the sample size are: The car category contains 108,885 samples, the pickup truck category consists of 22,188 samples, the SUV class contains 12,582 samples, the van category consists of 2998 samples, the public or commuter bus class includes 2454 samples, the bicycle class category comprises 2091 samples, walk contains 345 samples, the private/charter/tour/shuttle bus category consists of 40 samples, and finally the motorcycle/moped category holds 14 samples. The class imbalance ratio of the dataset is 777.5.
The principal intention of this study is to discover the most competent classification technique that can examine the imbalanced class. Periodically, various scholars had proposed useful techniques to handle class imbalance issue. The majority of the proposed methods were for binary category imbalance issues, which were not fit for the multi-category imbalance issue. These shortcomings urged authors to adjust the algorithm which can effectively handle binary category and multi-category imbalance issues without jeopardizing the performance of algorithms. The classification mentioned above will further assist in attaining the desirable answer toward urban transport planning and prediction of travel mode choice. This study employed four renowned conventional classification techniques and SVM-based models proposed in the literature along with the SVMAK model suggested in this study for the empirical assessment. The model applied in this study was compared with other models to ascertain effectiveness, fitness, and precision. This study evaluated the performance of the models developed using six criteria. Moreover, the authors employed a 10-fold cross-validation procedure as the validation scheme.
Four criteria, including accuracy, F1 score, precision, and recall were used to evaluate the outcomes of the classification algorithms applied in this study. The authors validated the classification techniques using the accuracy of classification. As is known, the NHTS dataset includes imbalanced category distribution, which may influence the performance of classification techniques. The overall performance of the models developed in this part of the study is shown in Table 4. All models achieved an overall accuracy above 80%. However, the SVMAK outperformed other models. The worst model was BN. Regarding other evaluation criteria, SVMAK again had the best values. It is worth mentioning that the SVMAK improved the performance of the SVMS model, which shows the capability of the proposed model of this study to handle the imbalanced mode choice data and enhance the performance of the typical SVM model for dealing with such data.
An evaluation of the models developed by each class also is provided in Figure 3. For the class of car, which had the largest sample size, the SVMAK improved the prediction accuracy from 82.33% (BN model) to 99.81%. Concerning the category of motorcycle/moped, which had the smallest sample size, the models developed yielded almost a similar accuracy. For other classes, the SVMAK model almost achieved better accuracy.
As previously mentioned, the performance of the SVMAK model was compared with some existing SVM models, which tried to alleviate the severe effects of using imbalanced data. In these methods the SVM model was hybridized with some techniques, including boosting [28], fuzzy [27], and class-boundary alignment [29], and ensemble [30]. The outcomes of the mentioned comparison are presented in Table 5. As can be seen, the SVMAK obtained the highest overall accuracy among all models developed.

4. Sensitivity Analysis

Many factors impact the travel mode choice; however, their effects are not the same. Thus, it is necessary to ascertain the magnitude of these impacts and identify the most influential factors on travel mode choice. For this purpose, the authors employed the mutual information (MI) test method [50], which computes the importance of the inputs. MI means a filtering system that captures the random association between inputs and the target. MI examines the dependence among variables and confirms the strength of the connection among them. The MI size among inputs is measured employing the information gain:
G a i n ( C , D ) = E n t ( C ) h 1 H | C h | | C | E n t ( C h )
where, h denotes the number of all probable values of D, Ch is the set of C when D takes the value Ds, and Ent(C) signifies the information entropy. The larger the value of Gain (C, D), the better the relationship between D and C.
Ultimately, the importance magnitude of each attribute for predicting travel mode choice was achieved based on the scores obtained in the MI test. The outcomes of this analysis are shown in Figure 4. The most important attributes were reason for not walking (walkmore), number of drivers in household (drvcnet), and count of adult household members at least 18 years old (numadlt). On the other hands, the lowest scores belonged to flexibility of work start time (flextime), owned vehicle longer than a year (vehowned), and gender (r_sex).
Reasons for not walking among respondents included unsafe street crossings, heavy traffic, and insufficient night lighting. It is clear that any improvement in these street conditions can encourage people to shift from motorized transport to walking. Thus, it makes sense that this factor is among the most influential travel mode choice factors to work [51,52,53]. The significance of the number of drivers in households can be attributed to its influence on the usage of vehicles and the generation of more trips. In practice, the likelihood of choosing active transportation options reduces as the number of drivers in a family grows [54]. As the number of adults in a family increases, the need for independent trips rises. Because of the different responsibilities that each adult in the family has, it is not easy to consolidate trips into one trip. This can be easily one of the principal sources of more trip generation and use of motorized transportation.
The flexibility of work start time was among the least important factors. This could be attributable to work culture of the respondents in the US. However, several previous studies showed that the flexibility of work start time influences the mode choice e.g., [54,55]. The possession of a vehicle for longer than a year was also an unimportant factor for predicting the choice of travel mode to work. A possible reason for this is that people usually look for flexible and convenient travel options to work. Usually, they are reluctant to replace their private cars with healthy travel modes unless they face new challenges. These challenges can be health problems, heavy traffic, so on. Thus, it is sensible that this factor does not influence the mode choice substantially.

5. Conclusions

In this research, the authors offered a novel method for learning from imbalanced mode choice data by the adjustable kernel based SVM classification model (SVMAK). The likelihood-ratio chi-square test and weighting measures were used in this suggested method for selecting the kernel function. The aforementioned kernel transformation function makes it possible to increase the class limits and offset the irregular class limits. The authors also performed a sensitivity analysis which showed that the reason for not walking (walkmore), the number of drivers in the household (drvcnet), and the count of adult household members no less than 18 years old (numadlt) were the most influential factors. On the other hand, the lowest scores found for flexibility of work start time (flextime), owning a vehicle longer than a year (vehowned), and gender (r_sex) were the most influential factors on travel mode choice.
The outcomes of this model were compared with those of various SVM-based models and ML models. The authors employed four criteria, including accuracy, F1 score, precision, and recall to perform this comparison. The results of this study showed that the SVMAK model achieved the best results and outperformed other models. The results also showed that this model improved the classification accuracy of most categories, especially the car class that had the largest samples.
Prediction of travel mode choice is an essential component of transport planning and traffic engineering. An accurate prediction is viable only if the data are precisely classified. Therefore, precise mode choice classification utilizing the algorithm suggested in this study would be efficacious for enhancing the current transport systems and further boosting the capacities for an efficient response to the worst traffic and transport scenarios.
The classes of choice of travel mode to work in the NHTS dataset are distinct from other mode choice datasets since this dataset considered the “SUV” category as different from the “car” category. However, future studies could combine these two classes and create a new class of travel mode to work. In the US, private motorized transport is dominant. Thus, the NHTS and, in turn, the result of this study is affected by this issue. Future studies can employ the method developed in this study to predict choice of travel mode to work in different environments, such as those in which walking, cycling, and public transport are dominant.

Author Contributions

Conceptualization, M.A. (Mahdi Aghaabbasi); methodology, M.A. (Mahdi Aghaabbasi); software, M.A. (Mahdi Aghaabbasi); formal analysis, M.A. (Mahdi Aghaabbasi); investigation, M.A. (Mahdi Aghaabbasi); resources, Y.Q., M.A. (Muwaffaq Alqurashi), M.A. (Mujahid Ali), B.S., E.E.H.; data curation, M.A. (Mahdi Aghaabbasi); writing—original draft preparation, M.A. (Mahdi Aghaabbasi) and M.M.; writing—review and editing, M.A. (Mahdi Aghaabbasi) and M.A. (Mujahid Ali); supervision, R.Z.; funding acquisition, Y.Q., M.A. (Muwaffaq Alqurashi), M.A. (Mujahid Ali), B.S., E.E.H. All authors have read and agreed to the published version of the manuscript.

Funding

This work was funded by the King Saud University, Saudi Arabia, through researchers supporting project number (RSP-2021/145), and the Taif University, Saudi Arabia, through Taif University Researchers Supporting Project, grant number [TURSP-2020/324].

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Acknowledgments

The authors of this paper thank King Saud University, Saudi Arabia for funding this work through researchers supporting project numbers (RSP-2021/145). The authors also would like to acknowledge Taif University Researches Supporting Project number (TURSP-2020/324), Taif University, Taif, Saudi Arabia for supporting this work.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Gang, L. A behavioral model of work-trip mode choice in Shanghai. China Econ. Rev. 2007, 18, 456–476. [Google Scholar]
  2. Simons, D.; De Bourdeaudhuij, I.; Clarys, P.; De Geus, B.; Vandelanotte, C.; Van Cauwenberg, J.; Deforche, B. Choice of transport mode in emerging adulthood: Differences between secondary school students, studying young adults and working young adults and relations with gender, SES and living environment. Transp. Res. Part A Policy Pract. 2017, 103, 172–184. [Google Scholar] [CrossRef]
  3. Ali, M.; de Azevedo, A.R.G.; Marvila, M.T.; Khan, M.I.; Memon, A.M.; Masood, F.; Almahbashi, N.M.Y.; Shad, M.K.; Khan, M.A.; Fediuk, R.; et al. The Influence of COVID-19-Induced Daily Activities on Health Parameters—A Case Study in Malaysia. Sustainability 2021, 13, 7465. [Google Scholar] [CrossRef]
  4. Badoe, D. Modelling work-trip mode choice decisions in two-worker households. Transp. Plan. Technol. 2002, 25, 49–73. [Google Scholar] [CrossRef]
  5. Vega, A.; Reynolds-Feighan, A. Employment sub-centres and travel-to-work mode choice in the Dublin region. Urban Stud. 2008, 45, 1747–1768. [Google Scholar] [CrossRef] [Green Version]
  6. Day, N.; Habib, K.N.; Miller, E.J. Analysis of work trip timing and mode choice in the Greater Toronto Area. Can. J. Civ. Eng. 2010, 37, 695–705. [Google Scholar] [CrossRef]
  7. Habib, K.M.N. Modeling commuting mode choice jointly with work start time and work duration. Transp. Res. Part A Policy Pract. 2012, 46, 33–47. [Google Scholar] [CrossRef]
  8. Heinen, E.; Maat, K.; van Wee, B. The effect of work-related factors on the bicycle commute mode choice in the Netherlands. Transportation 2013, 40, 23–43. [Google Scholar] [CrossRef] [Green Version]
  9. Hamre, A.; Buehler, R. Commuter mode choice and free car parking, public transportation benefits, showers/lockers, and bike parking at work: Evidence from the Washington, DC region. J. Public Transp. 2014, 17, 4. [Google Scholar] [CrossRef] [Green Version]
  10. Tran, M.T.; Zhang, J.; Chikaraishi, M.; Fujiwara, A. A joint analysis of residential location, work location and commuting mode choices in Hanoi, Vietnam. J. Transp. Geogr. 2016, 54, 181–193. [Google Scholar] [CrossRef]
  11. Ali, M.; Dharmowijoyo, D.B.; Harahap, I.S.; Puri, A.; Tanjung, L.E. Travel behaviour and health: Interaction of Activity-Travel Pattern, Travel Parameter and Physical Intensity. Solid State Technol. 2020, 63, 4026–4039. [Google Scholar]
  12. Aghaabbasi, M.; Shekari, Z.A.; Shah, M.Z.; Olakunle, O.; Armaghani, D.J.; Moeinaddini, M. Predicting the use frequency of ride-sourcing by off-campus university students through random forest and Bayesian network techniques. Transp. Res. Part A Policy Pract. 2020, 136, 262–281. [Google Scholar] [CrossRef]
  13. Stylianou, K.; Dimitriou, L.; Abdel-Aty, M. Big data and road safety: A comprehensive review. Mobil. Patterns Big Data Transp. Anal. 2019, 297–343. [Google Scholar] [CrossRef]
  14. Rashidi, S.; Ranjitkar, P.; Hadas, Y. Modeling bus dwell time with decision tree-based methods. Transp. Res. Rec. 2014, 2418, 74–83. [Google Scholar] [CrossRef]
  15. Ali, M.; Dharmowijoyo, D.B.E.; de Azevedo, A.R.G.; Fediuk, R.; Ahmad, H.; Salah, B. Time-Use and Spatio-Temporal Variables Influence on Physical Activity Intensity, Physical and Social Health of Travelers. Sustainability 2021, 13, 12226. [Google Scholar] [CrossRef]
  16. Parsajoo, M.; Armaghani, D.J.; Mohammed, A.S.; Khari, M.; Jahandari, S. Tensile strength prediction of rock material using non-destructive tests: A comparative intelligent study. Transp. Geotech. 2021, 31, 100652. [Google Scholar] [CrossRef]
  17. Harandizadeh, H.; Armaghani, D.J.; Asteris, P.G.; Gandomi, A.H. TBM performance prediction developing a hybrid ANFIS-PNN predictive model optimized by imperialism competitive algorithm. Neural Comput. Appl. 2021, 33, 16149–16179. [Google Scholar] [CrossRef]
  18. Li, E.; Zhou, J.; Shi, X.; Armaghani, D.J.; Yu, Z.; Chen, X.; Huang, P. Developing a hybrid model of salp swarm algorithm-based support vector machine to predict the strength of fiber-reinforced cemented paste backfill. Eng. Comput. 2020, 37, 1–22. [Google Scholar] [CrossRef]
  19. Jahed Armaghani, D.; Kumar, D.; Samui, P.; Hasanipanah, M.; Roy, B. A novel approach for forecasting of ground vibrations resulting from blasting: Modified particle swarm optimization coupled extreme learning machine. Eng. Comput. 2021, 37, 3221–3235. [Google Scholar] [CrossRef]
  20. Armaghani, D.J.; Harandizadeh, H.; Momeni, E.; Maizir, H.; Zhou, J. An optimized system of GMDH-ANFIS predictive model by ICA for estimating pile bearing capacity. Artif. Intell. Rev. 2021, 54, 1–38. [Google Scholar] [CrossRef]
  21. Li, Z.; Yazdani Bejarbaneh, B.; Asteris, P.G.; Koopialipoor, M.; Armaghani, D.J.; Tahir, M. A hybrid GEP and WOA approach to estimate the optimal penetration rate of TBM in granitic rock mass. Soft Comput. 2021, 25, 11877–11895. [Google Scholar] [CrossRef]
  22. Yu, C.; Koopialipoor, M.; Murlidhar, B.R.; Mohammed, A.S.; Armaghani, D.J.; Mohamad, E.T.; Wang, Z. Optimal ELM–Harris Hawks optimization and ELM–Grasshopper optimization models to forecast peak particle velocity resulting from mine blasting. Nat. Resour. Res. 2021, 30, 2647–2662. [Google Scholar] [CrossRef]
  23. Menardi, G.; Torelli, N. Training and assessing classification rules with imbalanced data. Data Min. Knowl. Discov. 2014, 28, 92–122. [Google Scholar] [CrossRef]
  24. Daskalaki, S.; Kopanas, I.; Avouris, N. Evaluation of classifiers for an uneven class distribution problem. Appl. Artif. Intell. 2006, 20, 381–417. [Google Scholar] [CrossRef]
  25. Vapnik, V. The Nature of Support Vector Machine; Springer: Berlin/Heidelberg, Germany, 1999. [Google Scholar]
  26. Batuwita, R.; Palade, V. FSVM-CIL: Fuzzy Support Vector Machines for Class Imbalance Learning. IEEE Trans. Fuzzy Syst. 2010, 18, 558–571. [Google Scholar] [CrossRef]
  27. Wang, B.X.; Japkowicz, N. Boosting support vector machines for imbalanced data sets. Knowl. Inf. Syst. 2009, 25, 1–20. [Google Scholar] [CrossRef] [Green Version]
  28. Wu, G.; Chang, E.Y. Class-Boundary Alignment for Imbalanced Dataset Learning. In Proceedings of the Workshop Learningfrom Imbalanced Datasets II, Washington, DC, USA, 21 August 2003; pp. 49–56. [Google Scholar]
  29. Liu, Y.; Yu, X.; Huang, J.X.; An, A. Combining integrated sampling with SVM ensembles for learning from imbalanced datasets. Inf. Process. Manag. 2011, 47, 617–631. [Google Scholar] [CrossRef]
  30. Liu, Z.; Tang, D.; Cai, Y.; Wang, R.; Chen, F. A hybrid method based on ensemble WELM for handling multi class imbalance in cancer microarray data. Neurocomputing 2017, 266, 641–650. [Google Scholar] [CrossRef]
  31. Hordri, N.F.; Yuhaniz, S.S.; Azmi, N.F.M.; Shamsuddin, S.M. Handling class imbalance in credit card fraud using resampling methods. Int. J. Adv. Comput. Sci. Appl. 2018, 9, 390–396. [Google Scholar] [CrossRef]
  32. Kim, S.; Lym, Y.; Kim, K.-J. Developing crash severity model handling class imbalance and implementing ordered nature: Focusing on elderly drivers. Int. J. Environ. Res. Public Health 2021, 18, 1966. [Google Scholar] [CrossRef]
  33. Rezaei, S.; Khojandi, A.; Haque, A.M.; Brakewood, C.; Jin, M.; Cherry, C. Performance evaluation of mode choice models under balanced and imbalanced data assumptions. Transp. Lett. 2021, 13, 1–13. [Google Scholar] [CrossRef]
  34. Lu, Y.; Kawamura, K. Data-mining approach to work trip mode choice analysis in Chicago, Illinois, area. Transp. Res. Rec. 2010, 2156, 73–80. [Google Scholar] [CrossRef]
  35. Xie, C.; Lu, J.; Parkany, E. Work travel mode choice modeling with data mining: Decision trees and neural networks. Transp. Res. Rec. 2003, 1854, 50–61. [Google Scholar] [CrossRef]
  36. Patterson, Z.; Ewing, G.; Haider, M. Gender-based analysis of work trip mode choice of commuters in suburban Montreal, Canada, with stated preference data. Transp. Res. Rec. 2005, 1924, 85–93. [Google Scholar] [CrossRef]
  37. Al-Ahmadi, H. Development of intercity work mode choice model for Saudi Arabia. In WIT Transactions on The Built Environment; WITT Press: Southampton, UK, 2007; Volume 96. [Google Scholar]
  38. Vega, A.; Reynolds-Feighan, A. A methodological framework for the study of residential location and travel-to-work mode choice under central and suburban employment destination patterns. Transp. Res. Part A Policy Pract. 2009, 43, 401–419. [Google Scholar] [CrossRef] [Green Version]
  39. Heinen, E.; Bohte, W. Multimodal commuting to work by public transport and bicycle: Attitudes toward mode choice. Transp. Res. Rec. 2014, 2468, 111–122. [Google Scholar] [CrossRef]
  40. Kunhikrishnan, P.; Srinivasan, K.K. Choice set variability and contextual heterogeneity in work trip mode choice in Chennai city. Transp. Lett. 2019, 11, 174–189. [Google Scholar] [CrossRef]
  41. Franco, S.F. Downtown parking supply, work-trip mode choice and urban spatial structure. Transp. Res. Part B Methodol. 2017, 101, 107–122. [Google Scholar] [CrossRef] [Green Version]
  42. Indriany, S.; Sjafruddin, A.; Kusumawati, A.; Weningtyas, W. Mode choice model for working trip under risk and uncertainty. In Proceedings of the AIP Conference Proceedings, Maharashtra, India, 5–6 July 2018; p. 020041. [Google Scholar]
  43. Irfan, M.; Khurshid, A.N.; Khurshid, M.B.; Ali, Y.; Khattak, A. Policy implications of work-trip mode choice using econometric modeling. J. Transp. Eng. Part A Syst. 2018, 144, 04018035. [Google Scholar] [CrossRef]
  44. Hatamzadeh, Y.; Habibian, M.; Khodaii, A. Walking mode choice across genders for purposes of work and shopping: A case study of an Iranian city. Int. J. Sustain. Transp. 2020, 14, 389–402. [Google Scholar] [CrossRef]
  45. Transportation Secure Data Center. 2017 National Household Travel Survey—California; Transportation Secure Data Center: Golden, CO, USA, 2019. [Google Scholar]
  46. Maratea, A.; Petrosino, A.; Manzo, M. Adjusted F-measure and kernel scaling for imbalanced data learning. Inf. Sci. 2014, 257, 331–341. [Google Scholar] [CrossRef]
  47. Vapnik, V. The Nature of Statistical Learning Theory; Springer Science & Business Media: Berlin/Heidelberg, Germany, 2013. [Google Scholar]
  48. Wang, L. Support. Vector Machines: Theory and Applications; Springer Science & Business Media: Berlin/Heidelberg, Germany, 2005; Volume 177. [Google Scholar]
  49. Foody, G.M.; Mathur, A. Toward intelligent training of supervised image classifications: Directing training data acquisition for SVM classification. Remote Sens. Environ. 2004, 93, 107–117. [Google Scholar] [CrossRef]
  50. Verron, S.; Tiplica, T.; Kobi, A. Fault detection and identification with a new feature selection based on mutual information. J. Process. Control. 2008, 18, 479–490. [Google Scholar] [CrossRef] [Green Version]
  51. Aghaabbasi, M.; Shah, M.Z.; Zainol, R. Investigating the Use of Active Transportation Modes Among University Employees Through an Advanced Decision Tree Algorithm. Civil. Sustain. Urban. Eng. 2021, 1, 26–49. [Google Scholar] [CrossRef]
  52. Aghaabbasi, M.; Moeinaddini, M.; Shah, M.Z.; Asadi-Shekari, Z. A new assessment model to evaluate the microscale sidewalk design factors at the neighbourhood level. J. Transp. Health 2017, 5, 97–112. [Google Scholar] [CrossRef]
  53. Tabatabaee, S.; Aghaabbasi, M.; Mahdiyar, A.; Zainol, R.; Ismail, S. Measurement Quality Appraisal Instrument for Evaluation of Walkability Assessment Tools Based on Walking Needs. Sustainability 2021, 13, 11342. [Google Scholar] [CrossRef]
  54. Sultana, S. Factors Affecting Parents’ Choice of Active Transport Modes for Children’s Commute to School: Evidence from 2017 NHTS Data; The University of Toledo: Toledo, OH, USA, 2019. [Google Scholar]
  55. Thorhauge, M.; Cherchi, E.; Rich, J. How flexible is flexible? Accounting for the effect of rescheduling possibilities in choice of departure time for work trips. Transp. Res. Part A Policy Pract. 2016, 86, 177–193. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Developed algorithm flowchart.
Figure 1. Developed algorithm flowchart.
Applsci 11 11916 g001
Figure 2. Category wise distribution of NHTS dataset.
Figure 2. Category wise distribution of NHTS dataset.
Applsci 11 11916 g002
Figure 3. Models’ performance by each class: (a) accuracy (%); (b) precision; (c) recall, (d) F1 score; CLASS 1 = Walk; CLASS 2 = Bicycle; CLASS 3 = Car; CLASS 4 = SUV; CLASS 5 = Van; CLASS 6 = Pickup truck; CLASS 7 = Motorcycle/moped; CLASS 8 = Public or commuter bus; CLASS 9 = Private/charter/tour/shuttle bus.
Figure 3. Models’ performance by each class: (a) accuracy (%); (b) precision; (c) recall, (d) F1 score; CLASS 1 = Walk; CLASS 2 = Bicycle; CLASS 3 = Car; CLASS 4 = SUV; CLASS 5 = Van; CLASS 6 = Pickup truck; CLASS 7 = Motorcycle/moped; CLASS 8 = Public or commuter bus; CLASS 9 = Private/charter/tour/shuttle bus.
Applsci 11 11916 g003
Figure 4. Outcomes of sensitivity analysis.
Figure 4. Outcomes of sensitivity analysis.
Applsci 11 11916 g004
Table 2. Description data.
Table 2. Description data.
2017 National Household Travel Survey–California Dataset
Total sample size151,597
Number of inputs26
Number of classes9
Number of samples in each class
Walk345
Bicycle2091
Car108,885
SUV12,582
Van2998
Pickup truck22,188
Motorcycle/moped14
Public or commuter bus2454
Private/charter/tour/shuttle bus40
Imbalance ratio777.5
Table 3. Variables included in the final dataset.
Table 3. Variables included in the final dataset.
VariableDescriptionTypeMean/Mode
Sociodemographic
ageAge of respondentContinuous36.947
educHighest education levelCategorial3.00
gt1jblwkMore than one jobFlag2.00
flextimeFlexibility of work start timeFlag2.00
raceRaceNominal1.00
sexGenderFlag1.00
wkftptFull-time or part-time workerFlag1.00
Household information
drvrcntNumber of drivers in householdContinuous3.003
hh_ontdNumber of household members on trip including respondentContinuous1.884
hhfamincHousehold incomeCategorial7.00
hhsizeCount of household membersContinuous4.576
hhvehcntCount of household vehiclesContinuous3.647
numadltCount of adult household members at least 18 years oldContinuous3.194
vehowned
wrkcount
Owned vehicle longer than a yearFlag1.00
youngchildNumber of workers in householdContinuous0.25
Trip characteristics
bikemoreReason for not bikingNominal7.00
timetowkTrip time to work in Continuous22.97
walkmoreReason for not walkingNominal5.00
Health
healthOpinion of healthCategorial2.00
medcondAny condition or handicap that makes it difficult to travel outside of the home?Flag2.00
medcond6Medical condition, how long?Categorial2.00
Living environment
urbansizeUrban area size where home address is locatedCategorial6.00
urbrurHousehold in urban/rural areaCategorial1.00
homelocHome location/reason to chose your current home location?Nominal1.00
wrktrans *Mode to workNominal3.00
* Target variable.
Table 4. Models’ overall performance.
Table 4. Models’ overall performance.
Accuracy (%)PrecisionRecallF1 Score
SVMAK99.810.991.000.99
SVMS93.180.870.890.88
XGBoost85.40.200.280.21
NN83.060.370.430.39
BN80.540.710.860.77
Table 5. The overall accuracy of SVM-based models and the SVMAK model.
Table 5. The overall accuracy of SVM-based models and the SVMAK model.
ModelAccuracy (%)
Wang and Japkowicz [28]83.33
Batuwita and Palade [27]92.99
Wu and Chang [29]93.89
Liu, Yu, Huang and An [30]90.16
SVMAK99.81
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Qian, Y.; Aghaabbasi, M.; Ali, M.; Alqurashi, M.; Salah, B.; Zainol, R.; Moeinaddini, M.; Hussein, E.E. Classification of Imbalanced Travel Mode Choice to Work Data Using Adjustable SVM Model. Appl. Sci. 2021, 11, 11916. https://0-doi-org.brum.beds.ac.uk/10.3390/app112411916

AMA Style

Qian Y, Aghaabbasi M, Ali M, Alqurashi M, Salah B, Zainol R, Moeinaddini M, Hussein EE. Classification of Imbalanced Travel Mode Choice to Work Data Using Adjustable SVM Model. Applied Sciences. 2021; 11(24):11916. https://0-doi-org.brum.beds.ac.uk/10.3390/app112411916

Chicago/Turabian Style

Qian, Yufeng, Mahdi Aghaabbasi, Mujahid Ali, Muwaffaq Alqurashi, Bashir Salah, Rosilawati Zainol, Mehdi Moeinaddini, and Enas E. Hussein. 2021. "Classification of Imbalanced Travel Mode Choice to Work Data Using Adjustable SVM Model" Applied Sciences 11, no. 24: 11916. https://0-doi-org.brum.beds.ac.uk/10.3390/app112411916

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop