Affiliation(s):
Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ), Shenzhen 518107, China;
moreAffiliation(s): Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ), Shenzhen 518107, China; College of Computer Science and Software Engineering, Shenzhen University, Shenzhen 518060, China;
less
Yu-lin HE, Xuan LU, Philippe FOURNIER-VIGER, Joshua Zhexue HUANG. A novel overlapping minimization SMOTE algorithm for imbalanced classification[J]. Frontiers of Information Technology & Electronic Engineering,in press.https://doi.org/10.1631/FITEE.2300278
@article{title="A novel overlapping minimization SMOTE algorithm for imbalanced classification", author="Yu-lin HE, Xuan LU, Philippe FOURNIER-VIGER, Joshua Zhexue HUANG", journal="Frontiers of Information Technology & Electronic Engineering", year="in press", publisher="Zhejiang University Press & Springer", doi="https://doi.org/10.1631/FITEE.2300278" }
%0 Journal Article %T A novel overlapping minimization SMOTE algorithm for imbalanced classification %A Yu-lin HE %A Xuan LU %A Philippe FOURNIER-VIGER %A Joshua Zhexue HUANG %J Frontiers of Information Technology & Electronic Engineering %P %@ 2095-9184 %D in press %I Zhejiang University Press & Springer doi="https://doi.org/10.1631/FITEE.2300278"
TY - JOUR T1 - A novel overlapping minimization SMOTE algorithm for imbalanced classification A1 - Yu-lin HE A1 - Xuan LU A1 - Philippe FOURNIER-VIGER A1 - Joshua Zhexue HUANG J0 - Frontiers of Information Technology & Electronic Engineering SP - EP - %@ 2095-9184 Y1 - in press PB - Zhejiang University Press & Springer ER - doi="https://doi.org/10.1631/FITEE.2300278"
Abstract: The synthetic minority oversampling technique (SMOTE) is a popular algorithm to reduce the impact of class imbalance for building classifiers, which has received several enhancements over the past 20 years. SMOTE and its variants synthesize a number of minority-class sample points in the original sample space to alleviate the adverse effects of class imbalance. This approach works well in many cases, but problems arise when synthetic sample points are generated in overlapping areas between different classes, which further complicates classifier training. To address this issue, this paper proposes a novel generalization-oriented rather than imputation-oriented minority-class sample point generation algorithm, named overlapping minimization SMOTE (OM-SMOTE), this algorithm is designed specifically for binary imbalanced classification problems. OM-SMOTE first maps the original sample points into a new sample space by balancing the trade-off between sample encoding and classifier generalization. Then, OM-SMOTE employs a set of sophisticated minority-class sample point imputation rules to generate synthetic sample points that are as far as possible from overlapping areas between classes. Extensive experiments have been conducted on 32 imbalanced data sets to validate the effectiveness of the OM-SMOTE algorithm. Results show that using OM-SMOTE to generate synthetic minority-class sample points leads to better classifier training performances for the naive Bayes classifier, support vector machine, decision tree, and logistic regression than other 11 state-of-the-art SMOTE-based imputation algorithms. This demonstrates that OM-SMOTE is a viable approach to support the training of high-quality classifier for imbalanced classification.
Darkslateblue:Affiliate; Royal Blue:Author; Turquoise:Article
Reference
Open peer comments: Debate/Discuss/Question/Opinion
Open peer comments: Debate/Discuss/Question/Opinion
<1>