https://www.mdu.se/

mdh.sePublikasjoner
Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Smart Data Driven Decision Trees Ensemble Methodology for Imbalanced Big Data
Univ Granada, Andalusian Res Inst Data Sci & Computat Intelligen, Dept Software Engn, Granada 18071, Spain..ORCID-id: 0000-0002-1927-8673
Univ Granada, Andalusian Res Inst Data Sci & Computat Intelligen, Dept Comp Sci & Artificial Intelligence, Granada 18071, Spain..
Mälardalens universitet, Akademin för innovation, design och teknik, Inbyggda system.ORCID-id: 0000-0001-9857-4317
Univ Granada, Andalusian Res Inst Data Sci & Computat Intelligen, Dept Comp Sci & Artificial Intelligence, Granada 18071, Spain..
2024 (engelsk)Inngår i: Cognitive Computation, ISSN 1866-9956, E-ISSN 1866-9964, Vol. 16, nr 4, s. 1572-1588Artikkel i tidsskrift (Fagfellevurdert) Published
Abstract [en]

Differences in data size per class, also known as imbalanced data distribution, have become a common problem affecting data quality. Big Data scenarios pose a new challenge to traditional imbalanced classification algorithms, since they are not prepared to work with such amount of data. Split data strategies and lack of data in the minority class due to the use of MapReduce paradigm have posed new challenges for tackling the imbalance between classes in Big Data scenarios. Ensembles have been shown to be able to successfully address imbalanced data problems. Smart Data refers to data of enough quality to achieve high-performance models. The combination of ensembles and Smart Data, achieved through Big Data preprocessing, should be a great synergy. In this paper, we propose a novel Smart Data driven Decision Trees Ensemble methodology for addressing the imbalanced classification problem in Big Data domains, namely SD_DeTE methodology. This methodology is based on the learning of different decision trees using distributed quality data for the ensemble process. This quality data is achieved by fusing random discretization, principal components analysis, and clustering-based random oversampling for obtaining different Smart Data versions of the original data. Experiments carried out in 21 binary adapted datasets have shown that our methodology outperforms random forest.

sted, utgiver, år, opplag, sider
SPRINGER , 2024. Vol. 16, nr 4, s. 1572-1588
Emneord [en]
Big data, Smart data, Classification, Ensemble, Imbalanced data, Decision tree
HSV kategori
Identifikatorer
URN: urn:nbn:se:mdh:diva-69422DOI: 10.1007/s12559-024-10295-zISI: 001236089200002Scopus ID: 2-s2.0-85194861723OAI: oai:DiVA.org:mdh-69422DiVA, id: diva2:1920395
Tilgjengelig fra: 2024-12-11 Laget: 2024-12-11 Sist oppdatert: 2025-10-10bibliografisk kontrollert

Open Access i DiVA

Fulltekst mangler i DiVA

Andre lenker

Forlagets fulltekstScopus

Person

Xiong, Ning

Søk i DiVA

Av forfatter/redaktør
Garcia-Gil, DiegoXiong, Ning
Av organisasjonen
I samme tidsskrift
Cognitive Computation

Søk utenfor DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric

doi
urn-nbn
Totalt: 95 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf