https://www.mdu.se/

mdu.sePublikationer
Driftstörningar
Det förekommer återkommande driftstörningar på några av sök-portalerna på grund av hög belastning. Vi arbetar på att lösa problemet, ni kan tillfälligt mötas av ett felmeddelande.
Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Smart Data Driven Decision Trees Ensemble Methodology for Imbalanced Big Data
Univ Granada, Andalusian Res Inst Data Sci & Computat Intelligen, Dept Software Engn, Granada 18071, Spain..ORCID-id: 0000-0002-1927-8673
Univ Granada, Andalusian Res Inst Data Sci & Computat Intelligen, Dept Comp Sci & Artificial Intelligence, Granada 18071, Spain..
Mälardalens universitet, Akademin för innovation, design och teknik, Inbyggda system.ORCID-id: 0000-0001-9857-4317
Univ Granada, Andalusian Res Inst Data Sci & Computat Intelligen, Dept Comp Sci & Artificial Intelligence, Granada 18071, Spain..
2024 (Engelska)Ingår i: Cognitive Computation, ISSN 1866-9956, E-ISSN 1866-9964, Vol. 16, nr 4, s. 1572-1588Artikel i tidskrift (Refereegranskat) Published
Abstract [en]

Differences in data size per class, also known as imbalanced data distribution, have become a common problem affecting data quality. Big Data scenarios pose a new challenge to traditional imbalanced classification algorithms, since they are not prepared to work with such amount of data. Split data strategies and lack of data in the minority class due to the use of MapReduce paradigm have posed new challenges for tackling the imbalance between classes in Big Data scenarios. Ensembles have been shown to be able to successfully address imbalanced data problems. Smart Data refers to data of enough quality to achieve high-performance models. The combination of ensembles and Smart Data, achieved through Big Data preprocessing, should be a great synergy. In this paper, we propose a novel Smart Data driven Decision Trees Ensemble methodology for addressing the imbalanced classification problem in Big Data domains, namely SD_DeTE methodology. This methodology is based on the learning of different decision trees using distributed quality data for the ensemble process. This quality data is achieved by fusing random discretization, principal components analysis, and clustering-based random oversampling for obtaining different Smart Data versions of the original data. Experiments carried out in 21 binary adapted datasets have shown that our methodology outperforms random forest.

Ort, förlag, år, upplaga, sidor
SPRINGER , 2024. Vol. 16, nr 4, s. 1572-1588
Nyckelord [en]
Big data, Smart data, Classification, Ensemble, Imbalanced data, Decision tree
Nationell ämneskategori
Data- och informationsvetenskap
Identifikatorer
URN: urn:nbn:se:mdh:diva-69422DOI: 10.1007/s12559-024-10295-zISI: 001236089200002Scopus ID: 2-s2.0-85194861723OAI: oai:DiVA.org:mdh-69422DiVA, id: diva2:1920395
Tillgänglig från: 2024-12-11 Skapad: 2024-12-11 Senast uppdaterad: 2025-10-10Bibliografiskt granskad

Open Access i DiVA

Fulltext saknas i DiVA

Övriga länkar

Förlagets fulltextScopus

Person

Xiong, Ning

Sök vidare i DiVA

Av författaren/redaktören
Garcia-Gil, DiegoXiong, Ning
Av organisationen
Inbyggda system
I samma tidskrift
Cognitive Computation
Data- och informationsvetenskap

Sök vidare utanför DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetricpoäng

doi
urn-nbn
Totalt: 95 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf