https://www.mdu.se/

mdu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
A Comparative Analysis of the Ingestion and Storage Performance of Log Aggregation Solutions: Elastic Stack & SigNoz
Mälardalen University, School of Innovation, Design and Engineering.
2024 (English)Independent thesis Basic level (degree of Bachelor), 10 credits / 15 HE creditsStudent thesis
Abstract [en]

As infrastructures and software grow in complexity the need to keep track of things becomes important. It is the job of log aggregation solutions to condense log data into a form that is easier to search, visualize, and analyze. There are many log aggregation solutions out there today with various pros and cons to fit the various types of data and architectures. This makes the choice of selecting a log aggregation solution an important one. This thesis analyzes two full-stack log aggregation solutions, Elastic stack and SigNoz, with the goal of evaluating how the ingestion and storage components of the two stacks perform with smaller and larger amounts of data. The evaluation of these solutions was done by ingesting log files of varying sizes into them while tracking their performance. These performance metrics were then analyzed to find similarities and differences. The thesis found that SigNoz featured a higher CPU usage on average, faster processing times, and lower memory usage. Elastic stack was found to do more processing and indexing on the data, requiring more memory and storage space to allow for more detailed searchability of the ingested data. This also meant that there was a larger storage space requirement for Elastic stack than SigNoz to store the ingested logs. The hope of this thesis is that these findings can be used to provide insight into the area and aid those choosing between the two solutions in making a more informed decision.

Place, publisher, year, edition, pages
2024. , p. 49
Keywords [en]
Elastic Stack, ELK, SigNoz, Beats, Logstash, Elasticsearch, Kibana, OpenTelemetry, ClickHouse, Log, Logging, Log Data, Log Aggregation, Performance, Ingestion, Storage
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:mdh:diva-66056OAI: oai:DiVA.org:mdh-66056DiVA, id: diva2:1838164
Subject / course
Computer Science
Supervisors
Examiners
Available from: 2024-02-19 Created: 2024-02-15 Last updated: 2024-02-19Bibliographically approved

Open Access in DiVA

fulltext(1177 kB)579 downloads
File information
File name FULLTEXT01.pdfFile size 1177 kBChecksum SHA-512
965f0f12468dd723ba10494029dbc6a42d3ab8d6f6567cd3d9dc125d238c6856f4ad0c843c87a3bab8f68f071c6bfd0b4dd5da95ba165ee2f46a91c5d2231bd8
Type fulltextMimetype application/pdf

Search in DiVA

By author/editor
Duras, Robert
By organisation
School of Innovation, Design and Engineering
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar
Total: 579 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 865 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf