https://www.mdu.se/

mdu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Automated Performance Profiling of Software Applications
Mälardalen University, School of Innovation, Design and Engineering.ORCID iD: 0000-0002-2758-8428
2023 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

For industrial systems performance, it is desired to keep the IT infrastructure competitive through the efficient use of computer resources. However, modern software applications are complex and often utilize a broad spectrum of available hardware resources. The way how applications utilize these resources may vary from platform to platform due to the different architectural features, requirements and performance levels guaranteed by the hardware as well as due to the type of application under analysis. It becomes challenging to predict how the deployed applications will perform on a particular platform, how to improve the hardware resource utilization, and how to meet the Quality of Service (QoS) requirements.  

Computers these days enable us to precisely trace down the performance of applications using the Performance Monitoring Counters (PMCs) available in the Performance Monitoring Unit (PMU) of the processors. PMCs can record micro-architectural events, called PMU events, at the CPU cycle level. Tools like perf API and PAPI provide performance information using manual and selective function calls. Nevertheless, it is difficult for humans to make analyses, visualize performance over time and draw conclusions from this wealth of data without automatic and intelligent tools. 

 In this thesis, our first contribution is to propose a cross-platform automated approach to investigate the overall performance profile of the applications. Instead of relying on a static and pre-selected list of hardware and software performance events we avoid the selection bias by capturing the entire range of performance events specific to the platform on which applications are running.  

The performance data being generated from shared resource environments and hierarchical resource utilization demands makes it harder to represent the behavior in one model. That being the case, it was deemed appropriate to demonstrate the compact representation of behavior. So, our next contribution is to present a simplified model to understand the behavior of performance events. Therefore, we determine segments in performance data by locating the points in their data distribution using the change point detection method. The proposed solution reduces the complexity of data handling, allows the application of further statistical analyses and provides better visualization.  

Lastly, to reveal the out-of-sight information, we present a customized approach to automatically identify the groups of similar performance events based on the change in their behavior. There can be several ways to group the performance data, we opt to form the groups based on change points in the behavior of the performance events. The knowledge can then be used by the decision-makers as per their interests such as for load balancing, deployments, scheduling and anomalous behavior detection. 

Place, publisher, year, edition, pages
Västerås: Mälardalen university , 2023.
Series
Mälardalen University Press Licentiate Theses, ISSN 1651-9256 ; 347
National Category
Computer Sciences
Research subject
Computer Science
Identifiers
URN: urn:nbn:se:mdh:diva-64286ISBN: 978-91-7485-610-1 (print)OAI: oai:DiVA.org:mdh-64286DiVA, id: diva2:1798388
Presentation
2023-10-25, Delta, Mälardalens universitet, Västerås, 13:15 (English)
Opponent
Supervisors
Available from: 2023-09-20 Created: 2023-09-19 Last updated: 2023-10-04Bibliographically approved
List of papers
1. Automatic Platform-Independent Monitoring and Ranking of Hardware Resource Utilization
Open this publication in new window or tab >>Automatic Platform-Independent Monitoring and Ranking of Hardware Resource Utilization
Show others...
2021 (English)In: IEEE International Conference on Emerging Technologies and Factory Automation, ETFA, Institute of Electrical and Electronics Engineers Inc. , 2021Conference paper, Published paper (Refereed)
Abstract [en]

In this paper, we discuss a method for automatic monitoring of hardware and software events using performance monitoring counters. Computer applications are complex and utilize a broad spectra of the available hardware resources, where multiple performance counters can be of significant interest to understand. The number of performance counters that can be captured simultaneously is, however, small due to hardware limitations in most modern computers. We suggest a platform independent solution to automatically retrieve hardware events from an underlying architecture. Moreover, to mitigate the hardware limitations we propose a mechanism that pinpoints the most relevant performance counters for an application's performance. In our proposal, we utilize the Pearson's correlation coefficient to rank the most relevant performance counters and filter out those that are most relevant and ignore the rest. 

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers Inc., 2021
Keywords
Correlation methods, Application performance, Automatic monitoring, Broad spectrum, Hardware and software, Hardware resource utilization, Hardware resources, Performance counters, Performance-monitoring, Platform independent, Software events, Computer hardware
National Category
Computer Systems
Identifiers
urn:nbn:se:mdh:diva-57107 (URN)10.1109/ETFA45728.2021.9613506 (DOI)000766992600158 ()2-s2.0-85122912883 (Scopus ID)9781728129891 (ISBN)
Conference
26th IEEE International Conference on Emerging Technologies and Factory Automation, ETFA 2021, 7 September 2021 through 10 September 2021
Projects
ACICS - Assured Cloud Platforms for Industrial Cyber-physical SystemsXPRES - Excellence in Production ResearchFiC - Future factories in the Cloud
Available from: 2022-02-23 Created: 2022-02-23 Last updated: 2023-09-19Bibliographically approved
2. Automatic Segmentation of Resource Utilization Data
Open this publication in new window or tab >>Automatic Segmentation of Resource Utilization Data
Show others...
2022 (English)In: 1st IEEE Industrial Electronics Society Annual On-Line Conference (ONCON) 2022, 2022Conference paper, Published paper (Other academic)
Abstract [en]

Advancement of industrial systems seek improvements to achieve required level of quality of service and efficient performance management. It is essential though to have better understanding of resource utilization behaviour of applications in execution. Even the expert engineers desire to envision dependencies and impact of one computer resource on the other. For such situations it is significant to know statistical relationship between data sets such as a resource with higher cache demand should not be scheduled together with other cache hungry process at the same time and same core. Performance monitoring data coming from hardware and software is huge and grouping of this time series data based on similar behaviour can display distinguishable execution phases. For benefits like these we opt to choose change point analysis method. By using this method study determined the optimal threshold which can identify more or less same segments for other executions of same application and same event. These segments are then validated with the help of test data. Finally the study provided segment-wise, local, compact statistical model with decent accuracy.

National Category
Computer Sciences
Research subject
Computer Science
Identifiers
urn:nbn:se:mdh:diva-61461 (URN)10.1109/ONCON56984.2022.10126744 (DOI)2-s2.0-85161320276 (Scopus ID)979-8-3503-9806-9 (ISBN)
Conference
2022 IEEE 1st Industrial Electronics Society Annual On-Line Conference (ONCON), 09-11 December 2022, Kharagpur, India
Available from: 2023-01-11 Created: 2023-01-11 Last updated: 2023-09-19Bibliographically approved
3. Automatic Clustering of Performance Events
Open this publication in new window or tab >>Automatic Clustering of Performance Events
Show others...
2023 (English)Conference paper, Published paper (Refereed)
Abstract [en]

Modern hardware and software are becoming increasingly complex due to advancements in digital and smart solutions. This is why industrial systems seek efficient use of resources to confront the challenges caused by the complex resource utilization demand. The demand and utilization of different resources show the particular execution behavior of the applications. One way to get this information is by monitoring performance events and understanding the relationship among them. However, manual analysis of this huge data is tedious and requires experts’ knowledge. This paper focuses on automatically identifying the relationship between different performance events. Therefore, we analyze the data coming from the performance events and identify the points where their behavior changes. Two events are considered related if their values are changing at ”approximately” the same time. We have used the Sigmoid function to compute a real-value similarity between two sets (representing two events). The resultant value of similarity is induced as a similarity or distance metric in a traditional clustering algorithm. The proposed solution is applied to different software applications that are widely used in industrial systems to show how different setups including the selection of cost functions can affect the results.

Series
IEEE International Conference on Emerging Technologies and Factory Automation, ETFA, ISSN 1946-0740
National Category
Computer Sciences
Identifiers
urn:nbn:se:mdh:diva-64276 (URN)10.1109/ETFA54631.2023.10275660 (DOI)2-s2.0-85175433182 (Scopus ID)9798350339918 (ISBN)
Conference
28th Annual Conference of the IEEE Industrial Electronics Society (ETFA2023)
Available from: 2023-09-18 Created: 2023-09-18 Last updated: 2024-11-28Bibliographically approved

Open Access in DiVA

fulltext(643 kB)145 downloads
File information
File name FULLTEXT02.pdfFile size 643 kBChecksum SHA-512
f75f4ca8ae7c5c0665cfd83f0b75600bf64b0d9bcc8b95c3695b5d32ffa96636495299f1117aa731aff2af342121437b665a6db5263d9724f1cbfa1e86e3ebd2
Type fulltextMimetype application/pdf

Authority records

Imtiaz, Shamoona

Search in DiVA

By author/editor
Imtiaz, Shamoona
By organisation
School of Innovation, Design and Engineering
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar
Total: 145 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 428 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf