https://www.mdu.se/

mdu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Improving the Efficiency and Reliability of Text Messaging Gateways
Mälardalen University, School of Innovation, Design and Engineering, Embedded Systems.ORCID iD: 0000-0003-4606-5144
2022 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

When software communicates, it typically uses some middleware. In this thesis we focus on the group of middleware called “messaging gateways”, which normally uses the store-and-forward architecture. Our overall goal is to find ways to improve the throughput and reliability of such gateways in general, in particular the ones used for forwarding mobile text messages. In short, our work resulted in a new anomaly detection algorithm, a reduction of the number of database operations in a commercial messaging gateway, and two new highly performant data replication protocols.

In addressing the throughput, we first wanted a better understanding of how the round-trip times for outgoing requests varied, in order to correctly detect abnormal delays. This resulted in a generalized extension of exponential smoothing, which we used in a novel algorithm to detect anomalies.

We then performed an architecture analysis of an industrial messaging gateway based on its quality requirements. From this exploratory case study, we deduced a somewhat unexpected plan to migrate the balance management module to a set of microservices, and identified situations where database operations could be batched in order to also provide higher throughput.

A common and easy way to improve the reliability of a system is to replicate the stored data to one or more additional servers. However, we found that this approach often leads to lower throughput due to extra network traffic required. We addressed this by first writing a problem formulation on how the quality attributes of a messaging gateway would be affected by a multi-node configuration, resulting in a review of state of the art and state of practice for multi-node systems. 

Building on this review, we developed a new data replication algorithm, which we validated in a controlled experiment. Its proof-of-concept implementation showed that even in a geo-distributed configuration, replication throughput can scale with the number of nodes. 

Text messaging gateways often have a module for credit management, used when billing the senders for their traffic. In a multi-node environment the maintenance of the corresponding credit balances requires synchronization between the nodes, for which we designed and implemented an algorithm which uses less network traffic than existing solutions in many real-world situations. 

Place, publisher, year, edition, pages
Västerås: Mälardalens universitet, 2022.
Series
Mälardalen University Press Dissertations, ISSN 1651-4238 ; 364
National Category
Computer and Information Sciences
Research subject
Computer Science
Identifiers
URN: urn:nbn:se:mdh:diva-60047ISBN: 978-91-7485-566-1 (print)OAI: oai:DiVA.org:mdh-60047DiVA, id: diva2:1699737
Public defence
2022-11-22, Gamma, Mälardalens universitet, Västerås, 13:15 (English)
Opponent
Supervisors
Available from: 2022-09-29 Created: 2022-09-28 Last updated: 2022-11-01Bibliographically approved
List of papers
1. GeoRep-Resilient Storage for Wide Area Networks
Open this publication in new window or tab >>GeoRep-Resilient Storage for Wide Area Networks
2022 (English)In: IEEE Access, E-ISSN 2169-3536, Vol. 10, p. 75772-75788Article in journal (Refereed) Published
Abstract [en]

Embedded systems typically have limited processing and storage capabilities, and may only intermittently be powered on. After sending data from its sensors upstream, the system must therefore be able to trust that the data, once acknowledged, is not lost. The purpose of this work is to propose a novel solution for replicating data between the upstream nodes in such systems, with a minimal effect on the software architecture. On the assumption that there is no relative order between replicated data tuples, we designed a new replication protocol based on partial replication. Our protocol uses only 2 communication steps per data tuple, instead of the 3 to 12 used by other solutions. We verified its failover mechanism in a proof-of-concept implementation of the protocol using simulated network failures, and evaluated the implementation on throughput and latency in several controlled experiments using up to 7 nodes in up to 5 geographically separated areas, with up to 1000 data producers per node. The recorded system throughput increased linearly relative to both the number of nodes and the number of data producers. For comparison, Paxos showed a performance similar to our protocol when using 3 nodes, but got slower as more nodes were added. The lack of a relative order, in combination with partial replication, enables our system to continue working during network partitions, not only in the part containing the majority of the nodes, but also in any sufficiently large minority partitions.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2022
Keywords
Servers, Protocols, Throughput, Internet of Things, Queueing analysis, Resilience, Companies, Store-and-forward, replication, distributed computing, availability
National Category
Embedded Systems
Identifiers
urn:nbn:se:mdh:diva-59629 (URN)10.1109/ACCESS.2022.3191686 (DOI)000831069700001 ()2-s2.0-85135218229 (Scopus ID)
Available from: 2022-08-08 Created: 2022-08-08 Last updated: 2022-09-29Bibliographically approved
2. Towards a more reliable store-and-forward protocol for mobile text messages
Open this publication in new window or tab >>Towards a more reliable store-and-forward protocol for mobile text messages
2018 (English)In: Proceedings of the Annual ACM Symposium on Principles of Distributed Computing, Association for Computing Machinery , 2018, p. 13-20Conference paper, Published paper (Refereed)
Abstract [en]

Businesses often use mobile text messages (SMS) as a cost effective and universal way of communicating concise information to their customers. Today, these messages are usually sent via SMS brokers, which forward them further to the next stakeholder, typically the various mobile operators, and then the messages eventually reach the intended recipients. Infoflex Connect AB delivers an SMS gateway application to the brokers with the main responsibility of reliable message delivery within set quality thresholds. However, the protocols used for SMS communication are not designed for reliability and thus messages may be lost. In this position paper we deduce requirements for a new protocol for routing messages through the SMS gateway application running at a set of broker nodes, in order to increase the reliability. The requirements cover important topics for the required communication protocol such as event ordering, message handling and system membership. The specification of such requirements sets the foundation for the forthcoming design and implementation of such a protocol and its evaluation.

Place, publisher, year, edition, pages
Association for Computing Machinery, 2018
Keywords
Replication, SMS, Store-and-forward, Cost effectiveness, Distributed computer systems, Samarium, Text messaging, Design and implementations, Message handling, Mobile operators, Position papers, Reliable message deliveries, Routing message, Store and forward, Gateways (computer networks)
National Category
Computer and Information Sciences
Identifiers
urn:nbn:se:mdh:diva-40746 (URN)10.1145/3231104.3231108 (DOI)2-s2.0-85052382122 (Scopus ID)9781450357753 (ISBN)
Conference
2018 Workshop on Advanced Tools, Programming Languages, and PLatforms for Implementing and Evaluating Algorithms for Distributed Systems, ApPLIED 2018, co-located with the 37th ACM Symposium on the Principles of Distributed Computing, PODC 2018, 27 July 2018
Available from: 2018-09-07 Created: 2018-09-07 Last updated: 2022-09-28Bibliographically approved
3. Resilient Conflict-free Replicated Data Types without Atomic Broadcast
Open this publication in new window or tab >>Resilient Conflict-free Replicated Data Types without Atomic Broadcast
2022 (English)In: PROCEEDINGS OF THE 17TH INTERNATIONAL CONFERENCE ON SOFTWARE TECHNOLOGIES (ICSOFT) / [ed] Hans-Georg Fill; Marten van Sinderen; Leszek Maciaszek, 2022, p. 516-523Conference paper, Published paper (Refereed)
Abstract [en]

In a distributed system, applications can perform both reads and updates without costly synchronous network round-trips by using Conflict-free Replicated Data Types (CRDTs). Most CRDTs are based on some variant of atomic broadcast, as that enables them to support causal dependencies between updates of multiple objects. However, the overhead of this atomic broadcast is unnecessary in systems handling only independent CRDT objects. We identified a set of use cases for tracking resource usage where there is a need for a replication mechanism with less complexity and network usage as compared to using atomic broadcast. In this paper, we present the design of such a replication protocol that efficiently leverages the commutativity of CRDTs. The proposed protocol CReDiT (CRDT enhanced with intelligence) uses up to four communication steps per update, but these steps can be batched as needed. It uses network resources only when updates need to be communicated. Furthermore, it is less sensit ive to server failures than current state-of-the-art solutions as other nodes can use new values already after the first communication step, instead of after two or more.

Keywords
Resilience, Data Replication
National Category
Computer and Information Sciences
Research subject
Computer Science
Identifiers
urn:nbn:se:mdh:diva-60046 (URN)10.5220/0011314500003266 (DOI)000852747000054 ()978-989-758-588-3 (ISBN)
Conference
17th International Conference on Software Technologies (ICSOFT), July 11-13, 2022, in Lisbon, Portugal
Available from: 2022-09-28 Created: 2022-09-28 Last updated: 2022-10-21Bibliographically approved
4. Round-Trip Time Anomaly Detection
Open this publication in new window or tab >>Round-Trip Time Anomaly Detection
Show others...
2018 (English)In: ICPE '18 Proceedings of the 2018 ACM/SPEC International Conference on Performance Engineering, 2018, p. 107-114Conference paper, Published paper (Refereed)
Abstract [en]

Mobile text messages (SMS) are sometimes used for authentication, which requires short and reliable delivery times. The observed round-trip times when sending an SMS message provide valuable information on the quality of the connection. In this industry paper, we propose a method for detecting round-trip time anomalies, where the exact distribution is unknown, the variance is several orders of magnitude, and there are lots of shorter spikes that should be ignored. In particular, we show that using an adaption of Double Seasonal Exponential Smoothing to reduce the content dependent variations, followed by the Remedian to find short-term and long-term medians, successfully identifies larger groups of outliers. As training data for our method we use log files from a live SMS gateway. In order to verify the effectiveness of our approach, we utilize simulated data. Our contributions are a description on how to isolate content dependent variations, and the sequence of steps to find significant anomalies in big data.

National Category
Computer Systems
Identifiers
urn:nbn:se:mdh:diva-41840 (URN)10.1145/3184407.3184436 (DOI)000744416300014 ()2-s2.0-85048196185 (Scopus ID)978-1-4503-5095-2 (ISBN)
Conference
2018 ACM/SPEC International Conference on Performance Engineering, Berlin, Germany — April 09 - 13, 2018
Available from: 2018-12-27 Created: 2018-12-27 Last updated: 2022-11-09Bibliographically approved
5. A Lightweight Architecture Analysis of a Monolithic Messaging Gateway
Open this publication in new window or tab >>A Lightweight Architecture Analysis of a Monolithic Messaging Gateway
2020 (English)In: Proceedings - 2020 IEEE International Conference on Software Architecture Companion, ICSA-C 2020, Salvador, Bahia, Brazil: IEEE, 2020, p. 25-32, article id 9095659Conference paper, Published paper (Refereed)
Abstract [en]

Background: The Enterprise Messaging Gateway(EMG) from Infoflex Connect (ICAB) is a monolithic system used to deliver mobile text messages (SMS) world-wide. The companies using it have diverse requirements on both functionality and quality attributes and would thus benefit from more versatile customizations, e.g. regarding authorization and data replication.

Objective: ICAB needed help in assessing the current architecture of EMG in order to find candidates for architectural changes as well as fulfilling the needs of variability in meeting the wide range of customer requirements.

Method: We analysed EMG using a lightweight version of ATAM (Architectural Trade-off Analysis Method) to get a better understanding of how different architectural decisions would affect the trade-offs between the quality requirements from the identified stakeholders.

Result: Using the results of this structured approach, it was easy for ICAB to identify the functionality that needed to be improved. It also became clear that the selected component should be converted into a set of microservices, each one optimized for a specific set of customers.

Limitation: The stakeholder requirements were gathered intermittently during a long period of continuous engagement, but there is a chance some of their requirements were still not communicated to us.

Conclusion: Even though this ATAM study was performed internally at ICAB without direct involvement from any external stakeholders, documenting elicited quality attribute requirements and relating them to the EMG architecture provided new, unexpected, and valuable understandings of the system with a rather small effort.

Place, publisher, year, edition, pages
Salvador, Bahia, Brazil: IEEE, 2020
Keywords
Architecture, Monolith, ATAM, Microservice
National Category
Computer and Information Sciences
Research subject
Computer Science
Identifiers
urn:nbn:se:mdh:diva-47566 (URN)10.1109/ICSA-C50368.2020.00013 (DOI)000587897600007 ()2-s2.0-85085748844 (Scopus ID)9781728146591 (ISBN)
Conference
2020 IEEE International Conference on Software Architecture Companion, ICSA-C 2020; Salvador; Brazil; 16 March
Available from: 2020-04-23 Created: 2020-04-23 Last updated: 2022-09-28Bibliographically approved

Open Access in DiVA

fulltext(5501 kB)335 downloads
File information
File name FULLTEXT02.pdfFile size 5501 kBChecksum SHA-512
ea7f3259d7114f2da2e4a528033e562234d383c8ca352219c90eb4f1e3fd1ef3c3441e3f25904420d0356aff18ffc411cacda57e8b326bafe65a294581b91e1c
Type fulltextMimetype application/pdf

Authority records

Brahneborg, Daniel

Search in DiVA

By author/editor
Brahneborg, Daniel
By organisation
Embedded Systems
Computer and Information Sciences

Search outside of DiVA

GoogleGoogle Scholar
Total: 335 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 2554 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf