https://www.mdu.se/

mdu.sePublications
Change search
Link to record
Permanent link

Direct link
Publications (10 of 24) Show all publications
Schwartz, C., Sander, I., Bruhn, F., Persson, M., Ekblad, J. & Fuglesang, C. (2023). Satellite Image Compression Guided by Regions of Interest. Sensors, 23(2), Article ID 730.
Open this publication in new window or tab >>Satellite Image Compression Guided by Regions of Interest
Show others...
2023 (English)In: Sensors, E-ISSN 1424-8220, Vol. 23, no 2, article id 730Article in journal (Refereed) Published
Abstract [en]

Small satellites empower different applications for an affordable price. By dealing with a limited capacity for using instruments with high power consumption or high data-rate requirements, small satellite missions usually focus on specific monitoring and observation tasks. Considering that multispectral and hyperspectral sensors generate a significant amount of data subjected to communication channel impairments, bandwidth constraint is an important challenge in data transmission. That issue is addressed mainly by source and channel coding techniques aiming at an effective transmission. This paper targets a significant further bandwidth reduction by proposing an on-the-fly analysis on the satellite to decide which information is effectively useful before coding and transmitting. The images are tiled and classified using a set of detection algorithms after defining the least relevant content for general remote sensing applications. The methodology makes use of the red-band, green-band, blue-band, and near-infrared-band measurements to perform the classification of the content by managing a cloud detection algorithm, a change detection algorithm, and a vessel detection algorithm. Experiments for a set of typical scenarios of summer and winter days in Stockholm, Sweden, were conducted, and the results show that non-important content can be identified and discarded without compromising the predefined useful information for water and dry-land regions. For the evaluated images, only 22.3% of the information would need to be transmitted to the ground station to ensure the acquisition of all the important content, which illustrates the merits of the proposed method. Furthermore, the embedded platform’s constraints regarding processing time were analyzed by running the detection algorithms on Unibap’s iX10-100 space cloud platform.

Place, publisher, year, edition, pages
MDPI, 2023
Keywords
change detection, cloud detection, image compression, satellite communication, vessel detection, Bandwidth, Communication satellites, Infrared devices, Remote sensing, Satellite communication systems, Signal detection, Detection algorithm, Images compression, Region-of-interest, Regions of interest, Satellite communications, Satellite images, Small-satellite
National Category
Computer and Information Sciences
Identifiers
urn:nbn:se:mdh:diva-61799 (URN)10.3390/s23020730 (DOI)000918751400001 ()2-s2.0-85146609639 (Scopus ID)
Available from: 2023-02-08 Created: 2023-02-08 Last updated: 2023-02-15Bibliographically approved
Nunes, M., Bruhn, F., Wright, R., Lucey, P., Ferrari-Wong, C., Flynn, L., . . . Sorensen, T. (2022). Hyperspectral Thermal Imaging CubeSat for SSA applications. In: : . Paper presented at 23rd Advanced Maui Optical and Space Surveillance Technologies Conference (AMOS), Maui, Hawaii, 27-30 September, 2022.
Open this publication in new window or tab >>Hyperspectral Thermal Imaging CubeSat for SSA applications
Show others...
2022 (English)Conference paper, Published paper (Refereed)
Abstract [en]

Hyperspectral thermal imagers provide characteristic information that conventional spectral imagers cannot offer. The proliferation of space assets and debris will require “eyes in the sky'' to track objects effectively. The current estimates as of 2022 state that more than 27,000 pieces of orbital debris are tracked by the Department of Defense’s global Space Surveillance Network (SSN). This number is expected to double in the next ten years with 57,000 satellites expected to be launched by 2029. Ground-based assets will not be able to track this vast number of orbital debris, and space-based monitoring capabilities will have to complement the tracking of assets and debris in the years to come. In this work, we present the Hyperspectral Thermal Imager (HyTI) CubeSat design, initially developed for Earth Observation, that can be adapted for Space Situational Awareness (SSA) applications with machine learning algorithms for fast object detection. With new advances in machine learning hardware and software, the categorization of orbital objects can help reveal features such as geometry, thermal signature, and size, among others. For example, spectral signatures can be leveraged to identify plumes of thrusters and unique characteristics of various materials used in different objects. HyTI is a 6U CubeSat funded by NASA’s Earth Science Technology Office (ESTO) In-Space Validation of Earth Science Technologies (InVEST) program. HyTI demonstrates how high spectral and spatial longwave infrared image data can be acquired from a 6U CubeSat platform. The long wave infrared detector uses a push-broom technique for producing accurate spectral and spatial data for moving targets. HyTI will demonstrate advanced on-orbit real-time data processing and the creation of scientific and operational data products. The payload uses aspatially modulated interferometric imaging technique to produce spectro-radiometrically calibrated image cubes, with 25 bands between 8-10.7 microns. The HyTI performance model indicates narrow band NEDTs of < 0.3 K. The small form factor of HyTI is made possible via the use of a no-moving-parts Fabry-Perot interferometer developedby the Hawaiʻi Institute of Geophysics and Planetology (HIGP) at the University of Hawaiʻi at Mānoa (UHM), and a Jet Propulsion Laboratory (JPL) cryogenically cooled High Operating Temperature (HOT) Barrier Infrared Detector (BIRD) focal plane array (FPA) technology. The level 0 (L0) data rate of the HyTI instrument is large. As a result, HyTI processes data from L0 to level 1 (L1, calibrated spectral radiance cubes) onboard. This is achieved using an advanced radiation-tolerant heterogeneous computer, the Unibap iX5-100 space computer, which offers CPU, GPU, and FPGA processing capability and has the option to add one or more neural network accelerators [12]. In this way, the L0 data volume is reduced by a factor of 13 before transmission to the ground as L1 data. Fully equipped, the iX5-100 can achieve several trillion computational operations per second (TOPS), which is essential for on-orbit detection of objects [13]. In this paper we provide an overview of the HyTI design and how it can be adapted for SSA observations and applications. We expand on the onboard data reduction and object detection approach, then provide an overview of the SpaceCloud Framework containerization of mission management and data applications.

Keywords
Hyperspectral Thermal Imaging, Longwave Infrared, CubeSat, Machine Learning, SSA
National Category
Aerospace Engineering
Identifiers
urn:nbn:se:mdh:diva-61282 (URN)
Conference
23rd Advanced Maui Optical and Space Surveillance Technologies Conference (AMOS), Maui, Hawaii, 27-30 September, 2022
Available from: 2022-12-15 Created: 2022-12-15 Last updated: 2022-12-15Bibliographically approved
Bruhn, F., Alice, A., Nunes, M., Amber, I.-H., Wood, M., Wright, R., . . . Flynn, L. (2022). HYTI mission: Raw thermal instrument on-orbit data processing with SpaceCloud. In: : . Paper presented at 4S Symposium, 16-20 May 2022, Vilamoura, Portugal.
Open this publication in new window or tab >>HYTI mission: Raw thermal instrument on-orbit data processing with SpaceCloud
Show others...
2022 (English)Conference paper, Published paper (Refereed)
Abstract [en]

The HyTI (Hyperspectral Thermal Imager) mission, funded by NASA’s Earth Science TechnologyOffice InVEST (In-Space Validation of Earth Science Technologies) program, is the first US science satellite to leverage heterogenous SpaceCloud hardware with CPU and GPU acceleration. The mission will demonstrate how high spectral and spatial long-wave infrared image data can be acquired from a 6U CubeSat platform and perform advanced on-orbit real-time data processing and creating L1 and L2 products. The mission will use a spatially modulated interferometric imaging technique to produce spectro-radiometrically calibrated image cubes, with 25 channels between 8-10.7 μm, at 13cm-1resolution) at a ground sample distance of ~60 m. The small form factor of HyTI is made possible via a no-moving-parts Fabry-Perot interferometer and JPL’s cryogenically cooled HOTBIRD FPA technology. The value of HyTI to Earth scientists will be demonstrated via on-board processing of the raw instrument data to generate L1 and L2 products, with a focus on rapid deliveryof data regarding volcanic degassing, land surface temperature, and precision agriculture metrics.This presentation will provide an overview of the HyTI measurement approach, the onboard data reduction approach, and the spacecraft design. We will also update HyTI integration, testing, andfuture mission concepts based on the SpaceCloud Framework containerization of mission management and data applications.

National Category
Aerospace Engineering
Identifiers
urn:nbn:se:mdh:diva-61290 (URN)
Conference
4S Symposium, 16-20 May 2022, Vilamoura, Portugal
Available from: 2022-12-15 Created: 2022-12-15 Last updated: 2022-12-15Bibliographically approved
Schwartz, C., Sander, I., Jordão, R., Bruhn, F., Persson, M., Ekblad, J. & Fuglesang, C. (2022). On-board Satellite Data Processing to Achieve Smart Information Collection. In: Proceedings of SPIE - The International Society for Optical Engineering: . Paper presented at Optics, Photonics and Digital Technologies for Imaging Applications VII 2022. SPIE, 12138
Open this publication in new window or tab >>On-board Satellite Data Processing to Achieve Smart Information Collection
Show others...
2022 (English)In: Proceedings of SPIE - The International Society for Optical Engineering, SPIE , 2022, Vol. 12138Conference paper, Published paper (Refereed)
Abstract [en]

Nowadays, it is a reality to launch, operate, and utilize small satellites at an affordable cost. However, bandwidth constraint is still an important challenge. For instance, multispectral and hyperspectral sensors generate a significant amount of data subjected to communication channel impairments, which is addressed mainly by source and channel coding aiming at an effective transmission. This paper targets a significant further bandwidth reduction by proposing an on-the-fly analysis technique on the satellite to decide which information is effectively useful for specific target applications, before coding and transmitting. The challenge would be detecting clouds and vessels having the measurements of red-band, green-band, blue-band, and near infrared band, aiming at sufficient probability of detection, avoiding false alarms. Furthermore, the embedded platform constraints must be satisfied. Experiments for typical scenarios of summer and winter days in Stockholm, Sweden, are conducted using data from the Mimir’s Well, the Saab AI-based data fusion system. Results show that non-relevant content can be identified and discarded, pointing out that for the cloudy scenarios evaluated, up to 73.1% percent of image content can be suppressed without compromising the useful information into the image. For the water regions in the scenarios containing vessels, results indicate that a stringent amount of data can be discarded (up to 98.5%) when transmitting only the regions of interest (ROI).

Place, publisher, year, edition, pages
SPIE, 2022
Keywords
Cloud detection, Image compression, Satellite communication, Vessel detection
National Category
Physical Sciences
Identifiers
urn:nbn:se:mdh:diva-59541 (URN)10.1117/12.2620955 (DOI)000943943400017 ()2-s2.0-85132990951 (Scopus ID)9781510651524 (ISBN)
Conference
Optics, Photonics and Digital Technologies for Imaging Applications VII 2022
Available from: 2022-07-06 Created: 2022-07-06 Last updated: 2023-04-12Bibliographically approved
Tsog, N., Mubeen, S., Sjödin, M. & Bruhn, F. (2021). A Trade-Off between Computing Power and Energy Consumption of On-Board Data Processing in GPU Accelerated In-Orbit Space Systems. Transactions of the Japan Society for Aeronautical and Space Sciences, Aerospace Technology Japan, 19(5), 700-708, Article ID 19.700.
Open this publication in new window or tab >>A Trade-Off between Computing Power and Energy Consumption of On-Board Data Processing in GPU Accelerated In-Orbit Space Systems
2021 (English)In: Transactions of the Japan Society for Aeronautical and Space Sciences, Aerospace Technology Japan, E-ISSN 1884-0485, Vol. 19, no 5, p. 700-708, article id 19.700Article in journal (Refereed) Published
Abstract [en]

On-board data processing is one of the prior on-orbit activities that improves the performance capability of in-orbit space systems such as deep-space exploration, earth and atmospheric observation satellites, and CubeSat constellations. However, on-board data processing encounters higher energy consumption compared to traditional on-board space systems. This is because the traditional space systems employ simple processing units such as single-core microprocessors as the systems do not require heavy data processing. Moreover, solving the radiation hardness problem is crucial in space, and adopting a new processing unit is challenging.

In this paper, we consider a Graphics Processing Unit (GPU) accelerated in-orbit space system for on-board data processing. According to prior works, there exist radiation-tolerant GPU, and the computing capability of systems is improved by using heterogeneous computing method. We conduct experimental observations of energy consumption and computing potential using this heterogeneous computing method in our GPU accelerated in-orbit space systems.The results show that the proper use of GPU increases computing potential with 10-140 times and consumes between 8-130 times less energy. Furthermore, the entire task system consumes 10-65% of less energy compared to the traditional use of processing units.

Keywords
On-board Data Processing, Heterogeneous Computing, Energy Efficiency, GPU Accelerated On-board Computer
National Category
Computer Systems
Research subject
Computer Science
Identifiers
urn:nbn:se:mdh:diva-56078 (URN)10.2322/tastj.19.700 (DOI)
Available from: 2021-10-01 Created: 2021-10-01 Last updated: 2021-10-22Bibliographically approved
Tsog, N., Mubeen, S., Bruhn, F., Behnam, M. & Sjödin, M. (2021). Offloading Accelerator-intensive Workloads in CPU-GPU Heterogeneous Processors. In: 26th IEEE International Conference on Emerging Technologies and Factory Automation, ETFA 2021: . Paper presented at 26th IEEE International Conference on Emerging Technologies and Factory Automation, ETFA 2021; Virtual, Vasteras 7 September 2021 through 10 September 2021.
Open this publication in new window or tab >>Offloading Accelerator-intensive Workloads in CPU-GPU Heterogeneous Processors
Show others...
2021 (English)In: 26th IEEE International Conference on Emerging Technologies and Factory Automation, ETFA 2021, 2021Conference paper, Published paper (Refereed)
Abstract [en]

Autonomous vehicular systems require computer vision and intelligent on-board decision making functionalities that include a mix of sequential and parallel workloads. The execution times of the workloads and power consumption in these functionalities can be lowered by utilizing the accelerators (e.g., GPU) instead of running the workloads entirely on the host processing units (CPU). However, allocating all the parallelizable workload to accelerators can create a computation bottleneck in the accelerators that, in turn, can have an adverse effect on schedulability of the systems. This paper presents a novel framework that can allocate the accelerate-intensive workloads to the accelerators as well as to the non-accelerated host processing units. Within the context of this framework, the paper introduces five offloading techniques to mitigate the accelerator-intensive workloads by utilizing excess capacity of non-accelerated processing units under dynamic scheduling in CPU-GPU heterogeneous processors. The proposed techniques are evaluated using simulation experiments. The evaluation results indicate that one of the proposed techniques can achieve up to 16% improvement in schedulability of the task sets compared to the traditional non-offloading technique.

National Category
Computer Systems
Research subject
Computer Science
Identifiers
urn:nbn:se:mdh:diva-56081 (URN)10.1109/ETFA45728.2021.9613666 (DOI)000766992600230 ()2-s2.0-85122955086 (Scopus ID)9781728129891 (ISBN)
Conference
26th IEEE International Conference on Emerging Technologies and Factory Automation, ETFA 2021; Virtual, Vasteras 7 September 2021 through 10 September 2021
Available from: 2021-10-01 Created: 2021-10-01 Last updated: 2022-11-08Bibliographically approved
Tsog, N., Mubeen, S., Behnam, M., Sjödin, M. & Bruhn, F. (2021). Simulation and Analysis of In-Orbit Applications under Radiation Effects on COTS Platforms. In: 42nd IEEE Aerospace Conference 2021 IEEEAC2021: . Paper presented at 42nd IEEE Aerospace Conference 2021 IEEEAC2021, 06 Mar 2021, Big Sky, Montana, United States.
Open this publication in new window or tab >>Simulation and Analysis of In-Orbit Applications under Radiation Effects on COTS Platforms
Show others...
2021 (English)In: 42nd IEEE Aerospace Conference 2021 IEEEAC2021, 2021Conference paper, Published paper (Refereed)
Abstract [en]

Radiation effects research is crucial as it defines risk to both human bodies and spacecraft. Employing radiation-hardened products is one way to mitigate radiation effects on in-orbit systems. However, radiation effects prohibit most of the state-of-the-art commercial off-the-shelf (COTS) technologies from use in space. Furthermore, radiation effects on software components are less studied compared to hardware components. In this work, we introduce a simulation tool that analyzes the impact of radiation effects on schedulability of task sets executing on COTS system-on-chip (SoC) platforms in the in-orbit systems. In order to provide a meaningful verification environment, single-event effects (SEEs) are introduced as aleatory disturbances characterized by probability distribution of occurrence using their predefined models. The tool supports interoperability with several other tools as it uses the extensible markup language (XML) model files for input and output, i.e., for importing input task sets and radiation effects and exporting the simulation results.

Series
IEEE Aerospace Conference Proceedings, ISSN 1095-323X
Keywords
Radiation toleranceCPU-GPUSimulation toolSchedulabilityCOTS components
National Category
Engineering and Technology Computer Systems
Identifiers
urn:nbn:se:mdh:diva-53949 (URN)10.1109/AERO50100.2021.9438255 (DOI)000681710101024 ()2-s2.0-85111365681 (Scopus ID)
Conference
42nd IEEE Aerospace Conference 2021 IEEEAC2021, 06 Mar 2021, Big Sky, Montana, United States
Projects
DPAC - Dependable Platforms for Autonomous systems and Control
Available from: 2021-05-24 Created: 2021-05-24 Last updated: 2021-11-05Bibliographically approved
Bruhn, F., Tsog, N., Kunkel, F., Flordal, O. & Troxel, I. (2020). Enabling radiation tolerant heterogeneous GPU-based onboard data processing in space. CEAS Space Journal, 12(4), 551-564
Open this publication in new window or tab >>Enabling radiation tolerant heterogeneous GPU-based onboard data processing in space
Show others...
2020 (English)In: CEAS Space Journal, ISSN 1868-2502, E-ISSN 1868-2510, Vol. 12, no 4, p. 551-564Article in journal (Refereed) Published
Abstract [en]

The last decade has seen a dramatic increase in small satellite missions for commercial, public, and government intelligence applications. Given the rapid commercialization of constellation-driven services in Earth Observation, situational domain awareness, communications including machine-to-machine interface, exploration etc., small satellites represent an enabling technology for a large growth market generating truly Big Data. Examples of modern sensors that can generate very large amounts of data are optical sensing, hyperspectral, Synthetic Aperture Radar (SAR), and Infrared imaging. Traditional handling and downloading of Big Data from space requires a large onboard mass storage and high bandwidth downlink with a trend towards optical links. Many missions and applications can benefit significantly from onboard cloud computing similarly to Earth-based cloud services. Hence, enabling space systems to provide near real-time data and enable low latency distribution of critical and time sensitive information to users. In addition, the downlink capability can be more effectively utilized by applying more onboard processing to reduce the data and create high value information products. This paper discusses current implementations and roadmap for leveraging high performance computing tools and methods on small satellites with radiation tolerant hardware. This includes runtime analysis with benchmarks of convolutional neural networks and matrix multiplications using industry standard tools (e.g., TensorFlow and PlaidML). In addition, a 1/2 CubeSat volume unit (0.5U) (10 x 10 x 5 cm(3)) cloud computing solution, called SpaceCloud (TM) iX5100 based on AMD 28 nm APU technology is presented as an example of heterogeneous computer solution. An evaluation of the AMD 14 nm Ryzen APU is presented as a candidate for future advanced onboard processing for space vehicles.

Place, publisher, year, edition, pages
SPRINGER WIEN, 2020
Keywords
OBDP, Machine learning, GPU, Small satellites, Heterogeneous computing
National Category
Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
urn:nbn:se:mdh:diva-50616 (URN)10.1007/s12567-020-00321-9 (DOI)000541029200001 ()2-s2.0-85086737276 (Scopus ID)
Available from: 2020-09-21 Created: 2020-09-21 Last updated: 2021-10-01Bibliographically approved
Tsog, N., Sjödin, M. & Bruhn, F. (2019). A Trade-Off between Computing Power and Energy Consumption of On-Board Data Processing in GPU Accelerated Real-Time Systems. In: : . Paper presented at The 32nd International Symposium on Space Technology and Science, Fukui, Japan.
Open this publication in new window or tab >>A Trade-Off between Computing Power and Energy Consumption of On-Board Data Processing in GPU Accelerated Real-Time Systems
2019 (English)Conference paper, Published paper (Refereed)
Abstract [en]

On-board data processing is one of the prior on-orbit activities that it improves the performance capability of in-orbit space systems such as deep-space exploration, earth and atmospheric observation satellites, and CubeSat constellations. However, on-board data processing encounters with higher energy consumption compared to traditional space systems. Because traditional space systems employ simple processing units such as micro-controllers or a single-core processor as the systems require no heavy data processing on orbit. Moreover, solving the radiation hardness problem is crucial in space and adopting a new processing unit is challenging.

In this paper, we consider a GPU accelerated real-time system for on-board data processing. According to prior works, there exist radiation-tolerant GPU, and the computing capability of systems is improved by using heterogeneous computing method. We conduct experimental observations of power consumption and computing potential using this heterogeneous computing method in our GPU accelerated real-time system.The results show that the proper use of GPU increases computing potential with 10-140 times and consumes between 8-130 times less energy. Furthermore, the entire task system consumes 10-65% of less energy compared to the traditional use of processing units.

Keywords
Trade-off, Computing power, Energy consumption, on-board data processing, GPU acceleration, Real-time systems
National Category
Engineering and Technology Computer Systems
Identifiers
urn:nbn:se:mdh:diva-45938 (URN)
Conference
The 32nd International Symposium on Space Technology and Science, Fukui, Japan
Projects
DPAC - Dependable Platforms for Autonomous systems and Control
Available from: 2019-11-11 Created: 2019-11-11 Last updated: 2019-11-22Bibliographically approved
Tsog, N., Becker, M., Bruhn, F., Behnam, M. & Nolin, M. (2019). Static Allocation of Parallel Tasks to Improve Schedulability in CPU-GPU Heterogeneous Real-Time Systems. In: : . Paper presented at IEEE 45th Annual Conference of the Industrial Electronics Society, IECON2019.
Open this publication in new window or tab >>Static Allocation of Parallel Tasks to Improve Schedulability in CPU-GPU Heterogeneous Real-Time Systems
Show others...
2019 (English)Conference paper, Published paper (Refereed)
Abstract [en]

Autonomous driving is one of the main challenges of modern cars. Computer visions and intelligent on-board decision making are crucial in autonomous driving and require heterogeneous processors with high computing capability under low power consumption constraints. The progress of parallel computing using heterogeneous processing units is further supported by software frameworks like OpenCL, OpenMP, CUDA, and C++AMP. These frameworks allow the allocation of parallel computation on different compute resources. This, however, creates a difficulty in allocating the right computation segments to the right processing units in such a way that the complete system meets all its timing requirements. In this paper, we consider pre-runtime static allocations of parallel tasks to perform their execution either sequentially on CPU or in parallel using a GPU. This allows for improving any unbalanced use of GPU accelerators in a heterogeneous environment. By performing several heuristic algorithms, we show that the overuse of accelerators results in a bottle-neck of the entire system execution. The experimental results show that our allocation schemes that target a balanced use of GPU improve the system schedulability up to 90%.

Keywords
Parallel task, Parallel segment, Alternative execution, CPU-GPU, Heterogeneous processors, Real-time systems
National Category
Computer Systems
Identifiers
urn:nbn:se:mdh:diva-45934 (URN)10.1109/IECON.2019.8926767 (DOI)000522050604083 ()2-s2.0-85084110257 (Scopus ID)9781728148786 (ISBN)
Conference
IEEE 45th Annual Conference of the Industrial Electronics Society, IECON2019
Projects
DPAC - Dependable Platforms for Autonomous systems and Control
Available from: 2019-11-11 Created: 2019-11-11 Last updated: 2021-10-01Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0002-8785-5380

Search in DiVA

Show all publications