Reaching the Edge of the Edge: Image Analysis in Space

Robert Bayer, Julian Priest, Pinar Tözün

Research output: Conference Article in Proceeding or Book/Report chapterArticle in proceedingsResearchpeer-review

Abstract

Satellites have become more widely available due to the reduction in size and cost of their components. As a result, there has been an advent of smaller organizations having the ability to deploy satellites with a variety of data-intensive applications to run on them. One popular application is image analysis to detect, for example, land, ice, clouds, etc. for Earth observation. However, the resource-constrained nature of the devices deployed in satellites creates additional challenges for this resource-intensive application.
In this paper, we present our work and lessons-learned on building an Image Processing Unit (IPU) for this satellite. We first highlight the resource constraints based on a deployed satellite performing machine learning on satellite imagery in orbit, including the required latency, power budget, and the network bandwidth limitations driving the need for such a solution. We then investigate the performance of a variety of edge devices (comparing CPU, GPU, TPU, and VPU) for deep-learning-based image processing on satellites. Our goal is to identify devices that are flexible when the workload changes while satisfying the power and latency constraints of satellites. Our results demonstrate that hardware accelerators such as ASICs and GPUs are essential for meeting the latency requirements. However, state-of-the-art edge devices with GPUs may draw too much power for deployment on a satellite.
Original languageEnglish
Title of host publicationProceedings of the Eighth Workshop on Data Management for End-to-End Machine Learning, DEEM 2024, Santiago, AA, Chile, 9 June 2024
Number of pages10
PublisherInteractions IX: Association of Computing Machinery ACM
Publication date2024
Pages29-38
DOIs
Publication statusPublished - 2024

Keywords

  • Edge Computing
  • Machine learning
  • earth observation
  • image data analysis
  • satellites
  • internet of things

Fingerprint

Dive into the research topics of 'Reaching the Edge of the Edge: Image Analysis in Space'. Together they form a unique fingerprint.

Cite this