Table of Contents

Payload: Camera

Description

The camera payload can be used to capture and save or export images from the simulation environment. Building on Unreal’s camera architecture as a base, Nominal has created the following camera payloads:

  • Optical Camera: An RGB optical camera by default that can also become Monochromatic.
  • Infrared (IR) Camera: A thermal camera designed to visualize the temperatures of any simulation physical components within its Field of View.
  • Event Camera: Inspired by Neuromorphic camera systems, this camera can generate Event Data by comparing sequential frames.

Example Use Cases

  • Optical and Thermal Imaging: Examples of objects that the camera can image include the spacecraft's orbital body, planets, or other orbital objects such as spacecraft and debris.
  • Event Detection: The Event Camera can be used to detect events within its Field of View that can then trigger other systems. For example, the Event Camera can instruct an Optical Camera to capture an image.

Module Implementation

The Camera Payload accepts a Device Status Message that allows the Instrument Manager Software to enable or disable the camera during the simulation. The camera payload also features several configuration variables such as Field of View, Sample Rate, File Name, and Exported File Type. the rest of the implemented module is built around Unreal Engines Camera capabilities.

The Camera Payload has a single output message, Camera Image Message, that contains the resolution, file name, and type as well as the raw file data. The message can be used to transmit camera payload data over the TT&C system.

Assumptions/Limitations

  • The Camera system can only capture an image of simulation objects that have an assigned mesh.
  • The IR Camera variant requires the thermal properties of other objects to be configured to generate the required heatmap.
  • The Event Camera can’t generate data on the first frame as it relies on comparing frames to detect a change.