Data Viewer User Guide

User Guide for the Data Viewer application.

Overview

The Data Viewer provides the following features:

Any bug reports, feature requests, or general questions can be sent to bradley.c.tse@nasa.gov or through NASA's Microsoft Teams.

Architecture

Install and Run

The Data Viewer can be run on Windows, Mac OS and Linux.

Mac OS

Mac OS versions are distributed as an Apple Disk Image (dmg). The dmg contains a single .app which can be placed anywhere on your machine and then run. The recommended location is in your Applications directory. The .app contains all required dependencies.

Linux

The Linux version is distributed as an AppImage which are similar to the Mac OS .apps. All dependencies are contained within the AppImage which makes it easy to distribute and run. The user or sys admin does not need to manage dependencies. The AppImage can also be run from any directory by double clicking it or running it from the terminal:

cd <dir containing appimage>
./<appimage_name>

If you are not able to run it, you may need to make it executable:

cd <dir containing appimage>
chmod +x <appimage_name>

Windows

The Windows version is distributed as a zip file that contains the executable and all dependencies. The zip file can be extracted to any location. After extraction, the .exe can be run by double clicking on it.

Supplementary Directory

We use a separate repository for each mission to store released versions of the Data Viewer, config files, and other miscellaneous applications and files. The repository is used for more than just the Data Viewer. For example, on OCI we have an ocigse Git repository that's maintained on the gs490v-gitlab GitLab. We use the version control to provide updates to the workstations and end users.

The instructions to setup the gse repository is mission specific, but can generally be boiled down to:

  1. Acquire permissions to access the repository. Usually a NAMS request.
  2. Checkout the repository
  3. Perform initial one-time setup

If a machine does not have direct access to the repository, the supplementary directory may instead be distributed as a zip file.

The instructions to setup the ocigse directory are maintained in the README.md of the repository: https://gs490v-gitlab.ndc.nasa.gov/497_OCI/OCI_XINA

Initial Startup

When first opening the application, you will be prompted with a File Dialog and a What's New Dialog. You may close both of these.

The main window (see below) displays information about the loaded archive. Depending on the operating system, the main menu may appear either at the top of the window or in the system menu bar at the top of the screen. If the menu bar is not visible, click the main window to bring it into focus.

Closing this window will exit the application.

Load Data

Real-time

To view data in real time:

  1. Select Setup → FEDS Client from the menu.

  2. Enter the Instrument ID and FEDS Network Address (IP address or hostname).

  3. Click Start.

  4. Verify the connection:

    • A confirmation message indicating a successful connection.
    • The KBytes/sec field displays a non-zero value when data is being received.
    • The Pkt Count field in the main window is incrementing

Load from Archive

Load archived data using one of the following File Menu options:

File → TID Explorer

Opens a window with a tree view of the root data directory configured in ~/.699config.INI. Clicking on a file will immediately load it. Some of the features were designed for missions that follow the TID directory naming conventions. To open the TID Explorer at startup, click the gear icon and check "Use as default".

File → Open Archive

Opens a file selection dialog to select one or more archive files to load. The archives will be loaded in the order they are selected.

File → Open TID

Opens a dialog to select a TID directory to load. This is intended for missions that follow the TID directory naming conventions.

File → Open Next TID

Loads the next TID directory. This is intended for missions that follow the TID directory naming conventions.

File → Open Previous TID

Loads the previous TID directory. This is intended for missions that follow the TID directory naming conventions.

Export Data

  1. File → Export HK Data
  2. Update filename
  3. Select directory to export to
  4. Select the column delimiter
  5. The "Combine Time Columns" option will output only 1 time column. By default, there is a time column per mnemonic.
  6. Select the Time Source:
    • Packet Time uses the time in the mission packet header.
    • Ground Receipt Time uses the time the ground system receives the packet. This option only works if the ground system supports it.
  7. Select the Time Mode to control the format of the time column:
    • Relative Time is the time in seconds from the first packet's time in the loaded archive
    • Date/Time is the time in YYYY-MM-DD HH:MM:SS format
    • Timestamp is the Unix timestamp in seconds
  8. Specify the Start and End Time in YYYY-MM-DD HH:MM:SS format. The default Start and End Time will encapsulate all data in the archive.
  9. Click "Add Field" to select the mnemonics to export
  10. Click "Export"

Clear Cached Data

A configurable amount of packets are cached in memory. To clear out all cached data: Data Viewers --> Clear all data

Change the refresh rate

Data Viewers --> Set Viewer Refresh Rate

Chart Tips

TODO

Quick Graph

You can quickly graph telemetry data over time.

Data Viewers --> Quick Graph

Open a new viewer

This method is used for opening up standard mission independent viewers:

Data Viewers --> Viewer Finder

Missions specific viewers can be opened up directly from the Data Viewers menu.

The viewers listed in the last section of the Data Viewers menu are the currently open viewers. Selecting from this list will bring it to the front.

Create Tabular or Graph Viewer

Data Viewers --> Make HK Viewer

OCI Viewers

Instructions on how to use the various OCI viewers

OCI Viewers

DDC Raw

The DDC Raw Viewer is used to display the DDC Raw captures. The DDC Raw captures are used for examining the raw samples out of the ADC. This mode is used for various tests:

OCI Step-by-step Instructions

Step-by-step instructions to use the Data Viewer for various OCI tests

OCI Step-by-step Instructions

ADC Sweep

This page contains instructions on how to view the ADC Sweep data with the DDC Raw Viewer.

The ADC sweep is performed by capturing multiple DDC raw captures while stepping the ADC sample point, which is a combination of the ADC mux delay (fine steps) and ADC Clock offset (coarse steps). One or more DDC Raw Captures may be collected at each step, depending on how the ITOS proc is configured. The collection of all steps is an "ADC Sweep".

Setup

  1. Open the DDC Raw Viewer (bring to front an existing one or open a new one)
  2. Set the CCD ID
  3. Start ADC Sweep ITOS procedure
  4. The viewer will update when a complete DDC raw capture is received. A single raw capture may look something like:

The colored regions indicate the different parts of a "line". Each raw capture contains ~11 lines of data (dependent on various OCI settings). The "INFO" annotation indicates the start of a raw capture.

Sweep Finished

When the ADC Sweep is finished, you may see something like below. (The actual shape may vary depending on the environment and other variables)

Scroll down to view the charts titled ADC Tap and CDS SD Tap. These are the main charts we will be using to analyze the ADC Sweep data.

The ADC Tap chart displays the ADC Counts vs. ADC Sample Point, where ADC Sample Point (x-axis) is defined as:

ADC Sample Point = (ADC Clock Offset * 48) + Mux Delay

The ADC Clock Offset is also known as the coarse setting, Mux Delay as the fine setting.

The CDS SD Tap chart displays the standard deviation of the calculated CDS for the image pixels (green region) of the 11 lines per capture.

If no data is visible, you may need to rescale the chart. You can do this 1 of 3 ways: double click on the chart, right click and select "Reset zoom", or click on the number at the top right corner of the chart.

Below are a few other notes:

At the end of the ADC Sweep, you may see something like this:

The ADC Tap charts are used to determine the ADC sample point settings we want to use. How this decision is made is outside the scope of these instructions.

You may see a jump/discontinuity in the chart when going to the next coarse setting. This occurs because the actual timing delay is not continuous, but we treat and display the ADC sample point as continuous. In the below chart, you can see discontinuities at x=48 and x=96, which is where the coarse setting is incremented. This should be kept in mind when determining what sample point to use.

Exporting

OCI Step-by-step Instructions

Touch Sensitivity Test

This page contains instructions on how to use the Data Viewer during the touch sensitivity tests.

Setup
  1. Open 2 instances of the Stats Per Pixel vs. Time viewer. (or bring to front if already open)
  2. Set the Stats Mode on one to SD and the other to AVG. Note: The window title displays the Stat Mode which can be used to differntiate the 2 instances.
  3. For both configure the following settings:
Optional:
Real-time operations:
No data?

The charts may need to be properly scaled. Double click to zoom out, or right click and select "Reset Zoom".

Exporting

You can export the charts as a single image by clicking on the Snap button.

Examples

OCI Step-by-step Instructions

ADC Output Phase Tuning

OCI Step-by-step Instructions

RG Sweeps

These instructions are for the Rg Mag and Rg Low sweeps.

OCI Step-by-step Instructions

EMI Testing

These instructions detail how to use the data viewer during EMI testing.

  1. Update to get the newest EMI window config
    1. Open a terminal
    2. cd ocigse
    3. git pull
    4. Close terminal
  2. On the bottom menu bar, click on ocidataview and select the OCI Data Viewer window.

  1. At the top of this window is a menu bar. Select Setup -> Restore Windows

  2. Select emi and click OK. This will load the 'emi' window configuration and may take up to a minute to reload the cached data.

  3. You can switch between the open viewers by clicking on the ocidataview in the menu bar and then selecting a viewer from the list.

  4. The 4 main viewers you will be using are:

    • SSM Ch Stats vs. Time - AVG - Displays AVG counts for the whole scan per SSM channel.
    • SSM Ch Stats vs. Time - SD - Displays SD for the whole scan per SSM channel.
    • Stats Per Pixel vs. Time - AVG - Displays AVG counts for the whole scan per FPA pixel.
    • Stats Per Pixel vs. Time - SD - Displays SD for the whole scan per FPA pixel.

Susceptibilities are more apparent in the SD variants; below is an example of what this may look like:

``

OCI Step-by-step Instructions

DDC Raw Capture

Instructions to generate DDC Raw Capture images:

  1. File -> Open Archives -> Select archives to open. You may select more than one.
  2. Open DDC Raw viewer if not already open: Data Viewers -> DDC Raw
  3. Maximize the window
  4. Set settings on the right side:
    • CCD ID: Red or BLUE
    • Chart Height: 500
    • Sync Axes: Both
    • Show Regions: checked
    • Line Window: 1
    • Right click the "All Taps Video" chart's y-axis, set range [14500, 16500]
    • Right click the "All Taps CDS" chart's y-axis, set range [-50, 500]
    • If desired, right click on each chart and select "All series data points visible"
    • All other settings can be left at the defaults
  5. Capture screenshot of whole window, except stop before the "All Taps Raw Samples" chart. Include the settings area on the right side.
  6. Repeat as needed for RED/BLUE

Below is an example screenshot:

OCI Step-by-step Instructions

DDC Scope Capture

The DDC Scope Mode Viewer is used to view and export the collected DDC Scope Capture data.

  1. File -> Open Archives -> Select archives to open. You may select more than one.
  2. Open DDC Scope Mode viewer if not already open: Data Viewers -> DDC Scope Mode
  3. Maximize the window
  4. Any scope captures will be parsed and loaded into the "Capture List"
  5. Under "Export Settings":
    1. If "Auto Export Raw CSV" is checked, the raw data will be auto exported to a CSV into ~/ocidata/scope_captures/
    2. If "Auto Export Retimed CSV" is checked, the retimed data will be auto exported to a CSV into ~/ocidata/scope_captures/
    3. If "Auto Export Charts" is checked, chart images will be automatically generated to ~/ocidata/scope_captures. The y-axis for these images are scaled for dark data. For light images, you will need to manually adjust the images and then click "Export Charts".
  6. The auto exported images are usually good enough for our functional tests. However, for special tests, such as performing scope captures with light, you will need to manually adjust the y-axis and export the charts by clicking "Export Charts".

Data Viewer Usage in PACE I&T

Overview

Usage of the Data Viewer in PACE I&T has changed since we no longer receive OCI science data in real-time. OCI Science File Archives are stored on-board PACE and downlinked at a later time. OCI HK and GSE data are still received in real-time.

A few updates to the Data Viewer and Science VMs have been made to accomadate for these changes.

We will be running 2 instances of the Data Viewer:

In the bottom right of the VM, you will see 3 workspaces:

The Live workspace contains the Data Viewer that will receive OCI HK and GSE data in real-time from the FEDS. This instance of the Data Viewer works the same as in the OCI I&T environment.

The Playback workspace contains the Data Viewer that will be used to open and view OCI Science File Archives.

The GSE workspace contains an application that archives GSE data locally so it can be merged into the OCI Science File Archives so that OCI Science Data and GSE data can be viewed at the same time. You do not need to worry about this workspace.

Viewing OCI Science Data

To view OCI Science Data, first switch to the Playback workspace.

Open the Local Playback window:

You should see a window popup that looks like this:

Archive Index:

The Archive Index section on the right side displays the OCI Science File Archives that have been downlinked to the ground. You can click the Refresh button to refresh the list of archives. The list is also automatically refreshed the first time the Local Playback window is opened. This implies that the list is not automatically kept in sync with what archives have been downlinked.

You may click Load Selected Archive to immediately open the currently selected archive. Note: Using this method will not contain any GSE data.

Playback:

The Playback section on the left side is used for playing back time ranges of data. When you use this functionality, it will attempt to merge GSE and OCI data so that both are viewable at the same time.

Selecting an archive in the Archive Index list will automatically update the Start time input. A Duration can be selected to choose how much data will be viewed. The max duration is 10 minutes due to resource limitations.

NOTE: The Set to most recent is NOT aware of what data exists in the archives. It offsets from the system's current time, not the data.

Fast as possible should generally be left checked.

Once configured, click Start to initiate the playback. When the playback has finished, the Data Viewer will automatically load the archive.

Example Viewers

Raw Packet Viewer

Mnemonic Database

When opening the application, the newest version of the mnemonic database is automatically loaded. You can manually load a different database with File --> Load database.