DraMS DevOps

DraMS developer operations handbook

• Deploy updates to XINA
• Setup DraMS Model on mine699

Deploy updates to XINA

In order for the DraMS XINA instance to function as expected, developers need to deploy various updates to XINA to keep it in sync.

DraMS XINA has the following Git repo dependencies:

• dramsgse
  • apps/linux/struct_extract - Extracts and converts the telemetry data from the raw packet archives
  • tmdef/ - Contains the telemetry definitions that are used by struct_extract to decode and convert the telemetry data. The telemetry definition files are also converted to XINA's Mnemonic Definition format and then imported into XINA.
• 699util
  • Contains mining scripts that extract additional data from the raw packet archives such as markers and message logs.

These repositories are not directly cloned on XINA. Instead, snapshots of the repositories are updated to AWS S3. Each repo has a "upload_s3.sh" script that can be used to upload the repo to the proper location. Usage requires confguring your aws ssm credentials.

The following scenarios require new versions to be uploaded to S3 and then deployed to drams.xina.io. Deploymeny to drams.xina.io is performed using the AWS SSM deploy script.

• Changes to the DraMS Telemetry Definitions (i.e. DRAMS_TM_Database.txt or any patch files)
• Changes to struct_extract. This may include:
  • DraMS decoder changes - DraMS decoders are implemented as static plugins, so changes require a new version of struct_extract to be released and deployed.
  • General struct_extract changes
  • gselib changes (or related) that affect all data processing
  • Changes to dramslib (or other related code) that impacts how DraMS data is extracted, converted, or processed
• 699util:
  • c699util - this C++ SWIG library is used by the 699util Python tools which is used to perform mission specific mining

Steps:

1. In Ubuntu VM, build newest gsw-cpp version.
2. Build appimage of struct_extract.

./scripts/makestructextract.sh

3. Add to dramsgse repo.
4. source labcode/699util/devenv.sh
5. In gsw-cpp, cd c699util, ./copy_into_699util.py. Commit to 699util repo.
6. Perform same process on Mac.
7. Tag version of 699util.
8. upload_s3.sh
9. In dramsgse, upload_s3.sh.
10. Generate XINA Mnem Defs from dramsgse/tmdef tmdbs.
11. Import into XINA.
12. Deploy changes to drams.xina.io using DeployStructGse.

Setup DraMS Model on mine699