Deploy updates to XINA

InDevelopers ordermust fordeploy DraMS specific updates to the DraMS XINA instance to functionensure asproper expected,operation. developersThese needupdates serve two main purposes:

• Update XINA's DraMS mnemonic definitions
• Update the tooling required to deployextract variousdata from the archives

The updates tocome XINA to keep it in sync.

DraMS XINA has thefrom following Git repo dependencies:

• dramsgse
  • apps/linux/struct_extract - Extracts and converts the telemetry data from the raw packet archives
  • tmdef/ - Contains the telemetryTelemetry definitions that are used by struct_extract to decode and convert the telemetry data. The telemetry definition files are also converted to XINA's Mnemonic Definition format and then imported into XINA.imported.
• 699util
  • Contains miningMining scripts that extract additional data from the raw packet archives such as markers and message logs.

These repositories are not directly cloned on XINA. Instead, snapshots of the repositories are updated to AWS S3. Each repo has a "upload_s3.sh" script that can be used to upload the repo to the proper location. Usage requires confguring your aws ssm credentials.

The following scenarios require new versions to be uploaded to S3 and then deployed to drams.xina.io. Deploymeny to drams.xina.io isare performed using the AWS SSM deploy script.

• Changes to the DraMS Telemetry Definitions (i.e. DRAMS_TM_Database.txt or any patch files)
• Changes to struct_extract. This may include:
  • DraMS decoder changes - DraMS decoders are implemented as static plugins, so changes require a new version of struct_extract to be released and deployed.
  • General struct_extract changes
  • gselib changes (or related) that affect all data processing
  • Changes to dramslib (or other related code) that impacts how DraMS data is extracted, converted, or processed
• 699util:
  • c699util - this C++ SWIG library is used by the 699util Python tools which is used to perform mission specific mining

Steps:

1. In Ubuntu VM,VM: buildBuild newest gsw-cpp version.master.
2. Build appimage of struct_extract.

./scripts/makestructextract.sh

3. Add struct_extract to dramsgse repo.
4. source labcode/699util/devenv.sh
5. In gsw-cpp,cpp:

cd c699util,
./copy_into_699util.py
.

Commit to 699util repo.

6. Perform same process on Mac.
7. Tag version of 699util.
8. upload_s3.sh
9. In dramsgse, upload_s3.sh.
10. Generate XINA Mnem Defs from dramsgse/tmdef tmdbs.
11. Import into XINA.
12. Deploy changes to drams.xina.io using DeployStructGse.