Skip to main content

MOMA/XINA Data Mining

MOMA telemetry archives (known as "TID's") are imported into XINA by the process described here.

  1. USER: Commits a TID to SVN. The SVN repo "momadata" resides on the MOMAIOC server (momaioc.gsfc.nasa.gov).
  2. MOMAIOC: An SVN post-commit hook creates a "rev" file and saves it to a shared network drive (/mine699/missions/moma/rev/)
  3. MINE699: A cronjob (running /mine699/missions/moma/watch.sh) monitors the "rev" directory for new files. For MOMA, the "tm.meta" file needs to have been added or updated for processing to continue. The "conditions" for how to handle a commit are defined in /mine699/missions/moma/config.watch.json.
java -jar /mine699/app/x3/xina_commit_watch.jar \
  -archive /mine699/mission/moma/archive \
  -config /mine699/mission/moma/config.watch.json \
  -data /mine699/mission/moma/data \
  -import /mine699/mission/moma/import \
  -java /mine699/env/jre1.8.0_45/bin/java \
  -label MOMA \
  -mailto "nick.dobson@gmail.com;eric.i.lyness@nasa.gov" \
  -mailhost mailhost.gsfc.nasa.gov \
  -python2 /mine699/env/python2.7/bin/python2.7 \
  -python3 /mine699/env/python3.4/bin/python3.4 \
  -rev /mine699/mission/moma/rev \
  -svn /usr/bin/svn \
  -svnlook /usr/bin/svnlook \
  -timeout 43200 >> /mine699/mission/moma/log/watch.log 2>&1 &
  1. MINE699: xina_commit_watch will call /mine699/missions/moma/commit.sh
/mine699/env/jre1.8.0_45/bin/java -jar /mine699/app/xina_commit_6.9.0.jar \
  -mode remote \
  -config /mine699/mission/moma/config.json \
  -import $1 \
  -java /mine699/env/jre1.8.0_45/bin/java \
  -local /mine699/mission/moma/local \
  -python2 /mine699/env/python2.7/bin/python2.7 \
  -python3 /mine699/env/python3.4/bin/python3.4 \
  -repo momadata \
  -rev $2 \
  -svn /usr/bin/svn \
  -svnlook /mine699/mission/moma/rev/$2.rev \
  -temp /mine699/mission/moma/temp \
  -url "svn://momaioc/" >> /mine699/mission/moma/log/commit.log 2>&1
  1. MINE699: xina_commit_watch will call /mine699/missions/moma/import.sh
/mine699/env/jre1.8.0_45/bin/java -jar /mine699/app/x3/xina_import.jar \
  -port 42000 \
  -fdelay 1000 \
  -dir $1 \
  -movejson $2 \
  -movefile $2 >> /mine699/mission/moma/log/import.log 2>&1