MOMA/XINA Data Mining
MOMA telemetry archives (known as "TID's") are imported into XINA by the process described here.
- USER: Commits a TID to SVN. The SVN repo "momadata" resides on the MOMAIOC server (momaioc.gsfc.nasa.gov).
- MOMAIOC: An SVN post-commit hook creates a "rev" file and saves it to a shared network drive (/mine699/missions/moma/rev/)
- MINE699: A cronjob (running /mine699/missions/moma/watch.sh) monitors the "rev" directory for new files. For MOMA, the "tm.meta" file needs to have been added or updated for processing to continue. The "conditions" for how to handle a commit are defined in /mine699/missions/moma/config.watch.json.
java -jar /mine699/app/x3/xina_commit_watch.jar \
-archive /mine699/mission/moma/archive \
-config /mine699/mission/moma/config.watch.json \
-data /mine699/mission/moma/data \
-import /mine699/mission/moma/import \
-java /mine699/env/jre1.8.0_45/bin/java \
-label MOMA \
-mailto "nick.dobson@gmail.com;eric.i.lyness@nasa.gov" \
-mailhost mailhost.gsfc.nasa.gov \
-python2 /mine699/env/python2.7/bin/python2.7 \
-python3 /mine699/env/python3.4/bin/python3.4 \
-rev /mine699/mission/moma/rev \
-svn /usr/bin/svn \
-svnlook /usr/bin/svnlook \
-timeout 43200 >> /mine699/mission/moma/log/watch.log 2>&1 &
- MINE699: xina_commit_watch will call /mine699/missions/moma/commit.sh
/mine699/env/jre1.8.0_45/bin/java -jar /mine699/app/xina_commit_6.9.0.jar \
-mode remote \
-config /mine699/mission/moma/config.json \
-import $1 \
-java /mine699/env/jre1.8.0_45/bin/java \
-local /mine699/mission/moma/local \
-python2 /mine699/env/python2.7/bin/python2.7 \
-python3 /mine699/env/python3.4/bin/python3.4 \
-repo momadata \
-rev $2 \
-svn /usr/bin/svn \
-svnlook /mine699/mission/moma/rev/$2.rev \
-temp /mine699/mission/moma/temp \
-url "svn://momaioc/" >> /mine699/mission/moma/log/commit.log 2>&1
- MINE699: xina_commit_watch will call /mine699/missions/moma/import.sh
/mine699/env/jre1.8.0_45/bin/java -jar /mine699/app/x3/xina_import.jar \
-port 42000 \
-fdelay 1000 \
-dir $1 \
-movejson $2 \
-movefile $2 >> /mine699/mission/moma/log/import.log 2>&1