Skip to content

Early scripts for a system to process the various reports produced by the IVS.

Notifications You must be signed in to change notification settings

e-s-l/stationFeedbackDB

 
 

Repository files navigation

stationFeedbackDB

In order to use this early stage of the database, all that should be required is mariaDB installed, and a handful of python3 packages (numpy, astropy, MySQLdb, scipy and ftplib). Pull this repo into a directory, and then manually run databaseCore.py to setup the initial SQL database and bring database up-to-date. databaseCore.py can then be setup as a cron job to periodically update the SQL databases.

Current pre-requisites:

  1. MariaDB setup with user 'auscope' (easily changed)
  2. Python3 with mysqlclient, numpy, astropy and ftplib packages

Pipeline:

Example crontab:

# m h  dom mon dow   command
0 5 * * 1 ~/software/stationFeedbackDB/databaseCore.py master2024.txt auscopeDB
0 7 * * 1 ~/software/stationFeedbackDB/databaseCore.py master2025.txt auscopeDB
0 9 * * 1 ~/software/stationFeedbackDB/updateReports.py auscopeDB

databaseCore.py

Create or fill the database (hardcoded parameters) with entries processed from the

updateReports.py

TODO

  • requirements.txt, test in a virtual environment
  • regarding the pipeline/cron:
    • look into looping through past master schedules as required
    • i would put the command line args as parameters in a config file...
  • use a proper logger

About

Early scripts for a system to process the various reports produced by the IVS.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 88.9%
  • HTML 8.1%
  • CSS 3.0%