In order to use this early stage of the database, all that should be required is mariaDB installed, and a handful of python3 packages (numpy, astropy, MySQLdb, scipy and ftplib). Pull this repo into a directory, and then manually run databaseCore.py to setup the initial SQL database and bring database up-to-date. databaseCore.py can then be setup as a cron job to periodically update the SQL databases.
Current pre-requisites:
- MariaDB setup with user 'auscope' (easily changed)
- Python3 with mysqlclient, numpy, astropy and ftplib packages
Example crontab:
# m h dom mon dow command
0 5 * * 1 ~/software/stationFeedbackDB/databaseCore.py master2024.txt auscopeDB
0 7 * * 1 ~/software/stationFeedbackDB/databaseCore.py master2025.txt auscopeDB
0 9 * * 1 ~/software/stationFeedbackDB/updateReports.py auscopeDB
Create or fill the database (hardcoded parameters) with entries processed from the
- requirements.txt, test in a virtual environment
- regarding the pipeline/cron:
- look into looping through past master schedules as required
- i would put the command line args as parameters in a config file...
- use a proper logger