Two python projects have been created to automate much of the process of generating the monthly report.
They can be found on gitlab:

MSR automation project: https://gitlab.geant.net/msr-automation/msr-python

MD-VPN automation project: https://gitlab.geant.net/msr-automation/mdvpn-python

The process for generating a new report when using these tools is as follows:

• Starting a new period
  1. run /opt/msr-reports/reports/opsdb_import_new.sh on the test-msr server
• 3.1 & 5.1 Availability, 7.0 GEANT LAMBDA and 8.0 Tickets:
  1. Add the month's outage data to reports.SPLUNK_DATA with the msrgenerator project https://gitlab.geant.net/msr-automation/msrgenerator
  2. Follow https://wiki.geant.org/display/SD/7.1+Availability until you need to run the exportoutages.sh script - the script has been moved to the test-msr server in the /opt/msr-reports/reports/infinera-outage-export directory
  3. Run runme.py in the msr-python project for the given month
  4. Generate graphs under the MSR administration menu http://test-msr.geant.net:8888/msr/ad_graphs.jsp
  5. Add previous month entry in the sidebar in the /var/lib/tomcat6/webapps/msr/includes/mainmenu.jsp file
  6. When publishing report, run the mdvpn-python script https://gitlab.geant.net/msr-automation/mdvpn-python to update mdvpn part of MSR on production, and copy over new topology/graphs/media files to prod-msr under `/var/lib/tomcat6/webapps/msr/`
  7. Make sure that the mainmenu.jsp file is also updated on prod-msr after publishing the MSR!
• 3.2, 5.2 & 7.2 Utilisation figures
  1. Use the cacti-utilisation project to generate scripts that import data from cacti to the test-msr database: https://gitlab.geant.net/msr-automation/cacti-utilisation 
  2. 3.2 Utilisation explains the process, but the scripts cover all of sections 3.2 and 5.2. Section 7.2 is covered above. You basically need to copy the generated fix-scripts to the scripts directory on the cacti VM and run sudo ./fix_monthly_utilisation.sh -y MSR_YEAR -m MSR_MONTH -- e.g. 2021 and 1