Should there be a system crash, you may need to start the Trap Processor again:
If you login to the Dashboard GUI, and you see: Last update from dashboard backend: - in the top left of the screen, or if the date/time has remained the same, then the Trap Processor or ActiveMQ has failed.
Login to prod-dboard01-trap.geant.net
Sudo to root and check what Java programs are running:
ps -ef | grep java This should show three processes running 1 for ActiveMQ and 2 for the Trap Processor process.
It's a good idea to check that the disk hasn't filled up: df /var will tell you how full the disk is. If it is approaching 100%, then go and delete some of the logs detailed below.
You can also check that the port 162 is open and is being listened to by Java:
sudo netstat -tulpn
Look for the following lines:
udp 0 0 :::162 :::* 6554/java
udp 0 0 :::7500 :::* 6554/java
You will notice the process id 6554 will be one of the two Java processes of the Trap processor, seen when you run the ps - ef | grep java command. Obviously, the process id will change as the Trap processor is restarted over time .
Where Are The Logs?
/var/log/snmptraps/new-dashboard/TrapProcessor
allLog.txt errorLog.txt warnLog.txt
/var/log/snmptraps/apache-activemq-5.10.0/data
audit.log
*** You Will Need To Start ActiveMQ BEFORE Starting The Trap Processor Process
To Stop And Start ActiveMQ:
Login and sudo as root
Navigate to /var/log/snmptraps/apache-activemq-5.10.0/bin
./activemq stop
./activemq start
To Stop And Start Trap Processor:
Login and sudo as root
Run ps -ef | grep java and note down the two process id numbers, then kill both:
kill -9 process_id_number_noted_down
*** Switch to user dante.sanigar
Navigate to /home/local/GEANT/dante.sanigar/TrapProcessor-1.0-SNAPSHOT
sudo java -jar -DCONFIG_HOME=file:///home/local/GEANT/dante.sanigar/TrapProcessor-1.0-SNAPSHOT -DMIB_PATH=/usr/share/snmp/mibs -DTRAP_PROCESSOR_HOME=/var/log/snmptraps/new-dashboard/TrapProcessor TrapProcessor-1.0-SNAPSHOT.jar &