The green cluster is back up. The downtime was due to multi-machine failure all caused by buggy hardware. We have 5 servers all using the same type of scsi raid controller that we are replacing as quickly as possible. We have replaced 2 so far and will be doing the other 3 as soon as possible. The databases halted abnormally, but there shouldn't be any dataloss or corruption. We'll be looking into it more, and apply sections of a backup should it be necessary.