xsBackup outage

  • October 16, 2013 by Stefanita Rares Dumitrescu
Hi guys,

Last Saturday we were pretty surprised when all the racks where the xsbackup nodes are located went down for about 30 minutes. As it seems, the datacenter forgot to send us a notice so we could shutdown the servers in advance, because they were replacing an old UPS with a new one, so they had to cut the power.

Upon booting back up, everything seemed okay, but the second day, one of the 2 arrays on the server started throwing errors, and we took it offline for check and repair. 

There was no data loss, but since it's a massive array, 18 TB, the integrity checking takes a while, so please be patient while we complete this. 

We are sorry for the inconvenience, but we just want to make sure that everything is working properly, and the data is secure and the backups are reliable, as you would expect from us, and as we have used you to our services in the past - reliable. 

Once again sorry for the inconvenience, and once we have everything running properly, we will let you know. Please keep in mind that the backups are intact, no data has been compromised, but we are just being cautious so that everything goes smooth.