Our server is setup to automatically patch each of our core programs (database server, apache web server, etc), automatically whenever a new security patch is released. This way, we're always running the most up-to-date services, and always protected.
The downside of this is occasionally they release a patch that causes the compile to break, and thus takes the server down (such as mysql crashing this morning). No problem, with good comes bad, and it's simple to resolve.
I was asleep, and around 7:30 got a text message from Dudesky, which I slept through (text messages are very quiet on my phone). Finally around 11:30am (EST) I got a call from witeshark to let me know the server was down. By this point it was down for over 8 hours, which is deadly to our search engine rankings, potential new signups, general traffic, etc. We need to keep the server up as much as possible.
Thank you Dudesky and witeshark, but if anyone else on UB notices it's down, call me and let me know 24/7, 404.213.8616. I'd rather get 20 phone calls a minute than two every 8 hours.
Haha, for that matter, feel free to call anytime regarding anything. I still on occasion get a phone call from Bitcore out of the blue.
Anyway, we're back up and running now, so sorry about the downtime guys.