Ha, so you guys have probably noticed the site has been having some ups and downs these days. The root cause has been traced to two things:
1) A faulty UPS which is no longer providing continous power
2) A bad motherboard which is causing the primary firewall not to restart after a power outage
Once the firewall is down, the whole system (njreefers along with other sites, and worst of all, my PERSONAL EMAIL!!! :'( ) goes down until I drive myself back to the site and hit the power switch.
I've been in negotiations with a colocation provider for the past two weeks to set up a new server at their facility, with redundant power, generator backup, etc, but I just got this note from them, regarding why I hadn't heard from them when I expected:
So, this is the level of service we have to look forward to!
Well, still going ahead with plans for the move, as I'm actually appreciative with this hosting provider for being pretty responsive to queries even under the circumstances.
Just had a good laugh to myself when I read this tonight.
1) A faulty UPS which is no longer providing continous power
2) A bad motherboard which is causing the primary firewall not to restart after a power outage
Once the firewall is down, the whole system (njreefers along with other sites, and worst of all, my PERSONAL EMAIL!!! :'( ) goes down until I drive myself back to the site and hit the power switch.
I've been in negotiations with a colocation provider for the past two weeks to set up a new server at their facility, with redundant power, generator backup, etc, but I just got this note from them, regarding why I hadn't heard from them when I expected:
At approx 8:30am there was a 12" water main that ruptured on Hoffman ln. that began to floof the street and parking lot of our facility. By 9:15 water began to enter the building, as well as engulf the Keyspan sub-station that is accross the street. Keyspan staff began picking up readings of natural gas in the air as well and ordered all utilities to be shut off to our building as well as several others on Hoffman ln. We were unable to use our generator due to the risk of explosion/electricution.
We were able to restore power to the Data center off our generator around 5:30 - 6 pm and began restarting all the equipment within it. We are not 100% operation an have over 30 people working on cleanup right now. Please be patient as we work through this mess.
So, this is the level of service we have to look forward to!
Well, still going ahead with plans for the move, as I'm actually appreciative with this hosting provider for being pretty responsive to queries even under the circumstances.
Just had a good laugh to myself when I read this tonight.