Kukla's Korner

Kukla's Korner Hockey

KK Issues

Sorry for the outage tonight.  My host had some serious database problems and it was a problem for every website on the system.
Not sure if it is 100% up yet, but it appears to be coming back…

added 10:16pm, from my hosting company, technical if you want to read what happened…

Sorry folks, we have a number of back-end ethernet switches that handle database, storage array, and other important communications between our clustered servers. We quickly identified that it was indeed an issue with our backend network, but as all visible indicators showed no outward issues (ie: no dead switches, typical ethernet switch blinking lights, and no warning/alert lights were on). Deeper investigation identified a highly unusual issue between two switches sharing a high-speed uplink port to pass data between them, we found the switch with the issue pulled it out of service and replaced it with a stand-by switch and systems are again operational.
Things we have already been working on to help avoid issues like this, and allow better communications with our clients:
1) Our switching networking is being upgraded with Cisco 4500 series ethernet switches, this will allow us to provide a more complete, highly available, and expandable infrastructure, each Cisco 4500 series switch will provide us the ability to expand to 100’s of GigE ethernet ports as well as 10GigE infrastructure where we need it as well.
2) New support ticket system based on HelpSpot support system + a dedicated e-mail server for our support e-mail needs are being placed in our business continuation data center in Edina, Minnesota. This will allow our clients, and staff to stay in communications in the event there are any physical issues, Denial of Service or in this case infrastructure failures in either of our two primary data centers in Minneapolis, MN or Fremont, CA.
I do apologize deeply for the downtime today, and I just would like to personally let everyone know that its our top priority, always, to provide the highest levels of uptime we can, with that we will be making organizational and infrastructure changes to make sure to limit issues like this happening again (which for us are a rare event already), and to allow us to communicate better with you.

Filed in: KK Website Business, | KK Hockey | Permalink
 

Comments

Be the first to comment.

Add a Comment

Please limit embedded image or media size to 575 pixels wide.

Add your own avatar by joining Kukla's Korner, or logging in and uploading one in your member control panel.

Captchas bug you? Join KK or log in and you won't have to bother.

Smileys

Notify me of follow-up comments?

Feed

Most Recent Blog Posts

About Kukla's Korner Hockey

Paul Kukla founded Kukla’s Korner in 2005 and the site has since become the must-read site on the ‘net for all the latest happenings around the NHL.

From breaking news to in-depth stories around the league, KK Hockey is updated with fresh stories all day long and will bring you the latest news as quickly as possible.

Email Paul anytime at pk@kuklaskorner.com