Andreas Echavez (oceanplexian) wrote in lj_maintenance,
Andreas Echavez
oceanplexian
lj_maintenance

Site Availability Issues

Hi Everyone,

This afternoon we experienced a technical failure of our Memcached system. Memcached encountered some hardware failures in just the right places (Murphy's Law), which caused issues with some related internal systems and a cascade effect that affected site availability. 

Fortunately, we managed to come up with a permanent solution and everything is back up again. Memcached only affects temporary cached data, so no user data was lost or corrupted in any way.

In addition to dealing with these issues, our engineers are working with us to eliminate the few, extremely unlikely points of failure that we managed to encounter today. Better quality "downtime" pages and status updates are now a priority, and I apologize we didn't have something for this situation, as failures on this level are highly unexpected.

Thanks for your patience,
Andreas - LJ Operations
Subscribe
  • Post a new comment

    Error

    Anonymous comments are disabled in this journal

    default userpic

    Your reply will be screened

  • 117 comments
Previous
← Ctrl ← Alt
Next
Ctrl → Alt →
Previous
← Ctrl ← Alt
Next
Ctrl → Alt →