dormando (dormando) wrote in lj_maintenance,
dormando
dormando
lj_maintenance

Stuff down.

E-mail notifications, amongst a few other things, seem to be down right now. I just woke up, so I'm going to get to work on fixing things now.

Current issues


- Mood icons don't appear, or images don't load.: The servers were moved to a new location last night, and the IP addresses had to be changed. We set up a machine at the old place which is forwarding requests to the old IP address, but it doesn't forward image requests. I'm going to see about getting it forwarding images later today.

Update: Mail seems to be sending now. I'll bet a whole bunch of comment notifications were lost, however :( I can't really tell how much were saved. Drop me a note if you're not getting notifications on comments made after this post was made.

Update 2: Figuring the extent of the broken-ness. I have a growing list of things that need to be fixed, but with any luck I'll be able to restore most of the site within an hour or two. I updated the 500 error message with a short message. It will look more like this message once I fix a few more things.

Update 3: Got the LJ servers syncing code from the new code server, since the old one they were syncing against is now a database. Pulled marklar out of rotation, since MySQL isn't running on it right now. Threw hat into rotation. The site seems to be back now. I'll look into tossing kenny into the pile as well.

Update 4: I've done just about all I can. I'm going to prepare the two new slave webservers for normal use, but I can't put them into the pool since only brad has access to do that. Brad also needs to get the other two DBs going (which should only take a few minutes, after he wakes up.)
Until then, I'll be monitoring the site closely. It seems to all work right now, though. Except for the issue highlighted above.

I'll update this post as stuff happens.
Subscribe
  • Post a new comment

    Error

    Anonymous comments are disabled in this journal

    default userpic

    Your reply will be screened

  • 62 comments
Previous
← Ctrl ← Alt
Next
Ctrl → Alt →
Previous
← Ctrl ← Alt
Next
Ctrl → Alt →