Why can't stuff break at a normal friggin hour? - Subaru Enthusiasts Car Club of the Sierras

sonicsuby · 2006-01-29, 05:15 AM

God dammit.

Tonight has been a nightmare. Well, not really a nightmare. For that I'd have to be sleeping

Had a disk to replace tonight in an SSA attached to an old ass R/S 6k. I'm new to this stuff so you're probably as confused with the acronyms as I am. I get by, you will too. So anyway, we go out to the computer room, open the box with our shiny new disk and....it's the wrong part. IBM shipped the wrong damn part. So the CE orders up the new disk. It's local (as in here in Sac), so no biggie (I've had parts fail at 3am before and have to come in from Hayward. By car. IBM apparently has no helicopters, rocket ships or dudes with jet packs to ferry parts.). It's 11:30pm when we order the disk. The people on the ordering side are apparently playing pong or something and decide not to order the disk for like 2 hours. We get the disk at 3am

. We replace the disk, go to start the cluster and start seeing some odd errors. What's that? The power supply failed! Well, luckily there's two power supplies so the box is up, but if one is down and the other fails, bad news! So the CE just left to go grab the PS to come back and replace it. He's been here since 7pm, me since 8pm. He probably won't be back till near 6 and then who knows how long it will take to swap it

The only benefit to being up this late is that I'll probably get home about the same time as the woman and we'll make breakfast and have a few drinks together. It's ok to drink at 6am if you haven't gone to sleep yet.

So to make this more of a discussion than a rant...

Don't you guys hate it when stuff fails at the most inopportune times? Tell me all about it and I'll read it tonight when I wake up!

newyorkreload · 2006-01-29, 07:28 AM

yes.

Dean · 2006-01-29, 09:06 AM

Yes... For the most part, my company has given up, and has entire Fault tolerant clusters and farms with on-site spares for key systems, and are progressing to full geographically dispersed High Availability (Dual active where possible)

I know many can't afford that level of Fault Tollerance, but you'd be surprised how inexpensive on-site spares are compared to the cost of 4 hour support over time.

MattR · 2006-01-29, 10:16 AM

Quote:

Originally Posted by sonicsuby

Don't you guys hate it when stuff fails at the most inopportune times? Tell me all about it and I'll read it tonight when I wake up!

OMG, that's sucks dude...I've always wondered why things tend to fail when no body's around.

I used to work as a nighttime dispatcher for my old trucking company, coordinating trucks all over CA, NV and AZ, and I swear to God, every night I'd have to find people to fix shit broken down along the road or in the most remote locations...It's hard to deal with mechanics on the phone, let alone at 3 AM.

Enjoy your day sleep.

sonicsuby · 2006-01-29, 04:11 PM

Quote:

Originally Posted by Dean

Yes... For the most part, my company has given up, and has entire Fault tolerant clusters and farms with on-site spares for key systems, and are progressing to full geographically dispersed High Availability (Dual active where possible)

I know many can't afford that level of Fault Tollerance, but you'd be surprised how inexpensive on-site spares are compared to the cost of 4 hour support over time.

We have a lot of similar high availability tech, unfortunately we have so much different hardware we couldn't really keep spares for everything

. Especially on these boxes that are so old.

Bob Danger · 2006-01-29, 07:11 PM

Normally I get a break from 1am to 5am, which I use to sleep, but the other night our Delta flight was running 3 hours behind. We didn't finish until 3:30, I had an hour and a half to sleep before the morning flights went out.

Its Harsh

2006-01-29, 05:15 AM	#1
sonicsuby Wagon Ho #2 Join Date: Mar 2004 Location: Sacramento, CA Posts: 657	Why can't stuff break at a normal friggin hour? God dammit. Tonight has been a nightmare. Well, not really a nightmare. For that I'd have to be sleeping Had a disk to replace tonight in an SSA attached to an old ass R/S 6k. I'm new to this stuff so you're probably as confused with the acronyms as I am. I get by, you will too. So anyway, we go out to the computer room, open the box with our shiny new disk and....it's the wrong part. IBM shipped the wrong damn part. So the CE orders up the new disk. It's local (as in here in Sac), so no biggie (I've had parts fail at 3am before and have to come in from Hayward. By car. IBM apparently has no helicopters, rocket ships or dudes with jet packs to ferry parts.). It's 11:30pm when we order the disk. The people on the ordering side are apparently playing pong or something and decide not to order the disk for like 2 hours. We get the disk at 3am . We replace the disk, go to start the cluster and start seeing some odd errors. What's that? The power supply failed! Well, luckily there's two power supplies so the box is up, but if one is down and the other fails, bad news! So the CE just left to go grab the PS to come back and replace it. He's been here since 7pm, me since 8pm. He probably won't be back till near 6 and then who knows how long it will take to swap it The only benefit to being up this late is that I'll probably get home about the same time as the woman and we'll make breakfast and have a few drinks together. It's ok to drink at 6am if you haven't gone to sleep yet. So to make this more of a discussion than a rant... Don't you guys hate it when stuff fails at the most inopportune times? Tell me all about it and I'll read it tonight when I wake up! Last edited by sonicsuby; 2006-01-29 at 05:18 AM.

2006-01-29, 09:06 AM	#3
Dean Señor Cheap Bastarde Real Name: Dean Join Date: May 2003 Location: $99 Tire Store Posts: 9,294 Car: $.04 STI Class: Fast,Cheap & Reliable=STI Deal, did somebody say Deal? Oh, Dean, yeah that's me.	Yes... For the most part, my company has given up, and has entire Fault tolerant clusters and farms with on-site spares for key systems, and are progressing to full geographically dispersed High Availability (Dual active where possible) I know many can't afford that level of Fault Tollerance, but you'd be surprised how inexpensive on-site spares are compared to the cost of 4 hour support over time. __________________ I am a Commodore PET --- Now get off my lawn you kids...

2006-01-29, 07:11 PM	#6
Bob Danger Tape Terrorist Join Date: Jul 2004 Location: Melmac Posts: 1,792 Car: ? Class: Retired! Warning: Prolonged eye contact may cause insanity	Normally I get a break from 1am to 5am, which I use to sleep, but the other night our Delta flight was running 3 hours behind. We didn't finish until 3:30, I had an hour and a half to sleep before the morning flights went out. Its Harsh __________________ A fronte praecipitium a tergo lupi.

2006-01-29, 07:28 AM	#2
newyorkreload EJ18 Join Date: Jan 2006 Location: Cow Town: The City of Trees Posts: 33 Car: 02, Subaru Impreza WRX "I have lived so many lives, all in my head"	yes.