![[personal profile]](https://www.dreamwidth.org/img/silk/identity/user.png){kind=small}
(no subject)
Fun day.. went to a conference/meeting at Alphawest this morning, scored a nice ~$100 waterman pen (engraved with a CheckPoint ad.. heh). Got back, did some work, and our main RAID box crapped itself. Lost one disk, then the hot-spare failed, so we were operating without parity, then a second one failed and the entire RAID set died. Which meant that /home on our student server and our departmental webserver went bye-bye... in a fairly fatal fashion.
This was at 2:45PM.. by 6PM, we had a new disk (not three, just one..) and a rebuilt RAID and have done some rearrangement, and have started to do a restore. We probably have about 100GB of stuff to recover.. got about 14GB back off the disks so far and it's been 4 hours.. should be all back up and going by Monday or Sunday evening (40 of it is over a network, and the rest is local to the backup server, so that will be a lot faster)
*mutters darkly*
This was at 2:45PM.. by 6PM, we had a new disk (not three, just one..) and a rebuilt RAID and have done some rearrangement, and have started to do a restore. We probably have about 100GB of stuff to recover.. got about 14GB back off the disks so far and it's been 4 hours.. should be all back up and going by Monday or Sunday evening (40 of it is over a network, and the rest is local to the backup server, so that will be a lot faster)
*mutters darkly*
no subject
(It must be that time of the month, incidently)