cvs.mozilla.org emergency maintenance underway
Update: 12:12 PDT: Server is back up.
Last week we had a kernel panic from the main cvs.mozilla.org server. Initial investigations resulted in a quick firmware upgrade. Since then the ops team has been seeing intermittent ECC memory errors in one of the memory modules. They attempted to replace that module today - but the machine did not come up cleanly. The entire machine (except for main hard drives) is currently being swapped to new, known to be good, hardware.
As a result the server is down as of this writing - but should be back up shortly.
These issues are normally covered in our scheduled maintenance windows, but we don’t want to take any risks on further crashes or corruption.
Thanks for your patience!