Past Incidents

This is a reminder that we have scheduled a maintenance window this Sunday March 14th, at 00:00 EST to 04:00 EDT.

We will move the Docker storage from ZFS running in the VM itself to block storage formatted with ext4.

During the maintenance MailNinja.aseriesoftubez.com will be unreachable and incoming email will be queued on mx2.aseriesoftubez.com and delivered after the maintenance.

The total downtime will be less than 3 hours.

We have resolved the issue and restored all the emails missing during that time.

We will do a final filesystem maintenance on March 14th, at 00:00 EDT.

While snapshots were being purged service was running fine but after snapshots were purged we ran a ZFS scrub on the pool which caused the kernel to hang at boot at 12:30PM EST similar to this issue.

We have restored a backup from this morning at 5:41:13AM EDT.

Once the old VM is back up and running we will do a diff of the mailboxes directories and restore those files on the new VM.

Later this week we will schedule a window to do some filesystem maintenance to prevent this from happening again.