Skip to main content

Posts

Showing posts from June, 2014

Incident report for Email Delays on the 18/06, caused by Mail storage migration on Auckland Network

Our upstream providers shared mail system users on the Auckland Network may be aware of an issue that occurred on the 18th June during a migration of data to a new mail platform. This resulted in mail delays for some of our clients. We apologise for the inconvenience caused, and have assurance from our upstream providers that future mail migrations will be broken down into a significantly smaller number of mailboxes, so the migrations complete within the planned maintenance window, and do not overrun into business hours. The full incident report is below. Incident report : A planned email storage migration to new hardware took longer than expected due to poor data synchronisation performance on the old mail storage hardware. Due to the ongoing mail synchronization issues we were unable to release new mail until the data synchronization had completed.This resulted in a mail delivery delay for many emails, of around 19 hours. Root Cause Analysis : The planned ma

RESOLVED | Scheduled Maintenance: Ongoing Mail storage migration on Auckland Network

 Update: 07.30pm The mailserver migration is completed and all queued mail has been delivered to the mailboxes successfully. We sincerely apologise for the long delay this sheduled migration took . The migration commenced early this morning at 12am, and should have completed by 3am during off peak hours. However there were a number of unforseen issues that have led to the delay, including the vast amount of individual files on the server which has reduced file transfer speeds. We will put a thorough incident report on this RSS as soon as soon as we have received it from our upstream providers.  ----- Update: 05.30 pm This issue still continues. We sincerely apologise for the long delay. Our upstream providers are absolutely certain in their ability to restore service by tonight. There have been a number of unforseen issues that have led to the delay, including the vast amount of individual files on the server which has reduced file transfer speeds. We will put a

Auckland Power Outages

There are reported power outages in Auckland. Please note that our hosting is not affected by this. Should there be a power outage at the datacentre, then they will run their servers off backup generators, which will keep all services up and running.