22nd November 2019

SMS Messaging API API and Dashboard configuration error

While doing routine server upgrades, traffic was internally routed away from affected servers - this is something we do on regular bases to keep our servers up to date with the latest security patches and should have 0 downtime.

In the current case a configuration error in services caused some internal connections to not disconnect from servers under maintenance and re-connect to working servers. This caused a snowball effect also ended up affecting our API's and Dashboard.

We have investigated the issue to the extent where the configuration error has been identified and we are in the process of updating internal services with required patches.

We are also doing further investigations on determining how the temporary traffic routing had such an effect to cause this configuration error to affect other services.

Duration of incident: Start: 22/11/2019 16:00 End: 22/11/2019 16:30