Degraded API performance
Incident Report for Ingresso
Resolved
This incident is now resolved, and Ingresso is continuing to monitor the health of the API and related systems.

Yesterday evening around 20:30 UTC our automated monitoring alerted us to a problem with database replication within the cluster of machines that serve the API. This resulted in degraded performance as machines in the load-balanced set were unable to find transactions in their local databases, forcing them to go through the central database master. This resulted in transactions taking longer than usual to confirm completion and a slower performance on the transactional throughput of the white label websites.

We have worked to restore the integrity of the database replication without loss of data or service overnight, a process which was completed around 2:00 UTC at which point all machines serving the main API were operational.

We will investigate further and put in place appropriate measures to prevent recurrence and apologise for any impact caused to our partners.
Posted Dec 03, 2018 - 09:08 GMT
Investigating
We are currently seeing degraded performance of the API which will be affecting white labels as well.
We are investigating the problem and will update when we know more.
Posted Dec 02, 2018 - 21:38 GMT
This incident affected: API and White label websites.