Groove applications are currently unusable
Incident Report for Clari
Postmortem

On October 11, 2024, at 18:30 UTC, Groove applications encountered intermittent problems due to a database deadlock. This situation arose when multiple transactions attempted to access the same resource, causing them to become stuck. Consequently, the system stalled, and incoming requests were blocked as they awaited the completion of the deadlocked transactions.

To address this, we implemented a timeout for database operations, which terminated blocked transactions after a specified duration. The issue was completely resolved by 20:03 UTC that same day. There was no risk or compromise to user data during this incident.

Posted Oct 16, 2024 - 23:12 UTC

Resolved
We have confirmed the issue has been resolved for the impacted customers. A summary of the incident will be posted within the next three US business days.
Posted Oct 11, 2024 - 21:01 UTC
Monitoring
A fix has been implemented and we are monitoring the results.
Posted Oct 11, 2024 - 20:03 UTC
Investigating
We are currently investigating this issue.
Posted Oct 11, 2024 - 19:21 UTC
This incident affected: Groove (Groove Dialer, Groove webapp, Groove Extension, Outlook Add-in).