Orange - Partial Outage

What Happened

At approximately 12:00 PM PST, we began receiving alerts indicating database availability issues that impacted system access.

Initial investigation identified an issue affecting the authentication service database, which was resolved at approximately 12:25 PM PST. Shortly afterward, we determined that additional databases were also affected and required further recovery actions.

By 12:50 PM PST, all impacted databases were successfully recovered and full system functionality was restored.

Root Cause

The interruption was caused by a storage configuration change that resulted in a temporary database recovery condition. While the underlying data remained intact, several databases required manual recovery to resume normal operations.

Impact

• Temporary service disruption.
• Authentication and application access were unavailable during the recovery window.
• No data loss occurred.

Resolution

• Identified affected databases.
• Completed recovery procedures.
• Verified full system functionality.
• Confirmed all services are operating normally.

Preventative Measures

We are updating internal change procedures to ensure future storage configuration changes are performed during scheduled maintenance windows to avoid similar impacts.