Event Processing Delays Due to Temporary Backlog

Resolved

This issue is now fully resolved.
Posted Nov 08, 2025 - 00:11 UTC

Monitoring

Recovery is complete, and all systems are now operating normally as of 3:21 pm PST. The event backlog has been completely cleared, and event-driven workflows are functioning as expected.
We’ll continue to monitor closely to ensure ongoing stability and performance. Thank you for your patience while recovery efforts were completed.
Posted Nov 07, 2025 - 23:48 UTC

Update

Recovery continues to progress well, and system performance is steadily returning to normal. We now expect full recovery within the next two hours.
All pipelines remain stable, and no data loss has been detected. Some of the event-driven workflows may still experience brief delays until processing is fully caught up.
We’ll share an update as soon as normal operations are fully restored.
Posted Nov 07, 2025 - 22:03 UTC

Update

Recovery is well underway, and the event backlog continues to reduce steadily. System capacity has been fully scaled to accelerate processing, and we expect all delayed events to be cleared within the next few hours. During this time, some event-driven workflows may still reflect updates with brief delays. Our teams are closely monitoring throughput and stability, and we’ll provide a final update once normal processing has fully resumed.
Posted Nov 07, 2025 - 20:13 UTC

Identified

We are continuing to work through the event processing delays and have elevated the incident priority to accelerate resolution. Our teams have identified the root cause contributing to higher-than-expected load, and mitigation steps are actively in progress. All core data pipelines remain stable, and there is no indication of data loss. Some event-driven workflows may continue to experience delayed updates as systems recover.
Posted Nov 07, 2025 - 18:14 UTC

Update

We are continuing to investigate this issue.
Posted Nov 07, 2025 - 17:22 UTC

Investigating

We are experiencing minor delays in event processing due to a temporary backlog. The incoming rate has stabilized, and our systems are actively clearing the queue. All pipelines remain healthy, and no data loss has been observed. During this period, a subset of event-driven workflows may reflect updates with a slight delay. We expect full normalization within the next few hours and will share updates as progress continues.
Posted Nov 07, 2025 - 17:22 UTC
This incident affected: Data Import and Export Services (Event Service).