Intermittent app downtime

Incident Report for Zephyr Squad Cloud

Resolved

The fixes are stable. We are not seeing 504 from Elasticsearch.
Posted Oct 07, 2026 - 16:47 IST

Monitoring

Update:
On 31-August-2026, some Zephyr for Jira Cloud customers saw slow responses and 504 (Gateway Timeout) errors. Actions like updating test executions and running ZQL searches could fail or take longer than usual.

What happened
A large surge of background Jira events came in at the same time, mostly from creating Jira versions, with some from issue updates, component creation and sprint deletion. Each of these events made several back-to-back calls to our search service. Together, they used up all the request-processing capacity on every server in the service. Because of that, regular customer requests had to wait in line and some timed out.

Current status
We have found the root cause and have deployed one set of fixes:
Removing repeated and unneeded search calls when Jira versions are created
Caching information that rarely changes so we look it up less often
Grouping search operations into fewer calls

We are monitoring these changes, while we work on the other areas where the same issue can re-occur.

We're sorry for the disruption. We'll post another update when the pending fixes are deployed.
Posted Oct 05, 2026 - 15:57 IST

Update

Following the August 31 occurrence of this incident, we identified Elasticsearch as a potential bottleneck causing thread starvation in the middleware layer. We subsequently introduced additional monitoring and telemetry to capture more detailed data and corroborate our initial observations.

The recurrence on September 10 provided the additional data needed to confirm the root cause, and a fix is now being implemented. In the meantime, we are actively monitoring for gateway timeouts and restarting the application as needed to maintain service stability until the permanent fix is deployed.

We will continue to provide updates as progress is made.
Posted Sep 15, 2026 - 11:40 IST

Identified

The issue has been identified and a fix is being implemented.
Posted Sep 02, 2026 - 18:33 IST

Investigating

Zephyr Squad is currently experiencing some intermittent downtime.

Team is currently investigating the problem.
Posted Sep 01, 2026 - 22:01 IST
This incident affected: Zephyr Squad (Zephyr Squad Cloud).