Operations

Incidents

3 incidents tracked · on-call rotation active.

Open queue

criticalPayments API latency degradation

#1042 · payments-api · production · owner m.rivera

Status

investigating

Impact

32% requests failing

Detected

10:42 AM

Duration

18 minutes

payments-apiPostgreSQL primaryapi-gateway
  1. 10:38

    Deployment v2.8.4 rolled out to production

    ci-bot
  2. 10:42

    Latency alert triggered (p95 > 800ms)

    fitsun-monitor
  3. 10:43

    AI root cause analysis started automatically

    fitsun-ai
  4. 10:45

    Database CPU saturation identified at 91%

    fitsun-ai
  5. 10:47

    Incident acknowledged, rollback under review

    m.rivera

Notes

Shared response context

  • Connection pool exhausted on payments-api replicas 3 and 5.
  • Rollback candidate: v2.8.3 (last known healthy).