Operational Excellence
Incident Communications Templates
Use these message formats for internal alerts and customer-facing updates. Keep timing commitments explicit and language clear.
Service: Payment Processing API
Impact: 35% of payment transactions failing with timeout errors
Started: 2025-12-31 09:23 PST
Status: Investigating root cause
Incident Commander: Sarah Chen (@schen)
Next Update: 15 minutes (09:40 PST)
Update: Database connection pool exhaustion identified as root cause. Scaling database connections from 100→500. Error rate declining from 35%→18%.
ETA Resolution: 10 minutes
Next Update: 10:05 PST
Resolved: 2025-12-31 10:12 PST
Total Duration: 49 minutes
Impact: 35% error rate affecting ~2,400 customers
Root Cause: Database connection pool exhaustion during high-traffic event
Immediate Actions:
• Scaled DB connections 100→500
• Added connection pool monitoring alert
• Scheduled postmortem for Jan 2 @ 2pm
RCA: Full report by Jan 3
Incident Status: Investigating
We are currently investigating elevated error rates affecting our Payment Processing API. This may result in transaction failures or increased processing times.
Impact: Payment transactions may fail intermittently
Started: December 31, 2025 at 09:23 PST
Services Affected: Payment API, Checkout Flow
Our engineering team is actively investigating the issue. We will provide the next update within 30 minutes or sooner if we have significant progress.
We apologize for any inconvenience and appreciate your patience.
View live status: status.techplatform.io | Incident ID: INC-2025-0042
Incident Status: Mitigating
We have identified the root cause of the payment transaction errors and are actively implementing a fix. Error rates are declining as we scale infrastructure capacity.
Current Status: Error rate reduced from 35% to 18%
Estimated Resolution: Within 10 minutes
Next Update: December 31, 2025 at 10:05 PST
Thank you for your continued patience as we work to fully restore service.
View live status: status.techplatform.io | Incident ID: INC-2025-0042
Incident Status: Resolved
The issue affecting our Payment Processing API has been fully resolved. All payment transactions are now processing normally.
Incident Summary:
Duration: December 31, 2025 from 09:23 PST to 10:12 PST (49 minutes)
Impact: Intermittent transaction failures affecting approximately 2,400 customers
Root Cause: Database connection pool exhaustion during high-traffic period
Resolution & Prevention:
• Increased database connection pool capacity
• Implemented enhanced monitoring and alerting
• Conducting full root cause analysis to prevent recurrence
We sincerely apologize for the disruption to your service. We are committed to improving our infrastructure resilience to prevent similar issues in the future.
A detailed postmortem report will be published on our status page within 72 hours.
View incident details: status.techplatform.io/incidents/INC-2025-0042
- Immediately: SLO breach with user-visible impact (availability, latency, error rate)
- Within 15 min: Any incident affecting >5% of users or critical functionality
- Regular updates: Every 30 minutes for customer-facing, every 15 minutes internal
- Resolution: Confirm fix deployed and metrics returned to normal
- Follow-up: Postmortem within 48-72 hours with prevention actions