All Systems Operational
Web App Operational
Report Processing Operational
Notification Processing ? Operational
Browser Extension Operational
3rd Party Services Operational
GitHub Operational
Atlassian Bitbucket API Operational
Heroku ? Operational
Redis Labs AWS/us-east-1-3.1 ? Operational
DNSimple Name Servers Operational
Stripe API ? Operational
AWS cloudFront Operational
AWS s3-us-west-2 Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
System Metrics Month Week Day
Median Response Time
Fetching
Tasks in queue ?
Fetching
Past Incidents
Mar 24, 2017

No incidents reported today.

Mar 23, 2017

No incidents reported.

Mar 22, 2017

No incidents reported.

Mar 21, 2017
Postmortem - Read details
Mar 22, 12:44 UTC
Resolved - This incident has been resolved.
Mar 21, 23:25 UTC
Update - Worker queue is under 500 and dropping quickly. We have implemented new procedures to store reports.

System has been stable for ~2 hours now.
Mar 21, 23:22 UTC
Monitoring - Working on our job queue. Thank you for your patience.
Mar 21, 22:46 UTC
Investigating - Server continue to battle sql query lag. We are dedicated to resolve this issue asap.
Mar 21, 21:32 UTC
Monitoring - A fix has been implemented and we are monitoring the results.
Mar 21, 20:54 UTC
Investigating - Sorry, but this continues to come up. We are working hard to manage the system and identify the culprit repositories.

There is one or more project that have massive reports causing the outage. More information will come soon. Thank you for your patience!
Mar 21, 20:37 UTC
Resolved - Back and running. Will write up a post-mortem shortly.
Mar 21, 20:12 UTC
Update - And we are back up and working on the queued jobs. <3
Mar 21, 19:12 UTC
Update - Back to some outage. Working through it! :)
Mar 21, 19:07 UTC
Monitoring - Working through our large queue of jobs. Thank you for your patience.
Mar 21, 18:54 UTC
Update - Bringing backend workers back online. Web service is being monitored, but operational.
Mar 21, 18:46 UTC
Identified - Working on resolving the issue. Should be back online in under 30 minutes. Thank you!
Mar 21, 18:31 UTC
Update - Taking our build workers offline as we review the cause of this outage. Thank you for your patience.
Mar 21, 18:15 UTC
Investigating - We are seeing elevated error rates due to SQL long queries.
Mar 21, 17:55 UTC
Mar 20, 2017

No incidents reported.

Mar 19, 2017

No incidents reported.

Mar 18, 2017

No incidents reported.

Mar 17, 2017

No incidents reported.

Mar 16, 2017

No incidents reported.

Mar 15, 2017

No incidents reported.

Mar 14, 2017

No incidents reported.

Mar 13, 2017

No incidents reported.

Mar 12, 2017

No incidents reported.

Mar 11, 2017

No incidents reported.

Mar 10, 2017

No incidents reported.