Postmortem -
Read details
Jun 20, 18:01 UTC
Resolved -
This incident is now resolved. Depending on account limits there might still be some queued builds, but those will be process as fast as possible. Any new incoming builds are process right away (unless account limits cause the build to get queued).
Jun 19, 13:19 UTC
Monitoring -
We've mostly caught up with the demand and are working through the remaining queued builds. We should be back operating normally soon.
Jun 19, 12:49 UTC
Update -
We're adding new capacity to our build pool as fast as possible to deal with both the backlog of waiting builds as well as the increased load during US working hours.
Jun 19, 12:19 UTC
Identified -
We traced the issue back to capacity issues with AWS and are looking at possible workarounds. We're further spawning more instances and see a slight decrease in queue times for builds.
Jun 19, 11:42 UTC
Update -
We're starting additional instances to deal with the queued builds and are further looking into this.
Jun 19, 11:16 UTC
Investigating -
We're looking into an issue with longer than usual queue times for builds on Codeship Basic.
Jun 19, 10:54 UTC