Major provider outage
Resolved·Full outage

The underlying incident has now been resolved and all systems are operational again. This incident was caused by an outage in AWS us-east-2 AZ-1 losing power, which resulted in some of our critical systems failing. We failed over to other AZs where we could, restoring operational capability.

As a result of this incident however you may see:

  • Missing API logs from your dashboard for the period of 16:59 - 17:30 UTC

  • Missing workflow run logs for the period of 16:59 - 17:30 UTC

Thu, Jul 28, 2022, 06:06 PM
(2 years ago)
·
Affected components
API
Notification delivery
Dashboard
Updates

Resolved

The underlying incident has now been resolved and all systems are operational again. This incident was caused by an outage in AWS us-east-2 AZ-1 losing power, which resulted in some of our critical systems failing. We failed over to other AZs where we could, restoring operational capability.

As a result of this incident however you may see:

  • Missing API logs from your dashboard for the period of 16:59 - 17:30 UTC

  • Missing workflow run logs for the period of 16:59 - 17:30 UTC

Thu, Jul 28, 2022, 06:06 PM

Monitoring

All services within Knock are operational again. Some downstream providers may still be impacted by the outage in AWS us-east-2.

We're continuing to monitor.

Thu, Jul 28, 2022, 05:45 PM(21 minutes earlier)

Investigating

There are ongoing issues with downstream providers, some notification deliverability may be impacted as a result.

Current Knock status:

  • In-app feeds are operational

  • Notification engine is processing normally

  • Webhooks are processing normally

  • Workflow run logs are delayed

  • API logs are delayed

Thu, Jul 28, 2022, 05:35 PM(10 minutes earlier)

Investigating

Our current status is:

  • In-app feeds are partially degraded

  • Notifications are still being sent

  • API logs are not currently being processed

  • Workflow run logs are currently not being processed

  • Webhooks are current not being processed

Thu, Jul 28, 2022, 05:21 PM(13 minutes earlier)

Investigating

We're having a major outage with our hosting provider. We're currently looking for ways to mitigate.

Thu, Jul 28, 2022, 05:08 PM(13 minutes earlier)