KMSAT - Console Issues
Incident Report for KnowBe4
Postmortem

On Monday, 10/18/2021, from approximately 11:40 a.m. until 2:08 p.m. (ET), users experienced delays with login-related emails including email confirmations, passwordless logins, and passwordless reset emails.

These issues were caused by an unexpected increase in email traffic, causing email processing to slow down. Once extra servers were added to process the traffic, login-related emails returned to normal performance by 2:08 p.m. (ET).

To prevent this type of issue in the future, we have started to implement a new priority system for login-related emails.

No data loss occurred as a result of this issue.

Posted Nov 05, 2021 - 14:45 UTC

Resolved
This incident has been resolved.
Posted Oct 18, 2021 - 18:08 UTC
Monitoring
We’ve implemented a fix for the notification delays and we’re monitoring the results to make sure no further issues occur.
Posted Oct 18, 2021 - 17:01 UTC
Update
We are continuing to investigate this issue and will update this page when we have more information.
Posted Oct 18, 2021 - 16:46 UTC
Investigating
We have received reports that users are experiencing delayed notifications. We are investigating this issue and will update this page when we have more information.
Posted Oct 18, 2021 - 15:40 UTC
This incident affected: Kevin Mitnick Security Awareness Training (KMSAT) (Console).