KMSAT - Users, Phishing, & Training Issues (US only)
Incident
Report for KnowBe4
Postmortem
On Wednesday, 2/1/2023, from approximately 7:00 a.m. until 10:00 a.m. (ET), some users experienced issues with the Users tab, phishing campaigns, and training campaigns in their KMSAT consoles.
This incident was caused by a recurring job that locked part of the database. As a result, other jobs were delayed, and database performance issues occurred. Once the lock was removed, KMSAT was able to return to normal performance by 10:00 a.m. (ET). While the remaining jobs were processed, phishing tests and training notifications were delayed up until 5:30 p.m. (ET).
To prevent this type of issue in the future, we will adjust our schedule for running recurring jobs.
No data loss occurred as a result of this issue.
Resolved
The underlying issue for this incident has been resolved. Phishing emails and training notifications may be delayed while the backlog processes.
Monitoring
We’ve implemented a fix for the issues with the Users tab, phishing campaigns, and training campaigns. We’re monitoring the results to make sure no further issues occur.
Investigating
We have received reports that some users are experiencing issues with the Users tab, phishing campaigns, and training campaigns. We are investigating this issue and will update this page when we have more information.
This incident affected: KnowBe4 Security Awareness Training (KSAT) (Console, Phishing, Training).