On Friday, 02/02/2024, from approximately 8:05 p.m. to Monday, 02/05/2024, at approximately 1:24 p.m. (UTC), users experienced delays when provisioning users in the US instance of their KnowBe4 consoles.
This incident was caused by a previous incident that affected a backend storage system and prevented jobs from processing. After the initial incident was resolved, the system did not resume processing jobs and our queues became backed up over the weekend.
Once we increased the resources available to the system to process the backlog of jobs, the KnowBe4 console was able to return to normal performance by 1:24 p.m. (UTC) on Monday.
To prevent this type of issue in the future, we are improving our monitoring processes to track the responsiveness of system processes.
No data loss occurred as a result of this issue.