On Wednesday, 2/1/2023, from approximately 7:00 a.m. until 10:00 a.m. (ET), some users experienced issues with the Users tab, phishing campaigns, and training campaigns in their KMSAT consoles.
This incident was caused by a recurring job that locked part of the database. As a result, other jobs were delayed, and database performance issues occurred. Once the lock was removed, KMSAT was able to return to normal performance by 10:00 a.m. (ET). While the remaining jobs were processed, phishing tests and training notifications were delayed up until 5:30 p.m. (ET).
To prevent this type of issue in the future, we will adjust our schedule for running recurring jobs.
No data loss occurred as a result of this issue.