On Monday, December 2, 2024, from approximately 1:15 p.m. until 3:28 p.m. (UTC), some users experienced issues with loading the Learner Experience (LX) on the US instance of the KSAT console.

This incident was caused when we deployed an update to improve the LX’s efficiency in loading recommended training modules. The update gradually caused an overload on our server’s CPU due to inefficient backend processes.

To resolve this issue, the update was reverted and the KSAT console returned to normal performance by 3.28 p.m. (UTC).

To prevent this type of issue in the future, we are adding improvements to the scaling, monitoring, and alert systems for the LX before we redeploy the update.

No data loss occurred as a result of this issue.