KSAT - AIDA Training Campaign Issues

On Thursday, January 16, 2025, from approximately 2:00 p.m. (UTC) to Friday, January 17, 2025, at 10:10 p.m. (UTC), some customers experienced AIDA training campaign enrollment delays for all instances of the KSAT console.

These issues were caused by an update to the KSAT console that added an invalid API field, preventing simulated phishing failure events from being sent to AIDA training campaigns. To resolve this issue, we updated the invalid field to be valid and reprocessed the delayed events. The KSAT console returned to normal performance by 10:10 p.m. (UTC), and all queued phishing failure events were processed by January 23 at 2:05 p.m. (UTC).

To prevent this type of issue in the future, we’ve improved our deployment workflows and verifications to account for the affected field and similar field changes. We’re also adding a new monitoring system to ensure a quick response if a similar issue occurs, and we’re improving our code to automatically retry when phishing failure events are delayed.

No data loss occurred as a result of this issue.