On Wednesday, 7/26/2023, from approximately 4:41 p.m. (UTC) until Thursday, 8/3/2023, at approximately 12:30 a.m. (UTC), some KMSAT admins experienced issues downloading reports as CSV files.
This incident was caused by a large number of report download requests, which led to query delays. Once a large request was removed, KMSAT was able to return to normal performance by Thursday, 8/3/2023, at 12:30 a.m. (UTC).
To prevent this type of issue in the future, we made a backend change to reduce the amount of time needed for report download requests. We are also planning additional infrastructure changes.
No data loss occurred as a result of this issue.