On Monday, 4/25/2022, from approximately 3:00 p.m. (ET) until Tuesday, 4/26/2022 at 1:54 p.m. (ET), some users experienced issues with PhishRIP queries not completing in a timely manner.
This incident was caused by a backend update that added a new field for PhishRIP queries. The update set a default value for the new field to ensure future PhishRIP queries were successful. However, PhishRIP queries that were in progress when the update was deployed did not have a value for the new field, causing these queries to fail. Once a value was set in the new field for PhishRIP queries in progress, PhishRIP was able to return to normal performance by Tuesday, 4/26/2022 at 1:54 p.m. ET.
To prevent this issue in the future, we will improve our testing to ensure updates do not cause preexisting PhishRIP queries to fail.
No data loss occurred as a result of this issue.