CEO & CTOHi everyone,
18:30-19:30 UTC - We’re aware that many managers had trouble running practice laps, and that some races scheduled started late. The races were delayed intentionally to give everyone an additional 5 or 10 minutes in some cases to prepare their setup while we resolved the matter with practice laps.
Practice availability has now been restored.
Technical cause identified
The incident was brought on by a broad network security enhancement today, which caused one service monitoring systems to incorrectly fail connectivity checks for working simulators, incorrectly marking the active services as unreachable. Once that happened, other services disregard them. The problem... all simulators got marked as offline. The system kept marking simulators as out of circulation, which meant practice could not find an available simulator and some race starts were delayed.
This has been resolved now. We’ll continue monitoring the race schedule and simulator pool while that fix is rolled out.
Sorry for the disruption, especially to anyone preparing for races during that window. We’ll share any further updates if needed.