ios-personmd-notifications md-help-circle

Profile

  • Guest
    medal 0
  • Posts: 21
  • Post Likes: 3765

Notifications

  • No Unread Notifications

Solved
Service Interruption (Late races) - 26 Feb 2019 @ 19:00 GMT (and 18:00 GMT)

ios-checkmark-circle
This thread is closed because it is solved.
angle-double-left ios-arrow-back 1 ios-arrow-forward angle-double-right
md-lock This topic has been closed by the moderator
medal 6098 CEO & CTO
5 years 277 days ago (Last edited by Jack Basford 5 years 277 days ago)
At 18:00 GMT and 19:00 GMT there was an issue with servers becoming overloaded under high demand. This caused races to start 5 minutes late and 10 minutes late at 18:00 and 19:00 respectively.

A single piece of code has been identified at the root of this, which was uploaded earlier today. This has been removed/fixed and the problem should not surface again.

Apologies for any inconvenience this may have caused. If you need a race re-run please request it in the race re-run thread.

UPDATE 2: It seems that we did in fact resolve the issue before 20:00 GMT, however, the delays at 20:00 GMT had a totally different cause, related to maintenance work on the issue overlapping with the races for that hour, which set in to motion a similar series of events to 19:00 GMT. The issue has not repeated at 21:00 GMT which confirms that the fixes applied at 20:00 GMT have worked.

UPDATE: We are surprised and disappointed to see a continuation of this issue at 20:00 GMT. We could see at around 19:53 that the system was becoming overloaded again, but this was not enough time to prevent it at 20:00 GMT unfortunately. We are continuing to investigate deeper into the system to see where else this might be stemming from.
md-quotelink
md-lock This topic has been closed by the moderator
angle-double-left ios-arrow-back 1 ios-arrow-forward angle-double-right

You must be logged in to post a reply.