[Notice] Information regarding Megazone account login issues
Followhello.
This is a MegaZone account.
On September 8, 2023, a login issue occurred in the MegaZone account, and the following information was provided.
We apologize for any inconvenience this may cause.
Disability Content
2023-09-08 17:28 ~ 18:10
Unable to log in to Megazone account
cause
The release notes included in version 1.36.0 included planned DB changes required for contract and application functionality.
Due to the nature of the work, the DB is temporarily locked to prevent data additions or changes until the DB structure is changed.
We expected a processing time of a few seconds, but two concurrent change operations ended up deadlocked, causing the service to become unresponsive.
This caused service outages as it increased the time it took to process incoming user requests in real time.
Due to the nature of the work, the DB is temporarily locked to prevent data additions or changes until the DB structure is changed.
We expected a processing time of a few seconds, but two concurrent change operations ended up deadlocked, causing the service to become unresponsive.
This caused service outages as it increased the time it took to process incoming user requests in real time.
Action taken
After discovering the cause, we immediately located the deadlocked task, stopped it, and rolled back the 1.36.0 release.
Follow-up actions
We will supplement the process as follows to avoid the same issue from occurring.
- If a DB change task is scheduled, the release time will be carried out outside of business hours regardless of the size of the task.
- Perform deployment tests in a staging environment with the same level and traffic as the production environment.
- If a DB change task is scheduled, the release time will be carried out outside of business hours regardless of the size of the task.
- Perform deployment tests in a staging environment with the same level and traffic as the production environment.
We apologize again for any inconvenience caused.
We will strive to be reborn with more stable and better services.
Comments
0 comments
Please sign in to leave a comment.