Disruption in trading is the last thing anyone wants in stock markets, In the least, one expects a smooth running trading system, especially on an expiry day trading session which normally has heightened activity and volatility. Trading today wasn’t as smooth as expected.

 

Around 8.45 a.m. this morning, our monitoring team saw some stress in the trading database with queue getting built up by users trying to access some functionalities like Live Portfolio and net positions. While there has been an increase in the number of users accessing the app lately, the stress on our systems was unusually high. By the time we could identify the cause of the stress, the market had started and there was a significant spike in users accessing the trading system. The CPU utilisation of trading database peaked and the trading system almost stopped functioning. Ideally in such scenarios, the load should automatically shift to failover database but that didn’t happen. After trying all methods our team decided to restart the primary database server. But instead of restarting in the normal state, the database went into an unusable state. After failed attempts of pointing the services to failover database, we had to restore the primary database server with all back up of trades, positions and holdings. This activity took a long time. We could completely restore the server by 12 p.m. and our entire trading system was up and running by 12.45 p.m.

I on behalf of entire 5paisa team sincerely apologize for today’s downtime. As I am writing this, our tech team is working on solutions which will help us avoid such mishaps in future. I will again communicate with you all on steps we will take to strengthen our infrastructure.