Stopping SMS bomb from using my sms template

I have an application that sends OTP sms. Sms bomber has been using my OTP template to send thousands of SMS in a day. I have blocked the IP of the website and changed my server IP. Still the issue is not resolved. How to do rca for this?