For anyone looking for help on how to do this. I used AWS Network load balancer. The load balancer needs to listen using TLS and port 443. Then, the listener needs to listen using TCP and port 1935. Connection between your streaming app e.g. OBS and the load balancer will be encrypted. The load balancer will decrypt the data and then forward to TCP:1935 to your Wowza Server. Voila, rtmps based streaming without having to deal with Wowza and Certificates.
Worth writing in a blog (if you have One) 
. I wonder if this can somehow be made useful in case of wowza WebRTC.