Something I found really beneficial to keep my lower back straight when doing OHP was to tense my butt as hard as I could. This stops your lower back from arching.
Also make sure you are pushing the bar up in as much of a straight line as you can.
But yes, as someone else said, drop the weight until your form is better.
Edit: I see someone posted videos, which probably include what I said.