There is only an 8 minute difference in your start times. There are a thousand people per pen So if you were at the front of your pen and he at the back of his that would stretch it out a bit.
I'm guessing you want to ride together so just wait for him at a prearranged spot and you'll be fine.
The broom wagon will be your Nemesis but only if you blow-up or linger too long.
Pens 7-8 should be alright.
Or is it the case that you want to get into his pen?