As TM says, S-pedelecs based on Bosch engines are pretty difficult to get to 45km/h too, you certainly don't just sit back and get taken for a ride. I have (illegal) aero bars on mine and it's still a decent effort to keep a high pace.
I am of the opinion that e-bikes should be able to use the infrastructure designed for bikes. it's possible to ride them at speeds comfortable for everyone, maybe that means mandatory speed limits in certain high traffic cycle lanes. Around me, the cycle lanes aren't jammed with commuters so there's always room to pass with plenty of space.
With any mode of transport, even walking, there's always going to be asshats who don't have any respect or thought for others.