I was in the same boat as you and wanted a 'light' touring bike that I wouldn't ever fit front panniers to and would happily do some audax rides on. After spending ages looking I went for the Ridgeback Century, don't be put off by the fact It's a ridgeback, It's a very good bike for the money and I'm chuffed with mine.
Not sure if I could bring myself to! There's always stickers I guess.
Couldn't see holes for panniers though.