I'm having the same problem too. The par 3 holes that I tee off with an iron, I can usually get on (or if not near) the green, but as soon as I go off on a par 4 or 5 with my driver etc tend to go all over the place.
I have a quite a bad habit of slicing my woods, so I compensate by aiming slightly left, but sods law the minute I go too far left, I actually catch one straight and end up in the rough on the other f**king side

.
I've seen a pro and he reckons I'm turning my shoulders too early. I've tried slowing them down, but it takes anything up to about 50yrds off my drives and finding mid-fairway hazzards.
Can anyone else please come up with some suggestions?