If you have a haberdashery nearby, go there and find out your proper hat size. it will make buying hats on the internet that much more fun and rewarding.
Can't say I've ever had a problem but the only hat I'd typically wear is a beanie or similar.