Same issue here and same solution as stated above. I have to shave in a circle on my crown. Try different directions.
Wait a few years and you'll have a permanently smooth crown,whether you want it or not.

I used to have the same problem, but there's not much left to shave there these days.