My hair at the crown grows in sorta like a spiral, so I have to go at all angles to keep with the grain.
I'm sure I'll never speak from personal experience on this one, but I would bet that the hardest area to shave is just below the waist...
Most of us have hard to shave areas. They get easier and easier to shave with practice.