I had a few problems with this when I first started shaving. For me, the answer was as "simple" as Stridex pads and changing my pillowcase more often. This solution did, however, make my skin dry out. So...to cure oily skin, I used acne medicine which then required me to put on more moisturizer.
Go figure, huh?