Put on some moisturizing cream and maybe a bit of anti-acne face cleanser (before the moisturizer, of course) and it will go away with time. The same thing happened to me when i first shaved my head, and it still does occasionally. If you shave against the grain, try shaving only with the grain on your neck. It seems to help a little.