I got some bumps like that as well (not sure what to call it, I just assumed it was acne). It might have been from pillow/hat, etc.
I scoured the area pretty clean and got in a regimine of closing the pores after shaving and then using a light lotion afterwards and they seem to have cleared up, or at least they are gone now.
I did also put a little dab of baccatracin on them (only maybe 3 or 4) and they cleared up and have not returned. Maybe that might work for you?