You shaved it against the grain, and it does make a difference. It can indeed be irritating, at least in the beginning, but use a good shave gel, cream or oil and a good after shave. I use Aloe Vera gels, they also add a nice shine.
I shave every day and must go against the grain, there is only so much stubble after one day