I first do front to back. That is primarily with the grain. Then I turn around and do back to front. Then I go after the "crazy hair" that isn't covered by the first two passes.
I can't start back to front because I just jam up the razor, dull it quicker, and don't get a good shave.