Thanks guys for all of your great advice! Ultimately I need to do what I want, so I decided to grow a soul patch since that's what I want to do.
It will be a nice way to ring in the new year with a new look. I already have some stubble below my lip, so it should be nice and full by the weekend.
It will be a little extra work keeping it groomed, but if the look works for me, then the maintenance will be worth it.