Do you want to remove the picture altogether, or do you just want to rotate it so it can show correctly?
If you want to remove and not replace it , just click on the picture and select "No avatar"
If you want to replace it with another picture from your computer, just click on "Upload Image" and then select the new image from your computer
If you want to use the current image and rotate it, you may have to download an app that lets you rotate pictures. My personal favorite is Irfanview. It's free and I've used it quite a few times
Note: Many avatars have the right side chopped off, so when taking self pictures for your avatar, you may have to take a picture with your face to the far left, or you may have to take the picture with the camera vertically.
Hope this helps.