Hey Rob,
I have checked your site and it looks like the EXIF import has been disabled,
http://take.ms/hSV44 . I have enabled this for you. Can you try re-uploading it again?
The reason that the orientation of the photo is not correct is most likely because the exif information wasn't imported and it can't know what was the original screen orientation from the photo.
If the problem still persists, could you upload the picture here so that I can test this on your site?