All my portrait images loaded into labelimg is flipped horizontal and i have no ways of rotating it in the program. Coordinates appear weird because of this.

I have exactly the same problem
@Kiathui, I found what was the problem !
When a picture is taken with some camera, it is recorded as a landscape direction picture and it is specified in the EXIF file of the picture that it was a portrait direction picture.
labelImg isn't handling the rotation needed through that EXIF file.
You have to rotate and save the pictures before using them in labelImg.
You can use
exiftran -ai *.jpeg
Most helpful comment
@Kiathui, I found what was the problem !
When a picture is taken with some camera, it is recorded as a landscape direction picture and it is specified in the EXIF file of the picture that it was a portrait direction picture.
labelImg isn't handling the rotation needed through that EXIF file.
You have to rotate and save the pictures before using them in labelImg.
You can use
exiftran -ai *.jpegexiftran
JPEG Autorotate