It is because the force of gravity is always directed towards the centre of the earth. Under such situation, your weight is in a direction perpendicular to the ground where you are standing. This is the reason why you feel that you are [standing upright].