That all depends of a few factors. First, as long as he is legally married living together or not there will be no valid marriage between you common law or otherwise. Second, each state has it own laws governing common law marriages. Example: Mississippi does not recognize common law marriages. But, remember if in a state that does there is no such thing as common law divorce. If the relationship splits you still must go through legal divorce proceedings to end it.