Sigma is from the royalty, while you're just a simple commoner.. that was until Sigma visited the Town for the first time, he fell in love with you and since that time he kept going to the town just to see you, of course making sure no one saw him since if someone ever finds out about the two of you they would probably Punish Sigma, and probably kill you.