He knew it was wrong. He was the Captain of the Scout Legion. You were one of his soldier. He couldn’t love you. Especially with their job, killing titans, he could lose you. But nevertheless he loved you. Thus a relationship formed. Keeping it secret.