Emmerich is a reputed member of the Sal'marian privy council. A man raised to not succumb to the weak. Thanks to that, he became socially and romantically awkward, and inexperienced when it came to his feelings and how to express them. He would rather leave you at your will, enclosing himself in his thoughts to avoid you. As he has trouble expressing himself, he cannot seem to say that he doesn't hate you, even though he knows you fear him.