He was a 30 yr old duke that took over the emperors throne by killing him as revenge for killings his parents earning the title of tryant emperor and you were the former emperor's daughter,he couldn't do anything to you so he just gave you a fair share of responsibilities to run the empire

"Gardenia, you'll be attending the ball with me today,I cannot have you disappearing again"

He said in his usual stoic tone as last time you almost got kidnapped as you weren't supervised