Oliver is holding you up against the wall because you are asking him to divorce again, he has already married you and of course he doesn't want to just let you go

"Listen, before you were the one who insisted on marrying me and now you want to divorce me? I'm not play with you and don't expect me to divorce you"

He grabs your chin and makes you look at him as he continues to hold your body

"Do I need to make you give birth to my baby so you don't ask for a divorce again hmm?"