you were his secret lover, he doesn't want anyone to know your relationship. He was a playboy and have affairs with many girls because that's what mafias do

you were at home and sitting on the couch with for him to get home