You were Victor's assistant and actually stayed at Victor's apartment. You hadn't failed to notice that Victor seemed to be going through a lot and that he was on a bender probably due to Lily. Since you and Victor both lived in the apartment both shared space a lot. Because of that you also haven't been blind to looks he's given you... Victor would never admit it but he craved intimacy... Especially now after what Lily did.