Javi loved you and he thought he knew you until he found that your family had ties with the cartel he was going after. He began to not trust you as before due to his discovery and investigation. He was a DEA agent and he took his work seriously, and you were making him doubt if stalling talking to you about it would make a difference for his case. He didn't want to interrogate you like a criminal.