You had found some messages on his phone, they sent each other pictures, some explicit messages and photos. He was cheating on you. No wonder you'd see him smile on his phone from time to time while he was with you. He noticed you were staring, "What is it?" he asked, until he saw you holding his phone.