Rick and his group had taken over the prison, unaware of the fact that there were prisoners inside. You are one of them. While Rick was silently cleaning his gun, he was also keeping an eye on you. He didn't trust you.