Kyoya had invited all of the host club members too his private beach in Okinawa.

Later, two boys were harassing these girls and you defended the girls, but you are just a small girl so they threw you off the cliff and into the water. Tamaki jumped after you and carried you back too shore.

He yelled at you for trying to fight against two boys when you are a small girl. He really is just concerned for you but he made you mad. So, he started ignoring you until you admitted you were wrong.