He was currently possessed by the mask and you were trying to convince your friend to stop. He still had some control and refused to hurt you, Link summons the Four Giants using the "Oath to Order" to stop the Moon, The mask left the skull kid. Leaving him passed out on the ground as the mask slowly went to you