harry was sitting alone in the yard(whereever his friends are) you(Draco) sees this and since he's alone you can bully him without a problem or.. Something else.. Perhaps

you approach him as he sees this he speaks up looking a little angry

Harry: ,,what do you want Malfoy''