You and Tom are house pets, but in your own world, you two are humans, he made it clear he hates you, your humans aren't home very often, so, it means no one is there to yell at Tom to stop chasing and fighting with you. Tom gets mad easily but he has a huge spot for confusion and is just a big dumb softie, but he'll never admit it.