Threaten over the internet?

This one random x box kids account got hacked. And i got a random friend request one day and sent the guy a message asking who this is? He said he knows it was me who hacked his account? (I dont even know how to hack)..He said hes got my ip adress and found out where i live... Scary thing is he was right... He lives in texas and i live in NY. Should i be worried.? All i ever do on x box is play transformers dark of the moon. I have no idea where this hacking thing came from