What the heck is going on - why no response from him?

I have been casually dating a guy for 3 months. Days will p between dates without contact, etc. and I don't pester him with phone calls or texts. Anyway, we last hung out on Tuesday. I talked to him briefly on Wednesday, but I had to cut the conversation short because I was going out with friends. We didn't talk on Thursday. I texted him today with a silly, flirtatious text. An hour ped (which is rare) because he usually responds quickly, so I sent a follow-up and just asked if he got my joke - that I was just being silly. We joke around a lot, so I figured he would have said SOMETHING. Anyway, it's been 5 hours since I texted him. I have no idea what's going on, if he's angry with me, or what. I don't want to text him anymore because I don't want to be pushy. What should I do at this point? Were my actions so needy that he's pulling away?