Why does my 2 mth keep on doing this?

I will give him his binky and 2 seconds later he's spitting it out and whining for it. He is laying in my arms he's not laying down somewhere else so it's not like he wants attention or held. Why does he keep doing that?