You see it as him playing with you. He refuses to see it as manipulation. You do not want to put the kids through divorce, but this is difficult to put up with.
Maybe all this would benefit from a third party (ie:Christian counseling at church or marriage counselor) sorting it all out and maybe helping open up the communication between your husband and you. Some men (and even women) do not talk openly but just use what I call "slap stick" communication. My brother in-law says things similar to your husband as I have been in my brother in laws presence many times when he has done this. She tries to talk to him about it and then he turns the tables to make it like she started the problem. I KNOW it hurts and even becomes depressing for my sister. My sister is going to look into and really wants counseling for them. His disrespect, anger, bitterness and temper just seems to increase as the weeks go by. I was there last week and the guy flipped a gasket for 20 minutes because she did not have the bed sheets back on the bed because he just wanted to crawl into bed and turn the TV on! My sister had a garage sale Thur, Fri & Sat with my mom and grandmother over. She had to entertain them, cook, clean, mow 2 acres, work her job (she works from home), volunteer at the dog shelter, take care of her 2 dogs and a foster dog they took in while her husband was out of town. Oh yeah, he brought home 10 loads of laundry she was doing that evening he flipped out! So she was doing all this and he could not even put a bed together?

Her husband though has issues that he never dealt with; his mothers suicide as he was the one that argued with her hours before and found her and then my sisters health issues. They do not have children, but they have been together for 20 years, married for 12. She does not want a divorce either, but having health issues and overcoming anxiety, it is hard to stay "recovered" when he is like Jeckyl and Hyde.
If what he says is bothering you, there IS a problem. You are not crazy. Maybe HE does not think there is anything wrong with speaking to you in the manner he does. Whether or not that is his intention, he DOES need to acknowledge that he does hurt you.
I hope there is a positive resolution to this for you and your family. Good luck to you!