Between friends, it can be OK. I have had conversations with people I actually like (often single people, who for some reason seem less invested as to whether we have kids or not), where the question has come up as naturally as Do you plan to live in New Zealand forever? or Are you going to homeschool?; and I do not have a problem answering that.