How do I give up my big family dream?

How do I get past my husband not wanting more kids? I've always wanted a big family and we'd always planned on it, but once our first was born he changed his mind for plenty of valid reasons, and some he can't articulate. I held out hope that he'd one day change his mind and when I thought he was wanting another baby, it was actually just to make me happy. So we have two kids, he loves them both, but he didn't want two. For him; he's done. But I'm not and I am trying so hard to get past it, but I'm struggling. I'm stuck in this place where I keep thinking "if I'd known before that he didn't want a big family, would I have married him?" I love him and I can't imagine any other person to be my partner and the father of my kids, and I'm not looking to change his mind or leave him. I just need help to get past my grief and my pain so that I can be happy again. Please help!!