For H4 visa, marriage certificate is very important. Its easy to get one from your local area registrar office.
Without marriage certificate, you may need to prove your marriage and kids relationship with alternative ways. One challenge is that having kids together doesnt constitute you both are married. Wedding invitation, album etc are just supplements over the marriage certificate rather than alternatives.