I’m sorry for your struggles.
The story was a bit unclear though about whether you blamed your ex for being infertile and that’s why your first marriage ended? Cause that seems a bit unfair.
The missing an adoption meeting deliberately though is a bigger red flag that you two are incompatible in terms of your long term desires for the future.
Something like kids is something both partners need to be 100% on the same page with otherwise a relationship can’t survive.
I’m glad you have a family now :)