Should I get back together with my ex-boyfriend who has trust issues?

My ex-boyfriend and I met over a year ago. We hit it off and fell in love pretty quick. However, he has trust issues and assumed I was cheating. When I found out I was pregnant, we had just broken up. Five months later, I lost the baby, and we did not speak for a few weeks. Now we are talking, and he says he loves me but is afraid I will hurt him "again." I just want to know where to go with this because I love him so much, and I want to get back to us being happy and a family.