Trying to get pregnant but...

Hi there, I have a question on my mind. We've been trying to get pregnant for almost 2 years now. I heard it could be hereditary, at least on my side. My parents had no trouble conceiving, but on my mother's side, some distant relatives had difficulty or couldn't conceive at all. Could that be the case? I'm a bit worried about it. I take vitamins and folic acid regularly and eat healthily, and I've lost 10 kilos. But on my husband's side, his parents took a long time to conceive. Could that be it? That's also on my mind. We're considering getting checked out, but we find it quite stressful...