How can this be??

Good day, a question in my head,
We've been trying to get pregnant for almost 2 years now. I heard before that it could be hereditary, at least on my side. My parents just had no trouble getting pregnant, but on my mother's side, a distant relative had difficulty or couldn't get pregnant at all. Could that be the case? I'm a bit worried about that. I regularly take vitamins and folic acid and eat healthily, I've lost 10 kilos. But on my husband's side, his parents took a long time to get pregnant. Could that be it? That's also a question in our heads. We're also considering getting checked out, but we find it all quite stressful...