I (man) have smoked before the pregnancy

Hi everyone, (posted this topic yesterday but apparently it was deleted)

My wife just got pregnant after our first attempt (hormone treatment). Now I'm super worried about the following…
I'm not a smoker by nature, but on rare stressful moments (e.g., huge difficulties or pressure at work) I do smoke a cigarette.
So in August there was such a difficult period and I smoked about 5 cigarettes a day during that month.
We made our first attempt in early October and my wife is pregnant.
Now I'm super worried about the cigarettes I smoked in August because you read a lot about damage to sperm cells or permanent DNA damage. I don't know what to think anymore?
I feel like slapping myself and I'm so angry at myself. If we had waited a few more months, could we have brought a healthier child into the world? Or am I really seeing this all wrong?