Clean without soap

I just put some of that soap-free stuff from the maternity pack on my hands and a quarter of an hour later put my pinky in my newborn baby's mouth. Stress me out now if this could be harmful? It'll probably be okay though, right? And it doesn't say it's toxic or anything like that either?