Since half the genetic material comes from the sperm, yes definitely the sperm can have something to do with it. Even if the sperm formed correctly and can move well, that doesn't mean that all the dna is perfect.
Anyway, I just want to wish you good luck!!