In this case, yes he would. When this child grows up, and becomes an adult, and Allah asks them on the judgment day when they die, why '' didn't you accept Islam''? then their seed will respond with, ''My father wasn't around to raise me, and to teach about the basics of Islam''. So, the sins will be passed onto him as he neglected his basic duties as a Muslim father.
It's a different story if that child has two Muslim parents, and later on, in their adult life, they decided to become a kafir then they will be punished for their own apostasy and not the parents per se, because they were given the knowledge of the deen, and they decided to reject the truth on their own behalf.