I sort of see it the exact reverse... wouldn't I be remiss in NOT raising my kids according to my beliefs while I have them? It informs every aspect of their father. Wouldn't I be wrong to just let them drift without spiritual guidance and conceptual structure until they reach an age that I don't believe exists to begin with?
When they get older, fine. they can stay with it, or find their own path. For my kids in my household, this is how our family works. I sort of feel it's supposed to be that way.