The starting-point for this is to realize that speech is a relative newcomer in human evolution. Recently evolved behaviours are almost always less reliable than long-existing functions. Speech is evolutionarily recent and is unique to humans. Reading is built on speech (presupposes it). If speech itself is an evolutionary novelty, how much more should we expect reading to be a difficult skill?