In a biography I read another story about Einstein and maths: he was allowed to skip the math classes because he was already so far ahead. He was already reading math books of university level at that time. Perhaps that story about Einstein being bad stems from elementary school, or it is only a myth.