"For over 300 years, one principle governed every learning system: the bias-variance tradeoff."

The bias-variance tradeoff is a very old concept in statistics (but not sure how old, might very well be 300)

Anyway note the first algorithms realted to neural networks are older then the digital computer by a decade at least.