Historical evidence from 70 years of AI research demonstrates that general methods leveraging computation ultimately prove the most effective by a significant margin.
This stems from Moore’s Law, which describes the exponential decrease in computation costs over time.
While researchers often attempt to incorporate human knowledge into AI systems for short-term gains, the long-term progress predominantly comes from approaches that leverage computation through search and learning.
Source: The Bitter Lesson