I updated the Kurzweil version of Moore’s Law to include the latest data points. Further UPDATE here, post Tesla AI Day. Of all of the variations of Moore’s Law, this is the one I find to be most useful, as it captures what customers actually value — computation per $ spent. Humanity’s capacity to compute has compounded for as long as we can measure it, starting long before Intel co-founder Gordon Moore noticed a refraction of the longer-term trend in the belly of the then fledgling semiconductor industry. But, Intel has ceded leadership for Moore’s Law. The 7 most recent data points are all NVIDIA GPUs, with CPU architectures dominating the prior 30 years. The fine-grained parallel compute architecture of a GPU maps better to the needs of deep learning than a CPU. There is a poetic beauty to the computational similarity of a processor optimized for graphics processing and the computational needs of a sensory cortex, as commonly seen in neural networks today.

• Uncategorized