Monday, September 28, 2020

Feynman on AI

Thanks to a reader for sending the video to me. The first clip is of Feynman discussing AI, taken from the longer 1985 lecture in the second video.

There is not much to disagree with in his remarks on AI. He was remarkably well calibrated and would not have been very surprised by what has happened in the following 35 years, except that he did not anticipate (at least, does not explicitly predict) the success that neural nets and deep learning would have for the problem that he describes several times as "pattern recognition" (face recognition, fingerprint recognition, gait recognition). Feynman was well aware of early work on neural nets, through his colleague John Hopfield.  [1] [2] [3]

I was at Caltech in 1985 and this is Feynman as I remember him. To me, still a teen ager, he seemed ancient. But his mind was marvelously active! As you can see from the talk he was following the fields of AI and computation rather closely. Of course, he and other Manhattan project physicists were present at the creation. They had to use crude early contraptions for mechanical calculation in bomb design computations. Thus, the habit of reducing a complex problem (whether in physics or machine learning) to primitive operations was second nature. Already for kids of my generation it was not second nature -- we grew up with early "home computers" like the Apple II and Commodore, so there was a black box magic aspect already to programming in high level languages. Machine language was useful for speeding up video games, but not everyone learned it. The problem is even worse today: children first encounter computers as phones or tablets that already seem like magic. The highly advanced nature of these devices discourages them from trying to grasp the underlying first principles.  

If I am not mistaken the t-shirt he is wearing is from the startup Thinking Machines, which built early parallel supercomputers.

Just three years later he was gone. The finely tuned neural connections in his brain -- which allowed him to reason with such acuity and communicate with such clarity still in 1985 -- were lost forever.

No comments:

Blog Archive