Modern AI and the state of interdisciplinary exchange with neuroscience - Greg Corrado

TL;DR

Deep learning and artificial neural networks have greatly impacted various fields of AI, including image and speech recognition and machine translation, but their relationship with neuroscience is limited and there is potential for further exploration and collaboration.

Transcript

so our next speaker is Greg Corrado and also shortly after I came to Stanford I had the pleasure of engaging with the Newsome lab and was on Greg kuratas thesis committee at that time he seemed to me like a hardcore neuroscientist and he was bringing the computation into the project he was collaborating with lea sugru on understanding a very intere... Read More

Key Insights

• 😷 Deep learning has had a significant impact on various fields of AI, including image and speech recognition, machine translation, and medical imaging.
• 🏑 The relationship between deep learning and neuroscience is limited, with minimal knowledge transfer between the two fields.
• ❓ Deep learning systems can provide valuable insights into the functioning of complex systems, such as the visual system or language processing.
• 🏛️ Hardware advancements, such as purpose-built accelerators, have further propelled the progress of deep learning.

Questions & Answers

Q: How have deep learning techniques been applied in medical imaging?

Deep learning systems have been used to screen for diabetic retinopathy, achieving similar performance to human doctors. They have also been used to identify distant planets from astronomical data.

Q: Can deep learning systems provide insights into the functioning of the brain?

Deep learning systems have been used to study the visual system and identify how individual neurons respond to certain stimuli. However, it is not clear whether these findings directly translate to how the brain works.

Q: How do embedding functions in deep learning systems contribute to language processing?

Embedding functions allow for the representation of words and concepts in a continuous vector space. This enables learning of relationships between words and concepts, such as gendered nouns or tenses.

Q: Has deep learning improved machine translation?

Yes, deep learning has significantly improved machine translation systems. By training recurrent neural networks on large datasets, machine translation systems can achieve performance comparable to self-identified bilingual speakers.

Summary & Key Takeaways

• Deep learning has revolutionized AI and machine learning in the past decade, with applications in image and speech recognition, machine translation, and medical imaging.

• Neural networks have been successful in tasks such as diabetic retinopathy screening, planet identification, and language processing.

• However, the relationship between deep learning and neuroscience is limited, with minimal knowledge transfer between the two fields.