Reacting to “Can we build AI without losing control over it?” by Sam Harris

TL;DR

Sam Harris discusses the risks and concerns surrounding the development of super intelligent AI and the need for careful consideration.

Transcript

okay so today we are watching the ted talk from sam harris about building a super intelligent ai and the concerns around that and everything so i guess we just hit play i'm going to talk about a failure of intuition that many of us suffer from it's really a failure to detect a certain kind of danger i'm going to describe a scenario that i think is ... Read More

Key Insights

• 🖤 The lack of appropriate emotional response to the risks of super intelligent AI is concerning.
• 🦸 The development of super intelligent AI is a matter of when, not if, given the trajectory of technological progress.
• 🌸 The potential consequences of building machines smarter than us include devastating wealth inequality, job loss, and the risk of global conflict.
• ☠️ The time horizon argument for AI safety is flawed, as the rate of progress doesn't dictate when we will achieve super intelligence.

Questions & Answers

Q: What is the main concern with the development of super intelligent AI?

The concern is that we will build machines that are so much more competent than us that even a slight divergence in goals could be catastrophic for humanity.

Q: Can we prevent the development of artificial general intelligence without stopping all technological progress?

While it might be possible to stop the development of AI specifically, it is unlikely as long as there is a demand for progress in technology. Stopping all technological progress would be extremely difficult.

Q: Are machines becoming spontaneously malevolent a likely scenario?

No, the concern lies in building machines that are more competent than humans, whose goals may not align with our own, leading to potential unintended consequences.

Q: How does intelligence relate to information processing?

Intelligence is seen as a product of information processing. As long as we continue improving our machines and building more intelligent systems, we will eventually achieve artificial general intelligence.

Summary & Key Takeaways

• Sam Harris discusses the failure of intuition to detect the dangers of super intelligent AI and how our lack of emotional response to the risks is concerning.

• He discusses the potential scenarios of either halting technological progress or continuing to improve intelligent machines, leading to the risk of an intelligence explosion.

• Harris highlights the dangers of machines surpassing human intelligence and the potential consequences for humanity.