Robots learning to walk | Risto Miikkulainen and Lex Fridman

TL;DR

Evolution computation and reinforcement learning are both fascinating approaches to teaching robots to walk, with evolutionary computation allowing for more exploration and discovery.

Transcript

there's very few things as entertaining as watching either evolution computation or reinforcement learning teaching a simulated robot to walk i maybe there's a higher level question that could be asked here but do you find this whole space in of applications in the robotics interesting for evolution computation yeah yeah very much um and indeed tha... Read More

Key Insights

• 👻 Evolutionary computation in robotics allows for exploration and discovery, even of seemingly unconventional solutions.
• ✳️ Reinforcement learning prioritizes stability and conservatism, while evolutionary computation embraces risk and experimentation.
• 🙈 The field of robotics sees learning to walk as a challenging yet beautiful endeavor, requiring faith, patience, and a deep understanding of movement.

Questions & Answers

Q: What is the main difference between evolution computation and reinforcement learning in teaching robots to walk?

The main difference lies in their approach to exploration and optimization. Reinforcement learning agents are conservative and prioritize stability, while evolutionary computation allows for more exploration and discovery by affording agents that go haywire.

Q: How does evolutionary computation enable incremental discovery?

Evolutionary computation allows for the exploration of various approaches, even those that may seem like dead ends. These so-called dead ends can serve as stepping stones, eventually leading to the discovery of a better solution when combined.

Q: Why is learning to walk considered fascinating in the field of robotics?

Learning to walk is both beautiful and dangerous in the realm of robotics. It requires overcoming the constant challenge of maintaining balance and elegant movement. The discovery of a good solution often necessitates a leap of faith, patience, and a deep understanding of movement.

Q: What is an interesting direction for learning in virtual creatures?

A fascinating direction is the study of learning to walk in virtual creatures, where both the controller and the body are evolved simultaneously. This approach results in movements that appear natural and optimized for the physical setup of the creature, creating a sense of aliveness.

Summary & Key Takeaways

• Evolution computation and reinforcement learning are two different approaches to teaching robots to walk.

• Reinforcement learning agents tend to be conservative and prioritize stability, while evolutionary computation agents can afford to take risks and explore different strategies.

• Evolutionary computation allows for incremental discovery and can result in natural-looking movements in virtual creatures.