MIT Human-Centered Autonomous Vehicle

TL;DR

This video showcases a human-centered approach to autonomous driving, highlighting the transfer of control between humans and machines based on the driver's attention to the road, and also demonstrates tweeting from an autonomous vehicle.

Transcript

this is the human center autonomous vehicle one of the main ideas underlying our work is that solving the task of autonomous driving is more complicated and more fascinating than the strictly robotics challenges of localization mapping perception control and planning you also have to enable the vehicle to perceive predict communicate and collaborat... Read More

Key Insights

• 🚙 Solving autonomous driving requires considering the human element and enabling the vehicle to perceive, predict, communicate, and collaborate with humans.
• 🚙 The autonomous vehicle's perception system is vision-based, utilizing neural networks for road segmentation and object detection.
• 🕵️ Transfer of control from human to machine is based on the driver's attention to the road, detected through glance region classification.
• 🚙 Safety is a top priority, with a safety driver in the car and the ability to stop the vehicle instantly.
• 🥡 The autonomous vehicle can perform tasks such as tweeting while the machine takes control of driving.
• 😤 The demonstration takes place on a test track with team members acting as pedestrians and other vehicles.
• ✋ High-level planning decisions to transfer control or stop the vehicle are made through a decision fusion algorithm.

Questions & Answers

Q: How does the autonomous vehicle transfer control from human to machine?

The transfer of control is based on whether the driver is paying attention to the road or not. If the driver is distracted, the machine takes over the steering and braking of the vehicle.

Q: What safety measures are in place during the demonstration?

There is another safety driver in the car who can stop the vehicle at any moment by pressing a single button. Additionally, the demonstration takes place on a test track with vehicles and pedestrians who are part of the team.

Q: What algorithms are used for perception and planning in the autonomous vehicle?

The perception system uses two neural networks for road segmentation and object detection. High-level planning decisions are made using a decision fusion algorithm that considers risk factors in the environment and the driver's state.

Q: Can the autonomous vehicle perform tasks other than driving?

Yes, the video demonstrates the ability to send a tweet from the autonomous vehicle. The machine takes control of the steering and braking while the driver engages in the distracting activity.

Key Insights:

• Solving autonomous driving requires considering the human element and enabling the vehicle to perceive, predict, communicate, and collaborate with humans.
• The autonomous vehicle's perception system is vision-based, utilizing neural networks for road segmentation and object detection.
• Transfer of control from human to machine is based on the driver's attention to the road, detected through glance region classification.
• Safety is a top priority, with a safety driver in the car and the ability to stop the vehicle instantly.
• The autonomous vehicle can perform tasks such as tweeting while the machine takes control of driving.
• The demonstration takes place on a test track with team members acting as pedestrians and other vehicles.
• High-level planning decisions to transfer control or stop the vehicle are made through a decision fusion algorithm.
• The ultimate mission of the team is to save lives through effective human-robot collaboration.

Summary & Key Takeaways

• Solving the task of autonomous driving involves challenges beyond robotics, including enabling vehicles to interact with human beings both inside and outside the car.

• The video showcases a voice-based transfer of control from human to machine based on the driver's attention to the road, using cameras to monitor the driver's face and body.

• The perception system is vision-based, utilizing neural networks for road segmentation and object detection.