Comma.ai Drive and Tour with George Hotz and Lex Fridman

TL;DR

George Hearts gives a demo of the comma two self-driving system and provides a tour of the comma.ai offices in San Diego. The company is impressive, and the demo showcases the capabilities of their system.

Transcript

george hearts gave me a demo of the comma two on a right back to the comma ai offices in san diego then we took a quick tour of the office i found both the comma two system and the entire comma ai team and operation very impressive plus i got a 3d printer named after me as one robot to another we're in this together my brother and now on to the rid... Read More

Key Insights

• 🎨 The comma two system is designed for highway driving, providing a nearly disengagement-free experience during long trips.
• 👥 The comma.ai team has put significant effort into achieving smooth and safe driving by focusing on both longitudinal and lateral control.
• ✈️ The system can handle lane changes and curves effectively, even on roads without lane markings.
• 📆 The comma two system relies on end-to-end processing, which allows for more comprehensive and robust self-driving capabilities.
• 🏦 The effectiveness of the system is demonstrated on curvy and banked roads, showcasing its advanced capabilities.
• ✈️ Comma.ai is focused on continuous improvement and plans to move to Open Pilot 1.0 with future updates.
• 👨‍💼 The comma.ai offices house a dedicated team working on various aspects, including hardware retrofitting, software development, and machine learning.

Questions & Answers

Q: How does the comma two system enable self-driving on highways?

The comma two system utilizes advanced longitudinal and lateral control, taking into account curves, lane changes, and more. It can handle highways effectively.

Q: Can the comma two system operate without perfect lane markings?

Yes, the comma two system can do lane changes on roads without lane markings, as it relies on end-to-end processing and not just lane lines.

Q: What is the main advantage of using the comma two system?

The comma two system is most enjoyable during long trips, providing a nearly disengagement-free driving experience. It excels in highways and can handle two-hour drives easily.

Q: How does the comma two system handle city streets?

Without end-to-end longitudinal control, the comma two system is not as useful on city streets. However, it can still navigate city intersections and disengage smoothly when necessary.

Key Insights:

• The comma two system is designed for highway driving, providing a nearly disengagement-free experience during long trips.
• The comma.ai team has put significant effort into achieving smooth and safe driving by focusing on both longitudinal and lateral control.
• The system can handle lane changes and curves effectively, even on roads without lane markings.
• The comma two system relies on end-to-end processing, which allows for more comprehensive and robust self-driving capabilities.
• The effectiveness of the system is demonstrated on curvy and banked roads, showcasing its advanced capabilities.
• Comma.ai is focused on continuous improvement and plans to move to Open Pilot 1.0 with future updates.
• The comma.ai offices house a dedicated team working on various aspects, including hardware retrofitting, software development, and machine learning.
• The company has a significant user base, with millions of miles driven using their system.

Summary

In this video, George gives a demo of the comma two system and takes a tour of the Comma AI offices in San Diego. They discuss various features and capabilities of the comma two system, including its ability to enable cruise control and perform lane changes on roads without lane markings. They also talk about open pilot 1.0 and its integration with the comma two hardware. The video provides insights into the development process, challenges, and future goals of Comma AI.

Questions & Answers

Q: How do you enable the comma two system?

To enable the comma two system, you can use the cruise control feature, which is controlled by the integrated knobs on the car. By enabling it, you can experience the system's capabilities and test its performance on the road.

Q: Can the comma two system handle red lights and stop signs?

Currently, the comma two system doesn't have the capability to handle red lights and stop signs. The goal is to have a complete, end-to-end system that can handle all aspects of driving, including stopping at stop signs. The system is continuously being developed to achieve this holistic functionality.

Q: How does the comma two system perform on roads with mediocre quality and lane markings?

Like the rest of California, the quality of roads and lane markings in San Diego is pretty mediocre. However, the comma two system doesn't require perfect lane markings to function properly. In fact, it can even perform lane changes on roads without lane markings, thanks to its end-to-end approach. The system is designed to adapt to various road conditions and markings.

Q: What is the favorite reason for using comma two?

The most joyful experience with the comma two system is during long trips. For example, driving from San Diego to LA can be done without any disengagements. It allows you to sit back, relax, and enjoy the journey while the system handles the driving. It's a convenient and enjoyable way to travel long distances.

Q: Is perfect lane marking necessary for the comma two system to function?

No, perfect lane marking is not necessary for the comma two system to function. It utilizes an end-to-end approach, which means it can do lane changes on roads without lane markings. The system relies on its comprehensive model and capabilities to navigate and drive safely, even on roads with imperfect lane markings.

Q: How hard is it to achieve smooth driving with the comma two system?

Achieving smooth driving with the comma two system requires years of engineering work and refinement. The system's end-to-end approach involves detecting lane lines and using them as reference points to make driving decisions. However, it also requires careful tuning and fine-tuning of the system's policies to ensure smooth acceleration, braking, and turning. It's a challenging process that involves extensive testing and optimization.

Q: What is the difference between longitudinal and lateral control in the comma two system?

Longitudinal control refers to the system's ability to control the vehicle's speed and acceleration/deceleration. In the context of the comma two system, the longitudinal control is handled by the car itself, specifically by the Hyundai ACC. On the other hand, lateral control involves handling the vehicle's position within the lanes and making steering decisions. The comma two system's lateral control is handled by Comma AI's policies, which ensure smooth and accurate lane keeping, lane changes, and overall navigation.

Q: How does the comma two system handle challenging road conditions, such as curvy and banked roads?

The comma two system is designed to handle challenging road conditions, including curvy and banked roads. Traditional car companies have competent longitudinal control, but the subtlety required for lateral control is where the comma two system shines. It can accurately detect and adjust to road curves, bankings, and other complex features. By having a comprehensive model and well-designed policies, the system can navigate such roads with confidence, providing a smooth and safe driving experience.

Q: How does comma two compare to other systems like Super Cruise and Autopilot?

Comma two system, Autopilot, and Super Cruise are all level two autonomous driving systems. However, each system has its strengths and limitations. Super Cruise, for example, may not be able to handle certain road conditions that comma two and Autopilot can handle. Autopilot performs well in terms of roll on the road, but comma two's end-to-end approach allows for smoother and more holistic driving experiences. It's important to consider the specific capabilities and limitations of each system when choosing the suitable one for your needs.

Q: What are the challenges in developing and achieving smooth driving with the comma two system?

Developing and achieving smooth driving with the comma two system involves various challenges. For example, the development of the longitudinal policy requires competent ACC capabilities, which are currently provided by Hyundai. However, lateral control, handled by Comma AI, is more nuanced and requires extensive work in modeling and fine-tuning to achieve smooth and precise driving. The team at Comma AI has invested years of engineering and refinement to overcome these challenges and deliver a high-quality driving experience.

Q: How does Comma AI ensure the safety and reliability of the comma two system?

Comma AI is committed to ensuring the safety and reliability of the comma two system. The system has a torque limit that is lower than Teslas, which means it can't make any sudden or dangerous moves. To test the system's safety, Comma AI performs injection tests where one person sits in the car with a joystick, and another person keeps their hands off the wheel. The test person can freely maneuver the joystick in any direction during the test, ensuring that the system can handle unexpected moves and keep the ride safe.

Takeaways

In summary, the video provides a glimpse into the development and capabilities of the comma two system by Comma AI. The system excels in providing a smooth and enjoyable driving experience, particularly on long trips. It can handle various road conditions, including those with mediocre quality and imperfect lane markings. Challenges in achieving smooth driving are overcome through years of engineering work and fine-tuning. The comma two system is designed with an end-to-end approach that allows for comprehensive navigation and handling of complex road features. Safety and reliability are top priorities for Comma AI, and the system undergoes rigorous testing to ensure its performance and safety on the road.

Summary & Key Takeaways

• George Hearts demonstrates the capabilities of the comma two self-driving system and takes the viewer on a tour of the comma.ai offices in San Diego.

• The comma two system is designed for highways and can handle lane changes and curves effectively.

• The comma.ai team has put a lot of engineering effort into achieving smooth and safe driving experience.