Students Create 'JediBot' | Summary and Q&A

Summary

In this video, the speaker discusses the development of a robot that can engage in swordfighting with a human opponent. The inspiration for this project comes from the entertaining sword fights seen in the Star Wars movies. The robot is programmed to swing its sword in a series of attack motions and recoils when it hits the human's sword. The challenge lies in getting the robot to understand the human's movements and react accordingly. The team uses a Microsoft Kinect to sense the position of the human's sword and isolate it from the background using color detection. The speaker emphasizes the excitement of seeing their programming come to life through physical hardware.

Questions & Answers

Q: What was the inspiration behind developing a robot that can swordfight?

The inspiration for developing a robot that can swordfight came from the entertaining sword fights seen in the Star Wars movies. The ability to engage in sword fighting against a computerized opponent, like in Star Wars video games, seemed like a cool concept.

Q: How does the robot swing its sword and react to the human opponent's moves?

The robot swings its sword using a series of predefined attack motions. When it detects hitting the human opponent's sword, it recoils and moves on to the next attack motion. It can execute a swing every two to three seconds, requiring the human opponent to be on their toes and ready to block it.

Q: How does the robot understand the human opponent's moves?

Understanding the human opponent's moves is a challenge in this project. The first step is sensing the position of the human's sword. The team uses a Microsoft Kinect to accomplish this, as it can detect points in 3D. By isolating the color image of the opponent's sword (green) from the background, they can track its movement accurately.

Q: Can you provide more details about the sensing process using the Microsoft Kinect?

The team utilizes the Microsoft Kinect for its sensing capabilities. It can detect points in 3D, allowing them to determine the position of the human opponent's sword accurately. They also use the color image from the Kinect to isolate the green color of the opponent's sword from the background. This helps in tracking the sword's movement.

Q: How does it feel when the robot swings its sword towards you?

When the robot swings its sword towards the human opponent, it feels quite real. The swords coming at you create a sense of realism, and the opponent must be swift in blocking the attacks. The sensation of having a sword swung at you by a robot adds to the overall experience.

Q: What did you observe at a recent conference in Shanghai regarding robot fencing?

The speaker mentions attending a conference in Shanghai where a company showcased two robots engaging in fencing. He points out that this task was easier for the robots because they knew exactly what the other robot was doing. The challenge lies in getting a robot to understand and react to a human opponent's moves.

Q: What is the main challenge in this project?

The main challenge in this project is getting the robot to understand and react to the human opponent's moves. Unlike robot fencing, where both robots know what the other is doing, the challenge here is equipping the robot with the ability to comprehend and respond to the human's sword movements accurately.

Q: How does the robot determine the best position to block a human's attack?

The robot uses a defense mode where it tries to find the best position to block the human opponent's attack. This involves analyzing the human's movements and positioning itself in a way that effectively prevents the attack from landing. By understanding the human's intent, the robot can determine the optimal position to block.

Q: How do you ensure the accuracy of the robot's movements?

The accuracy of the robot's movements is ensured through the use of the Microsoft Kinect for sensing the human opponent's sword. By detecting points in 3D and isolating the color image of the sword from the background, the team can track the sword's movement accurately, allowing the robot to respond accordingly.

Q: What is the significance of working with physical hardware in this project?

Working with physical hardware, as opposed to just programming simulations, adds an exciting dimension to the project. Being able to see the results of their programming running on physical hardware brings a sense of fulfillment and validates their efforts. It provides a valuable hands-on experience in working with robotics and hardware development.

Takeaways (in one paragraph)

This video showcases the development of a robot capable of engaging in swordfighting with a human opponent. Inspired by the sword fights in the Star Wars movies, the team has programmed the robot to swing its sword using predefined attack motions and react to hits from the human opponent by recoiling and transitioning to the next attack motion. The challenge lies in getting the robot to understand and react to the human's sword movements, which is achieved through the use of a Microsoft Kinect for sensing. This project demonstrates the excitement of working with physical hardware and provides valuable hands-on experience in the field of robotics.