Structure from Motion Octocopter - Computerphile

TL;DR

A UAV equipped with a still image camera is used for structure from motion 3D reconstruction, allowing for automated planning and execution.

Transcript

what we got here is a uav which we use for d3 3d reconstruction it's an octocopter and has a still image camera on it and here you can see the controls with a live view we're using this system for 3d reconstruction so we are flying up there taking images and from these images we do something that's called structure promotion and basically make a 3d... Read More

Key Insights

• 🎥 UAVs equipped with still image cameras can be used for structure from motion 3D reconstruction.
• ❓ Structure from motion involves finding correspondences between images to extract 3D structure.
• ✈️ The UAV can autonomously plan its flight path to capture more images and improve the 3D reconstruction.
• 🪡 Different structures, such as smooth surfaces and vegetation, need to be treated differently for better reconstruction.
• 😥 The system is semi-autonomous, with a human operator supervising the flight and intervention possible at any point.
• 🏘️ The software used for the 3D reconstruction and flight planning is developed in-house.
• 🏗️ The system can be trained for different tasks, such as reconstructing construction sites or ancient buildings.

Questions & Answers

Q: What is structure from motion?

Structure from motion is a technique that involves finding correspondences between salient points in images taken from different positions, allowing for the extraction of 3D structure.

Q: How is UAV used for 3D reconstruction?

The UAV flies to different positions, captures images, and updates the 3D reconstruction with the information obtained. It can autonomously plan its flight path to ensure complete coverage of the scene.

Q: How does the system treat different structures differently?

The system learns through a program on how to treat different structures. For example, it may handle smooth surfaces differently from high frequency structures, like vegetation, to improve the quality of the 3D reconstruction.

Q: Is the UAV fully autonomous?

The UAV is semi-autonomous, as a human operator supervises the flight and can intervene at any point. However, the planning and execution of the flight and 3D reconstruction is done automatically by the system.

Summary & Key Takeaways

• The UAV is equipped with a still image camera and is used for structure from motion 3D reconstruction.

• The system uses salient points in the images to find correspondences and extract 3D structure.

• The UAV can autonomously plan its flight path to capture more images and improve the 3D reconstruction.