Autonomous Drone Flight Over 1 Kilometer Forest Trail

By: Nikolai Smolyanskiy

25   1   5718

Uploaded on 05/28/2017

This video demonstrates our autonomous navigation system for drones and mobile robotics. The system uses Deep Neural Network for visual perception and path finding. This video features a world record 1 kilometer autonomous drone flight over a forest trail (visual navigation only, no GPS, no maps). It was presented at GTC 2017 conference (session #S7172).

This video accompanies our paper:
"Toward Low-Flying Autonomous MAV Trail Navigation using Deep Neural Networks for Environmental Awareness".
Arxiv pre-print: arXiv:1705.02550 [cs.RO] :

Abstract - We present a micro aerial vehicle (MAV) system, built with inexpensive off-the-shelf hardware, for autonomously following trails in unstructured, outdoor environments such as forests. The system introduces a deep neural network (DNN) called TrailNet for estimating the view orientation and lateral offset of the MAV with respect to the trail center. The DNN utilizes a novel application of transfer learning, and it achieves stable flight without oscillations by avoiding overconfident behavior through a loss function that includes both label smoothing and entropy reward. In addition to the TrailNet DNN, the system also utilizes vision modules for environmental awareness, including another DNN for object detection and a visual odometry component for estimating depth for the purpose of low-level obstacle detection. All vision systems run in real time on board the MAV via a Jetson TX1. We provide details on the hardware and software used, as well as implementation details. We present experiments showing the ability of our system to navigate forest trails more robustly than previous techniques, including autonomous flights of 1 km.

Comments (1):

By bigiain    2018-08-10

This is quite impressive:

And it's solving a somewhat harder problem - it's done with no maps apart from what it's generating in real time.

Original Thread

Submit Your Video

If you have some great dev videos to share, please fill out this form.