Researchers from Pennsylvania, New York University, and collaborators have developed a system which enables users to control a drone with their eyes.
The deep learning system uses NVIDIA GPUs to facilitate in flight drone control by a pilot directing their eyes in the direction they want the drone to travel.
The footage shows a drone pilot demonstrating how the system works.
In the footage, the researcher said: “We show how a set of glasses equipped with gaze tracker, a camera, and an Inertial Measurement Unit (IMU) can be used to estimate the relative position of the human with respect to a quadrotor, decouple the gaze direction from the head orientation, and allow the human spatially task the robot in an uninstrumented environment.”
Watch the video here: