Playing AstroDrone. – ESA
NOORDWIJK, The Netherlands, â€” A free ESA app released Friday turns a popular iPhone-controlled â€˜home droneâ€™ into a spacecraft. The augmented reality game lets owners of Parrot AR.Drone quadcopters attempt dockings with a simulated International Space Station while flying their drones for real â€“ in the process helping to improve robotic rendezvous methods.
This new AstroDrone app is part of a scientific crowdsourcing project by ESAâ€™s Advanced Concepts Team, gathering data to teach robots to navigate their environments.
â€œPeople intuitively assess their position and motion in relation to their surroundings in various ways, based on what they see before them,â€ explained team research fellow Guido de Croon.
â€œThis new app lets us crowdsource examples of this process in practice, as a first step to reproducing it with artificial intelligence.
â€œFor ESA, the result could be much more autonomous spacecraft that can reliably manoeuvre, dock or land themselves.â€
Remote-controlled drones were once the province of the military, but technology advances make them accessible now to everybody.
â€œFor ESA, this development opens up completely new ways of involving the public in scientific experiments,â€ noted Leopold Summerer, head of the Advanced Concepts Team. â€œWe can obtain real-life data to train our algorithms in large amounts that would practically be impossible to get in any other way.
The AR.Drone is one example: around half a million have been sold since their introduction by Franceâ€™s Parrot company in 2010. Equipped with two cameras, the midget drone flies on four rotors and can be steered by iPhone or any other iOS device.
â€œWe wanted to carry out robotic crowdsourcing, which meant selecting a robot that the public actually possesses in large numbers,â€ added Guido. â€œThis is indeed a robot that people have at home and play games with, with the imaging capabilities we need.â€
â€œIn addition, the manufacturer has made the source code needed to communicate with the drone open to anyone to develop software.â€
With AstroDrone, the controller places an augmented-reality marker on a real-world feature to serve as the Space Station docking port. The challenge is then to place the drone onto a graphical version of the Station in as rapid but controlled a manner as possible, with bonus points for correct orientation and low speed on final approach.
â€œHere at ESAâ€™s ESTEC technical centre in the Netherlands we happen to have a ceiling-mounted scale model of the Space Station to manoeuvre around â€“ not everyone is so lucky,â€ remarked Guido. â€œBut with AstroDrone anyone can share the same experience.â€
Players are invited to contribute to the experiment via the Internet as they log their scores on the high-score table.
Their inputs will be anonymous, Guido explained: â€œWeâ€™re not interested in the places people are flying in. We will not receive any raw video images or GPS measurements, only the abstract mathematical image features that the drone itself perceives for navigation, along with velocity readings.â€
A three-person team developed the app â€“ Guido worked alongside with Paul Gerke and Ida Sprinkhuizen-Kuyper of Radboud University in the Netherlands.
Versions for other devices are planned as time permits, as well as future levels featuring other space rendezvous scenarios â€“ such as ESAâ€™s Rosetta probe rendezvousing with the 67P/Churyumovâ€“Gerasimenko comet, which takes place for real next year.