Home Earth changes Atmosphere The novel study applies reinforcement learning to set a course toward artificial...

The novel study applies reinforcement learning to set a course toward artificial intelligence — ScienceDaily


The words “fly like an eagle” are famously part of a song, but they may also be words that make some scientists scratch their heads. Especially when it comes to soaring birds like eagles, falcons and hawks, who seem to ascend to great heights over hills, canyons and mountain tops with ease. Scientists realize that upward currents of warm air assist the birds in their flight, but they don’t know how the birds find and navigate these thermal plumes.

To figure it out, researchers from the University of California San Diego used reinforcement learning to train gliders to autonomously navigate atmospheric thermals, soaring to heights of 700 meters–nearly 2,300 feet. The novel research results, published in the Sept. 19 issue of Nature, highlight the role of vertical wind accelerations and roll-wise torques as viable biological cues for soaring birds. The findings also provide a navigational strategy that directly applies to the development of autonomous soaring vehicles, or unmanned aerial vehicles (UAVs).

“This paper is an important step toward artificial intelligence–how to autonomously soar in constantly shifting thermals like a bird. I was surprised that relatively little learning was needed to achieve expert performance,” said Terry Sejnowski, a member of the research team from the Salk Institute for Biological Studies and UC San Diego’s Division of Biological Sciences.

Reinforcement learning is an area of machine learning, inspired by behavioral psychology, whereby an agent learns how to behave in an environment based on performed actions and the results. According to UC San Diego Department of Physics Professor Massimo Vergassola and PhD candidate Gautam Reddy, it offers an appropriate framework to identify an effective navigational strategy as a sequence of decisions taken in response to environmental cues.

“We establish the validity of our learned flight policy through field experiments, numerical simulations and estimates of the noise in measurements that is unavoidably present due to atmospheric turbulence,” explained Vergassola. “This is a novel instance of learning a navigational task in the field, where learning is severely challenged by a multitude of physical effects and the unpredictability of the natural environment.”

In the study, conducted collaboratively with the UC San Diego Division of Biological Sciences, the Salk Institute and the Abdus Salam International Center for Theoretical Physics in Trieste, Italy, the team equipped two-meter wingspan gliders with a flight controller. The device enabled on-board implementation of autonomous flight policies via precise control over bank angle and pitch. A navigational strategy was determined solely from the gliders’ pooled experiences collected over several days in the field using exploratory behavioral strategies. The strategies relied on new on-board methods, developed in the course of the research, to accurately estimate the gliders’ local vertical wind accelerations and the roll-wise torques, which served as navigational cues.

The scientists’ methodology involved estimating the vertical wind acceleration, the vertical wind velocity gradients across the gliders’ wings, designing the learning module, learning the thermalling strategy in the field, testing the performance of the learned policy in the field, testing the performance for different wingspans in simulations and estimating the noise in gradient sensing due to atmospheric turbulence.

“Our results highlight the role of vertical wind accelerations and roll-wise torques as viable biological mechanosensory cues for soaring birds, and provide a navigational strategy that is directly applicable to the development of autonomous soaring vehicles,” said Vergassola.

 

Story Source:

Materials provided by University of California – San Diego. Note: Content may be edited for style and length.



Source link

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Must Read

Use Water Purifiers To Stay Fit And Healthy

Different people have different choices; some go to the office for work while some choose to stay at home and do work. Housewives on...

ENERGY STAR Builders

To become a qualified ENERGY STAR builder, a builder must construct a home that meets energy efficiency guidelines set by the U.S. Environmental Protection...

Wind Power – The Ideal Power Source

Wind power: Nature and OriginThe solar radiations give birth to wind. These radiations heat up the surface of the planet earth, although in unequal...

Integration of Energy

Have you ever thought much about this word and what it may mean at a deeper level? Well let us explore then and begin...

Top 5 Places Women Lose Their Engagement Rings

Once you purchase the perfect engagement ring, you would hope that it will never leave her finger. This is where you are probably wrong....
Support