Collaborative Q(lambda) reinforcement learning algorithm - A promising robot learning framework

U Kartoun, H Stem, Y Edan, C Feied, J Handler, M Smith, M Gillam

Research output: Chapter in Book/Report/Conference proceedingChapterpeer-review

Abstract

This paper presents the design and implementation of a new reinforcement learning (RL) based algorithm. The proposed algorithm, CQ(λ) (collaborative Q(λ) ) allows several learning agents to acquire knowledge from each other. Acquiring knowledge learnt by an agent via collaboration with another agent enables acceleration of the entire learning system; therefore, learning can be utilized more efficiently. By developing collaborative learning algorithms, a learning task solution can be achieved significantly faster if performed by a single agent only, namely the number of learning episodes to solve a task is reduced. The proposed algorithm proved to accelerate learning in navigation robotic problem. The CQ(λ) algorithm was applied to autonomous mobile
robot navigation where several robot agents serve as learning processes. Robots learned to navigate an 11 x 11 world contains obstacles and boundaries choosing the optimum path to reach a target. Simulated experiments based on 50 learning episodes showed an average improvement of 17.02% while measuring the number of learning steps required reaching definite optimality and an average improvement of 32.98% for convergence to near
optimality by using two robots compared with the Q(λ) algorithm [1, 2].
Original languageEnglish
Title of host publicationPROCEEDINGS OF THE SIXTH IASTED INTERNATIONAL CONFERENCE ON ROBOTICS AND APPLICATIONS
Pages13-19
StatePublished - 2005

Keywords

  • robot simulation
  • reinforcement learning
  • and navigation

Fingerprint

Dive into the research topics of 'Collaborative Q(lambda) reinforcement learning algorithm - A promising robot learning framework'. Together they form a unique fingerprint.

Cite this