Institutional Repository [SANDBOX]
Technical University of Crete
EN  |  EL

Search

Browse

My Space

Directed policy search using relevance vector machines

Lagoudakis Michael, Rexakis Ioannis

Simple record

URIhttp://purl.tuc.gr/dl/dias/BF79601B-BFBF-4960-8421-586B6186C225-
Identifierhttps://doi.org/10.1109/ICTAI.2012.13-
Languageen-
Extent8 pagesen
TitleDirected policy search using relevance vector machinesen
CreatorLagoudakis Michaelen
CreatorΛαγουδακης Μιχαηλel
CreatorRexakis Ioannisen
CreatorΡεξακης Ιωαννηςel
Content SummarySeveral recent learning approaches based on approximate policy iteration suggest the use of classifiers for representing policies compactly. The space of possible policies, even under such structured representations, is huge and must be searched carefully to avoid computationally expensive policy simulations (rollouts). In our recent work, we proposed a method for directed exploration of policy space using support vector classifiers, whereby rollouts are directed to states around the boundaries between different action choices indicated by the separating hyper planes in the represented policies. While effective, this method suffers from the growing number of support vectors in the underlying classifiers as the number of training examples increases. In this paper, we propose an alternative method for directed policy search based on relevance vector machines. Relevance vector machines are used both for classification (to represent a policy) and regression (to approximate the corresponding relative action advantage function). Exploiting the internal structure of the regress or, we guide the probing of the state space only to critical areas corresponding to changes of action dominance in the underlying policy. This directed focus on critical parts of the state space iteratively leads to refinement and improvement of the underlying policy and delivers excellent control policies in only a few iterations, while the small number of relevance vectors yields significant computational time savings. We demonstrate the proposed approach and compare it with our previous method on standard reinforcement learning domains.en
Type of ItemΠλήρης Δημοσίευση σε Συνέδριοel
Type of ItemConference Full Paperen
Licensehttp://creativecommons.org/licenses/by/4.0/en
Date of Item2015-11-13-
Date of Publication2012-
SubjectArtificial Intelligenceen
Bibliographic CitationI. Rexakis and M. G. Lagoudakis, “Directed policy search using relevance vector machines," in 2012 IEEE Intern. Conf. Tools Artif. Intel. (ICTAI), pp. 25–32. doi:10.1109/ICTAI.2012.13en

Services

Statistics

 

Copyright © DIAS 2013