Rank: 4132 based on 28 downloads (last 30 days) and 2 files submitted
photo

Nick Birnie

E-mail

Personal Profile:

 

Watch this Author's files

 

Files Posted by Nick Birnie View all
Updated   File Tags Downloads
(last 30 days)
Comments Rating
06 Sep 2011 TIle Coding (CMAC) for reinforcement learning Linear tile coding function approximation based on CMAC algorithm Author: Nick Birnie course coding, discretisation, feature space, function approximatio..., reinforcement learnin..., state abstraction 20 0
  • 4.0
4.0 | 1 rating
19 Jul 2011 Bindings to Course Coding (tile coding) for Reinfocement Learning. Matlab bindings to C code for Course Coding. Author: Nick Birnie reinforcement learnin..., course coding, tile coding, function approximatio..., feature space, state abstraction 8 2
Comments and Ratings on Nick Birnie's Files View all
Updated File Comment by Comments Rating
07 Mar 2012 TIle Coding (CMAC) for reinforcement learning Linear tile coding function approximation based on CMAC algorithm Author: Nick Birnie Reza Ahmadzadeh

20 Feb 2012 Bindings to Course Coding (tile coding) for Reinfocement Learning. Matlab bindings to C code for Course Coding. Author: Nick Birnie Sergio

I have followed these instructions to surmount the gcc version: http://askubuntu.com/questions/75012/how-do-i-install-gcc-4-3

But running in Matlab:

variables = 0.25*ones(4,1);
numTilings = 32;
memorySize = 4^4*numTilings;
tiles = getTiles(variables, numTilings, memorySize)

it outuputs this error:
??? Attempted to access getTiles__rndseq__(449); index out of bounds because
numel(getTiles__rndseq__)=1.

Error in ==> getTiles>hashCoordinates at 70
sum = sum + getTiles__rndseq__(floor(index));

Error in ==> getTiles at 50
tiles(i) = hashCoordinates(coordinates,memorySize);

Indeed getTiles__rndseq__is a scalar equal -1.4845e+09.

Does it make any sense?

20 Feb 2012 Bindings to Course Coding (tile coding) for Reinfocement Learning. Matlab bindings to C code for Course Coding. Author: Nick Birnie Sergio

Hi, I am sorry, but I have not figured how to use your Tile Coding functions. I am able to compile the c file and get the mexa64.

However I do not understand well how to use it. I am lacking some understanding of the input variables.

For instance, where do I set the width of the tiles, perhaps indirectly based on the number of tilings and the total number of tiles?
Where do I set the range of values to grid?
Can I set the displacement vector?
How can avoid hashing if my system is plenty of memory but I want to increase speed?

Thank you very much in advance!!!

Contact us