Rank: 52850 based on 0 downloads (last 30 days) and 0 files submitted
photo

Sergio

E-mail

Personal Profile:
Professional Interests:

 

Watch this Author's files

 

Comments and Ratings by Sergio View all
Updated File Comments Rating
20 Feb 2012 Bindings to Course Coding (tile coding) for Reinfocement Learning. Matlab bindings to C code for Course Coding. Author: Nick Birnie

I have followed these instructions to surmount the gcc version: http://askubuntu.com/questions/75012/how-do-i-install-gcc-4-3

But running in Matlab:

variables = 0.25*ones(4,1);
numTilings = 32;
memorySize = 4^4*numTilings;
tiles = getTiles(variables, numTilings, memorySize)

it outuputs this error:
??? Attempted to access getTiles__rndseq__(449); index out of bounds because
numel(getTiles__rndseq__)=1.

Error in ==> getTiles>hashCoordinates at 70
    sum = sum + getTiles__rndseq__(floor(index));

Error in ==> getTiles at 50
    tiles(i) = hashCoordinates(coordinates,memorySize);

Indeed getTiles__rndseq__is a scalar equal -1.4845e+09.

Does it make any sense?

20 Feb 2012 Bindings to Course Coding (tile coding) for Reinfocement Learning. Matlab bindings to C code for Course Coding. Author: Nick Birnie

Hi, I am sorry, but I have not figured how to use your Tile Coding functions. I am able to compile the c file and get the mexa64.

However I do not understand well how to use it. I am lacking some understanding of the input variables.

For instance, where do I set the width of the tiles, perhaps indirectly based on the number of tilings and the total number of tiles?
Where do I set the range of values to grid?
Can I set the displacement vector?
How can avoid hashing if my system is plenty of memory but I want to increase speed?

Thank you very much in advance!!!

22 Mar 2011 Graph adjacency matrix to incidence matrix Conversion from graph adjacency matrix to incidence matrix. Author: Ondrej

Oops! Forget my latter question :-)

22 Mar 2011 Graph adjacency matrix to incidence matrix Conversion from graph adjacency matrix to incidence matrix. Author: Ondrej

Please, how could I modify it in order to contain +1 and -1 instead of only logical values? Thanks!

Contact us at files@mathworks.com