MATLAB Central Newsreader - how to save data when using remote cluster

how to save data when using remote cluster

chaosheng — Tue, 03 Nov 2009 22:18:03 -0500

hey, I am trying to save data in a file when I run my job on a remote cluster, but i don't know how to save.
This is the script;

clusterHost = '###.###.###.###';
remoteDataLocation = '/home/Matlab';

sched = findResource('scheduler', 'type', 'generic');

set(sched, 'DataLocation', 'F:\Matlab');
set(sched, 'ClusterMatlabRoot', '/share/apps/mtlb');
set(sched, 'HasSharedFilesystem', false);
set(sched, 'ClusterOsType', 'unix');
set(sched, 'GetJobStateFcn', @sgeGetJobState);
set(sched, 'DestroyJobFcn', @sgeDestroyJob);

set(sched, 'SubmitFcn', {@sgeNonSharedSimpleSubmitFcn, clusterHost, remoteDataLocation});

j = createJob(sched);
set(j, 'FileDependencies', {'test.m'});
t = createTask(j,@test,1);

submit(j);

waitForState(j, 'finished');
results = getAllOutputArguments(j);
celldisp(results)

this is test.m which is in my working directory.

function out = test
x = 1;
y = 2;
save('testSaveData.mat','x','y')
out = x+y;

After I run the script I can get the results as results{1} =3. but I couldn't get the file of testSaveData.mat.

Please help me how to save data. Thank you so much.

Re: how to save data when using remote cluster

Edric M Ellis — Wed, 04 Nov 2009 08:35:09 -0500

"chaosheng " <csudeng@126.com> writes:

> hey, I am trying to save data in a file when I run my job on a remote cluster,
> but i don't know how to save.
>
> This is the script; [...]
>
> this is test.m which is in my working directory.
>
> function out = test
> x = 1;
> y = 2;
> save('testSaveData.mat','x','y')
> out = x+y;
>
> After I run the script I can get the results as results{1} =3. but I couldn't
> get the file of testSaveData.mat.

That will save "testSaveData.mat" into the current directory of the workers,
probably not what you want (since that may be a temporary directory
somewhere). I would recommend putting in a full path to some location shared by
the workers and the client, e.g.

save( '/home/me/data/testSaveData.mat', 'x', 'y' );

or similar.

Cheers,

Edric.

Re: how to save data when using remote cluster

chaosheng — Wed, 04 Nov 2009 17:01:03 -0500

That's good. I fixed that problem. thank you!