MATLAB Answers

FAQ: How can I process a sequence of files?

611 views (last 30 days)
Jan
Jan on 26 Dec 2012
Commented: Walter Roberson on 16 Feb 2020
How can I process a sequence of files?

  3 Comments

Jan
Jan on 26 Dec 2012
This is a tutorial question only! There is no need to answer it and please to not vote for it. This is neither my question nor my answer, but only an example for a nicer, more convenient, more usable FAQ, which is less stuffed with commercials.
Salah Djerouni
Salah Djerouni on 15 Feb 2020
Hi Jan
can i ask you some question because i have a problem for save result in matlab
my probleme is i run matlab with three loops (for...end ) and i want to save the result every change iterataion loop.
if you possible to help me .
thanks Jan
Walter Roberson
Walter Roberson on 16 Feb 2020
Pre-allocate an output array that is at least 3 dimensions, with one dimension being the number of times the first loop will execute, a second dimension being the number of times the second loop will execute, and the third dimension being the number of times the third loop will execute. Then assign to the output according to how many loop iterations you have done.
For example,
Lvals = [-83, 149, -5, 0, -2, 101];
numL = length(Lvals);
output = zeros(7, 3, numL);
for J = 9:17:11
Jidx = round((J-9)/17) + 1;
for K = 1000:500:2000
Kidx = round((K-500)/500);
for Lidx = 1 : numL
L = Lvals(Lidx);
output(Jidx, Kidx, L) = J.^2 + K/7 + sin(L.^3);
end
end
end

Sign in to comment.

Accepted Answer

Jan
Jan on 26 Dec 2012
Edited: Jan on 18 Dec 2018
If the files that you want to process are sequentially numbered, like "file1.txt", "file2.txt", "file3.txt", etc. then you can use SPRINTF or NUM2STR to create the filename and LOAD, IMREAD, FOPEN, etc. to retrieve the data from the file. (Also note the three different ways of building the filename - you can use your favorite way.)
% Read files file1.txt through file20.txt, mat1.mat through mat20.mat
% and image1.jpg through image20.jpg. Files are in the current directory.
folder = cd;
for k = 1:20
matFilename = sprintf('mat%d.mat', k);
matData = load(fullfile(cd, matFilename));
jpgFilename = sprintf('image%d.jpg', k);
imageData = imread(jpgFilename);
textFilename = sprintf('file%d.txt', k);
fid = fopen(fullfile(folder, textFilename), 'rt');
textData = fread(fid);
fclose(fid);
end
In the above code, matData, imageData, and textData will get overwritten each time. You should save them to an array or cell array if you need to use them outside the loop, otherwise use them immediately inside the loop.
If instead you want to process all the files whose name matches a pattern in a directory, you can use DIR to select the files. Note that while this example uses *.jpg as the pattern and IMREAD to read in the data, as with the previous example you could use whatever pattern and file reading function suits your application's needs:
myFolder = 'C:\Documents and Settings\yourUserName\My Documents\My Pictures';
if exist(myFolder, 'dir') ~= 7
Message = sprintf('Error: The following folder does not exist:\n%s', myFolder);
uiwait(warndlg(Message));
return;
end
filePattern = fullfile(myFolder, '*.jpg');
jpegFiles = dir(filePattern);
for k = 1:length(jpegFiles)
baseFileName = jpegFiles(k).name;
fullFileName = fullfile(myFolder, baseFileName);
fprintf('Now reading %s\n', fullFileName);
imageArray = imread(fullFileName);
imshow(imageArray); % Display image.
drawnow; % Force display to update immediately.
end
Or you can try a "File Exchange Pick of the Week": FileExchange: FileFun.
This answer is a modified version of:

  3 Comments

joshua Abam
joshua Abam on 23 Jun 2019
Hi
In follow up of your answer is it possible to apply same to iterations from Genetic algorithm, AS I am currently having challenges of saving the iterations from GA to a single file or each iteration to a seperate file
Thanks
Kind regards
Joshua
Walter Roberson
Walter Roberson on 23 Jun 2019
Each iteration in a separate file could result in hundreds of thousands of files.
persistent fid
if isempty(fid) || isempty(fopen(fid))
fid = fopen('output.txt','wt');
end
fprintf(fid, 'appropriate format', appropriate data) ;
joshua Abam
joshua Abam on 24 Jun 2019
Hi Walter
I seem not to have follow your suggestion can you help by adding some more comments to ease my grap or better still use this example to illustrate it and where best can I possible attached that to a GA code.
function f = gaintobj(x)
f = rastriginsfcn([x(1)-6 x(2)-13]);
f = f + rastriginsfcn([x(3)-3*pi x(4)-5*pi]);
lb = [1 1 -30 -30];
ub = [20 20 70 70];
%%
% Set the integer variables and number of variables.
IntCon = [1 2];
nvar = 4;
%%
% Set options to call the custom output function, and to initially have
% little crossover.
options = optimoptions('ga','OutputFcn',@gaoutputfunround,'CrossoverFraction',0.2);
%%
% For reproducibility, set the random number generator.
rng(10)
%%
% Set the objective function and call the solver.
fun = @gaintobj;
[x,fval] = ga(fun,nvar,[],[],[],[],lb,ub,[],IntCon,options)

Sign in to comment.

More Answers (2)

Sean de Wolski
Sean de Wolski on 31 May 2013

  3 Comments

Jan
Jan on 31 May 2013
Somebody has accepted my answer. This has not been the intention, but of course the FAQ contain only answers worth to be accepted.

Sign in to comment.


Sean de Wolski
Sean de Wolski on 29 Jul 2016
Edited: Sean de Wolski on 29 Jul 2016
In MATLAB R2014b and newer, you can use a datastore to read a sequence of files in a load-analyze-discard manner or in one shot with the readall() command.

  1 Comment

Ismail Qeshta
Ismail Qeshta on 11 Nov 2017
Hi all. Thanks for sharing it. How about if my files are in permutations sequence such as, Data11, Data12, Data 13, etc. Also, what if I would like to plot two different files names within a folder? Regards.

Sign in to comment.

Sign in to answer this question.