How to read excel files in chunk?
Show older comments
I do not want to load the whole excel file in the environment to save memory. I know in can be done with pandas in python. Any way to implement the same thing in matlab?
2 Comments
See datastore or similar.
ds = tabularTextDatastore(myBigdata, 'ReadSize', 100); % set desired line num
while hasdata(ds)
chunk = read(ds); % reads only 100 rows of original file
% do something
end
dpb
on 2 Feb 2021
tabularTextDatastore is not available for a spreadsheet; a spreadsheetDatastore is required. Could then partition it into n smaller pieces.
Or, one can simply use the 'Range' row numbers wanted with readtable or readmatrix if is numeric data; readcell it otherwise.
Answers (0)
Categories
Find more on Spreadsheets in Help Center and File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!