Read large CSV file in column and save each column in mat file

This is a draft to help you for transferring large CSV file or dat file into mat file

Description

We all feel headache about importing large data into matlab which may cause 'out of memory' problem. Since large CSV data usually stored in columns or rows, we can read CSV file column by column or row by row.

csvscan.m is a simple draft but work well for unlimited size of csv file, if each column data does not surpass the memory limitation. In my case, I have loaded 500M Bytes CSV file in 34 separated mat files. Hope it can help you.

• Required Products: MATLAB
• MATLAB release: MATLAB 7.9 (R2009b)

[per isakson]

I think

eval(['save',' ', filename,' ', 'dataarray']);

may be replaced by

save( filename, 'dataarray' )