Read large CSV file in column and save each column in mat file

Version 1.3.0.0 (1.53 KB) by Juan Huo
This is a draft to help you for transferring large CSV file or dat file into mat file
644 Downloads
Updated 4 Jun 2012

View License

We all feel headache about importing large data into matlab which may cause 'out of memory' problem. Since large CSV data usually stored in columns or rows, we can read CSV file column by column or row by row.

csvscan.m is a simple draft but work well for unlimited size of csv file, if each column data does not surpass the memory limitation. In my case, I have loaded 500M Bytes CSV file in 34 separated mat files. Hope it can help you.

Cite As

Juan Huo (2024). Read large CSV file in column and save each column in mat file (https://www.mathworks.com/matlabcentral/fileexchange/36546-read-large-csv-file-in-column-and-save-each-column-in-mat-file), MATLAB Central File Exchange. Retrieved .

MATLAB Release Compatibility
Created with R2009b
Compatible with any release
Platform Compatibility
Windows macOS Linux
Categories
Find more on Large Files and Big Data in Help Center and MATLAB Answers

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!
Version Published Release Notes
1.3.0.0

At the end of each loop, text=[]; and textarray=[] are added to release the memory.

1.0.0.0