Info

This question is closed. Reopen it to edit or answer.

How to process a large file

1 view (last 30 days)
Xiaofeng Fan
Xiaofeng Fan on 7 Dec 2016
Closed: MATLAB Answer Bot on 20 Aug 2021
I need to process a csv file with 280,000,000 rows and 4 columns for each row. It seemed that I cannot even import the whole file using csvread at a time. So should I divide it into pieces or anyone knows a better solution? Thanks.

Answers (2)

Steven Lord
Steven Lord on 8 Dec 2016
Find the equivalent of this documentation page in your locally installed documentation.
This area of functionality has been changing rapidly over the past several releases. The version of that documentation page included in your installation will list exactly the functions and functionality available in the release you're using. That list may be different from those available in the current release.

KSSV
KSSV on 7 Dec 2016
Edited: KSSV on 7 Dec 2016
You can specify the range in csvread. You can read it by chunks. Read the documentation.
You can read the file using xlsread also. In this also you can specify the ranges.
  1 Comment
Xiaofeng Fan
Xiaofeng Fan on 8 Dec 2016
Thanks, I am going to try it now

Products

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!