MATLAB Answers

GUI Import data: Column names not recognized for large files

2 views (last 30 days)
Timo
Timo on 28 Mar 2018
Edited: Timo on 2 Apr 2018
Version R2017b. When using the GUI: Home->Import data for csv files, I observe that the import data interface does not take over the column headers from the .csv file if the number of columns is large. I tested this with csv files containing 365 columns and 3285 columns. The large file contains copies of the data in the small files. For the first short file,the column names are recognized but not for the second file:
Is this intended or a known bug? I could not find a reference on MATLAB Answers.
Thank you!
  4 Comments
Timo
Timo on 28 Mar 2018
This is a test file which allows recreating the problem. My original files contain private data.

Sign in to comment.

Accepted Answer

Prasanth Sunkara
Prasanth Sunkara on 2 Apr 2018
This behavior is intentional. In order for the import tool to meet performance expectations, it only processes a certain amount of a delimited file to try to find header and variable name information, among other details, and this limit is 1000 columns. Beyond this, the import tool will experience many delays in performance.
Please consider using Datastore for larger data-sets.
-Prasanth
  1 Comment
Timo
Timo on 2 Apr 2018
Thank you for the very clear answer! Not knowing the reason for this behavior might confuse the user though (as it did for me). A pop-up note or similar to inform the user and point to alternatives would be helpful.

Sign in to comment.

More Answers (0)

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!