.mat files taking a very long time to load
Show older comments
I have a script which needs to work through many large .mat files (all about 17 MB) - one for each day of the years from 2000 to 2019 - and then to do so 120 times for another set of conditions. This takes a very long time if I simply use load() to do so. I have tried converting to .zip files, converting to another version of .mat file (uncompressed with v6 or compressed with v7.3 and using the matfile() function) but to no avail. I have also tried downloading them all once (rather than the 120 times) and saving to a cell array for later access, but the array soon grew too large and matlab crashed.
Is there a faster way to do something like this? Any help would be much appreciated.
4 Comments
Rik
on 12 Jun 2019
You probably can't avoid the slow disk (SSDs are also slow when you compare them to RAM).
The only high-level advice I can give you is to limit the number of times you load the same file as much as you can.
Cole Tamburri
on 12 Jun 2019
Cole Tamburri
on 12 Jun 2019
Answers (0)
Categories
Find more on MATLAB in Help Center and File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!