Thread Subject: loading large datasets

Subject: loading large datasets

From: Paul

Date: 16 Jan, 2009 02:10:05

Message: 1 of 2

It would be nice to have some kind of indicator to show the progress of the load command. No problem for small files, which only takes a seconds, but when there is a lot of data it would be reassuring to see a progress bar.

If this is not possible, then why is it possible when moving files, say when you click and drag on Windows machine.

Subject: loading large datasets

From: Rune Allnor

Date: 16 Jan, 2009 11:55:57

Message: 2 of 2

On 16 Jan, 03:10, "Paul" <p...@ceri.memphis.edu> wrote:
> It would be nice to have some kind of indicator to show the progress of t=
he load command. =A0No problem for small files, which only takes a seconds,=
 but when there is a lot of data it would be reassuring to see a progress b=
ar. =A0
>
> If this is not possible, then why is it possible when moving files, say w=
hen you click and drag on =A0Windows machine.

Assuming there is a progress bar available with the
matlab GUI components (there was a post some weeks ago
complaining about some 'trivial' component missing from
the matlab component kit) this is possible. But you
might have to implement the tool yourself.

On the command line you can print a status message
every N'th line. It will become a bit cluttered,
but is possible.

But the fact of the matter is that text files take a
long time to load. Expect 50 - 100 seconds per 100 MBytes
of data, depending on system parameters and what parsing
of the data is done wile reading them.

Rune

Tags for this Thread

Everyone's Tags:

Add a New Tag:

Separated by commas
Ex.: root locus, bode

What are tags?

A tag is like a keyword or category label associated with each thread. Tags make it easier for you to find threads of interest.

Anyone can tag a thread. Tags are public and visible to everyone.

Tag Activity for This Thread
Tag Applied By Date/Time
load Godzilla 15 Jan, 2009 21:15:23
progress bar Godzilla 15 Jan, 2009 21:15:23
timing Godzilla 15 Jan, 2009 21:15:23
rssFeed for this Thread
 

MATLAB Central Terms of Use

NOTICE: Any content you submit to MATLAB Central, including personal information, is not subject to the protections which may be afforded information collected under other sections of The MathWorks, Inc. Web site. You are entirely responsible for all content that you upload, post, e-mail, transmit or otherwise make available via MATLAB Central. The MathWorks does not control the content posted by visitors to MATLAB Central and, does not guarantee the accuracy, integrity, or quality of such content. Under no circumstances will The MathWorks be liable in any way for any content not authored by The MathWorks, or any loss or damage of any kind incurred as a result of the use of any content posted, e-mailed, transmitted or otherwise made available via MATLAB Central. Read the complete Terms prior to use.

Contact us at files@mathworks.com