loading large datasets

Paul — Fri, 16 Jan 2009 02:10:05 -0500

It would be nice to have some kind of indicator to show the progress of the load command. No problem for small files, which only takes a seconds, but when there is a lot of data it would be reassuring to see a progress bar.

If this is not possible, then why is it possible when moving files, say when you click and drag on Windows machine.

Re: loading large datasets

Rune Allnor — Fri, 16 Jan 2009 11:55:57 -0500

On 16 Jan, 03:10, "Paul" <p...@ceri.memphis.edu> wrote:
> It would be nice to have some kind of indicator to show the progress of t=
he load command. =A0No problem for small files, which only takes a seconds,=
but when there is a lot of data it would be reassuring to see a progress b=
ar. =A0
>
> If this is not possible, then why is it possible when moving files, say w=
hen you click and drag on =A0Windows machine.

Assuming there is a progress bar available with the
matlab GUI components (there was a post some weeks ago
complaining about some 'trivial' component missing from
the matlab component kit) this is possible. But you
might have to implement the tool yourself.

On the command line you can print a status message
every N'th line. It will become a bit cluttered,
but is possible.

But the fact of the matter is that text files take a
long time to load. Expect 50 - 100 seconds per 100 MBytes
of data, depending on system parameters and what parsing
of the data is done wile reading them.

Rune

MATLAB Central Newsreader - loading large datasets

loading large datasets

Re: loading large datasets