Path: news.mathworks.com!newsfeed-00.mathworks.com!newsfeed2.dallas1.level3.net!news.level3.com!postnews.google.com!t13g2000yqt.googlegroups.com!not-for-mail
From: Rune Allnor <allnor@tele.ntnu.no>
Newsgroups: comp.soft-sys.matlab
Subject: Re: Script will take far too long..
Date: Tue, 21 Jul 2009 16:56:19 -0700 (PDT)
Organization: http://groups.google.com
Lines: 27
Message-ID: <4fe65105-648f-4e77-9dd4-6a52da136c5f@t13g2000yqt.googlegroups.com>
References: <h454s2$k0u$1@fred.mathworks.com>
NNTP-Posting-Host: 77.17.74.50
Mime-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
X-Trace: posting.google.com 1248220579 10298 127.0.0.1 (21 Jul 2009 23:56:19 GMT)
X-Complaints-To: groups-abuse@google.com
NNTP-Posting-Date: Tue, 21 Jul 2009 23:56:19 +0000 (UTC)
Complaints-To: groups-abuse@google.com
Injection-Info: t13g2000yqt.googlegroups.com; posting-host=77.17.74.50; 
	posting-account=VAp5gAkAAAAmkCze5hvZtMeedpZWNthI
User-Agent: G2/1.0
X-HTTP-UserAgent: Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; 
	Trident/4.0; .NET CLR 2.0.50727; .NET CLR 3.0.04506.648; .NET CLR 
	3.5.21022),gzip(gfe),gzip(gfe)
Xref: news.mathworks.com comp.soft-sys.matlab:557361


On 21 Jul, 21:28, "David Kunik" <ku...@ualberta.ca> wrote:
> Hey,
>
> So i have a very large data set (1.9GB) so i am unable to load this in to Matlab for modification that way (this computer only has 1gb of ram).  I need to do a couple simple regexprep calls (A_A -> 1) which is easy enough but each row of data is like 1.5MB and it takes bloody forever for regexprep to go through (there is allot of A_A's..).  By "forever" i mean ~41 minutes.  For 1/624 rows.

There is something wrong. A 1GB computer should have no problems
whatsoever with handling lines of 1.5 MB.

Most likely, the file was generated by a different type of
computer than your - presumably - PC. If so, the lines are
ended by different characters than FGETS or FGETL look for.

I don't know how to configure FGETS or FGETL to change
End-of-Line characters, so the second best is if you know
how many characters there are in the line.

Or use some other computer and re-format the file.
If this is a text file, open it in MSWordPad and
then store it as a .txt file. That way, End-of-Line
characters are changed to what matlab can recognize.

Rune