Thread Subject: conv2 of a large image

Is there any one how can help me in using conv2 function for large image (10000x 10000) pixels ?
thanks.

"amcum ammcum" <ammcum@yahoo.fr> wrote in message
news:gjhd65$7b2$1@fred.mathworks.com...
> Is there any one how can help me in using conv2 function for large image
> (10000x 10000) pixels ?
> thanks.

Yes, I can help you

--Nasser

"Nasser Abbasi" <nma@12000.org> wrote in message <zQW6l.7809$pr6.4630@flpi149.ffdc.sbc.com>...
>
> "amcum ammcum" <ammcum@yahoo.fr> wrote in message
> news:gjhd65$7b2$1@fred.mathworks.com...
> > Is there any one how can help me in using conv2 function for large image
> > (10000x 10000) pixels ?
> > thanks.
>
> Yes, I can help you
>
> --Nasser
>

thnk you I am waiting for the solution !
my email is ammcum@hotmail.com

On Dec 31 2008, 10:27=A0pm, "amcum ammcum" <amm...@yahoo.fr> wrote:
> Is there any one how can help me in using conv2 function for large image =
(10000x 10000) pixels ?
> thanks.

-------------------------------------------
What exactly is the problem? You call it just like you do any other
of the hundreds of MATLAB functions.

"ImageAnalyst" <imageanalyst@mailinator.com> wrote in message
news:6cc68097-2e74-4872-bd05-e551acf0db01@u14g2000yqg.googlegroups.com...
On Dec 31 2008, 10:27 pm, "amcum ammcum" <amm...@yahoo.fr> wrote:
> Is there any one how can help me in using conv2 function for large image
> (10000x 10000) pixels ?
> thanks.

"-------------------------------------------
What exactly is the problem? You call it just like you do any other
of the hundreds of MATLAB functions."

Also, he did not day what is he convolving the image with. if it is same
size image, then he needs about 800 MB for both. May be he does not have
enough memory?

Ii will be good if OP could explain more what is the problem.

--Nasser

"Nasser Abbasi" <nma@12000.org> wrote in message <31_6l.9245$W06.474@flpi148.ffdc.sbc.com>...
>
> "ImageAnalyst" <imageanalyst@mailinator.com> wrote in message
> news:6cc68097-2e74-4872-bd05-e551acf0db01@u14g2000yqg.googlegroups.com...
> On Dec 31 2008, 10:27 pm, "amcum ammcum" <amm...@yahoo.fr> wrote:
> > Is there any one how can help me in using conv2 function for large image
> > (10000x 10000) pixels ?
> > thanks.
>
> "-------------------------------------------
> What exactly is the problem? You call it just like you do any other
> of the hundreds of MATLAB functions."
>
> Also, he did not day what is he convolving the image with. if it is same
> size image, then he needs about 800 MB for both. May be he does not have
> enough memory?
>
> Ii will be good if OP could explain more what is the problem.
>
> --Nasser


The problem is with the 'Out of memory message'
The conv2 function is called by the wconv2 (wavelet convolution of a 2D array).
My kernel is defined with the support of the 'bior2.4' wavelet.
Hope that theses information explains better my problem.

"amcum ammcum" <ammcum@yahoo.fr> wrote in message
news:gjiqsl$mnr$1@fred.mathworks.com...


>
> The problem is with the 'Out of memory message'

Ok, How much memory does your PC/laptop have?

--Nasser

"Nasser Abbasi" <nma@12000.org> wrote in message <%S67l.7852$pr6.4099@flpi149.ffdc.sbc.com>...
>
> "amcum ammcum" <ammcum@yahoo.fr> wrote in message
> news:gjiqsl$mnr$1@fred.mathworks.com...
>
>
> >
> > The problem is with the 'Out of memory message'
>
> Ok, How much memory does your PC/laptop have?
>
> --Nasser
>


I 'm using vista home premium with my laptop: 3G RAM and 300Go HD
I have also used a desktop with 512Mo RAM (more than 30 Go free HD memory).

Matlab generate the same memory limitation message (for the two machines: desktop and laptop) once the array dimension accede 3000 x 3000 pixel.
So I believe (not sure) that the problem is a combination of a software-hardware.

Best regards.

On Jan 1, 12:43=A0pm, "amcum ammcum" <amm...@yahoo.fr> wrote:
> "Nasser Abbasi" <n...@12000.org> wrote in message <%S67l.7852$pr6.4...@fl=
pi149.ffdc.sbc.com>...
>
> > "amcum ammcum" <amm...@yahoo.fr> wrote in message
> >news:gjiqsl$mnr$1@fred.mathworks.com...
>
> > > The problem is with the 'Out of memory message'
>
> > Ok, How much memory does your PC/laptop have?
>
> > --Nasser
>
> I 'm using vista home premium with my laptop: 3G RAM and 300Go HD
> I have also used a desktop with 512Mo RAM (more than 30 Go free HD memory=
).
>
> Matlab generate the same memory limitation message (for the two machines:=
 desktop and laptop) once the array dimension accede 3000 x 3000 pixel.
> So I believe (not sure) that the problem is a combination of a software-h=
ardware.
>
> Best regards.

----------------------------------------------------------------------
amcum:
10k by 10k by 8 bytes (for double) gives about 800 MB. Now double
that since it'll need to also create an output image, and you're up to
at least 1.6 GB. You are probably just out of memory. Are you using
Windows? Do you have the /3GB switch (Google it) set when you run
windows?

Can you type memory at the MATLAB command prompt and paste the
response here?

How important is this to you? If you're willing to spend money, you
can get Star-P (http://www.interactivesupercomputing.com/) and get rid
of your memory problems in MATLAB. You can even have terabyte sized
arrays.

Otherwise you may have to convolve it in smaller parts and piece them
together - a mess since you'll have lots of boundaries to fix up
because it's not simply stitching the parts together.
Regards,
ImageAnalyst

ImageAnalyst <imageanalyst@mailinator.com> wrote in message <2988496d-4770-4710-9213-6596da54c8ab@f11g2000vbf.googlegroups.com>...
> On Jan 1, 12:43=A0pm, "amcum ammcum" <amm...@yahoo.fr> wrote:
> > "Nasser Abbasi" <n...@12000.org> wrote in message <%S67l.7852$pr6.4...@fl=
> pi149.ffdc.sbc.com>...
> >
> > > "amcum ammcum" <amm...@yahoo.fr> wrote in message
> > >news:gjiqsl$mnr$1@fred.mathworks.com...
> >
> > > > The problem is with the 'Out of memory message'
> >
> > > Ok, How much memory does your PC/laptop have?
> >
> > > --Nasser
> >
> > I 'm using vista home premium with my laptop: 3G RAM and 300Go HD
> > I have also used a desktop with 512Mo RAM (more than 30 Go free HD memory=
> ).
> >
> > Matlab generate the same memory limitation message (for the two machines:=
> desktop and laptop) once the array dimension accede 3000 x 3000 pixel.
> > So I believe (not sure) that the problem is a combination of a software-h=
> ardware.
> >
> > Best regards.
>
> ----------------------------------------------------------------------
> amcum:
> 10k by 10k by 8 bytes (for double) gives about 800 MB. Now double
> that since it'll need to also create an output image, and you're up to
> at least 1.6 GB. You are probably just out of memory. Are you using
> Windows? Do you have the /3GB switch (Google it) set when you run
> windows?
>
> Can you type memory at the MATLAB command prompt and paste the
> response here?
>
> How important is this to you? If you're willing to spend money, you
> can get Star-P (http://www.interactivesupercomputing.com/) and get rid
> of your memory problems in MATLAB. You can even have terabyte sized
> arrays.
>
> Otherwise you may have to convolve it in smaller parts and piece them
> together - a mess since you'll have lots of boundaries to fix up
> because it's not simply stitching the parts together.
> Regards,
> ImageAnalyst

The 3GB switch :
I introduce the command to the prompt :
bcdedit /set IncreaseUserVa 3072
and this do not resolve my problem.

- for the memory function it don’t produce any output !
- The application is important for me, but I am not able to pay an Star-P solution !

"amcum ammcum" <ammcum@yahoo.fr> wrote in message <gjjq7p$6di$1@fred.mathworks.com>...
> ImageAnalyst <imageanalyst@mailinator.com> wrote in message <2988496d-4770-4710-9213-6596da54c8ab@f11g2000vbf.googlegroups.com>...
> > On Jan 1, 12:43=A0pm, "amcum ammcum" <amm...@yahoo.fr> wrote:
> > > "Nasser Abbasi" <n...@12000.org> wrote in message <%S67l.7852$pr6.4...@fl=
> > pi149.ffdc.sbc.com>...
> > >
> > > > "amcum ammcum" <amm...@yahoo.fr> wrote in message
> > > >news:gjiqsl$mnr$1@fred.mathworks.com...
> > >
> > > > > The problem is with the 'Out of memory message'
> > >
> > > > Ok, How much memory does your PC/laptop have?
> > >
> > > > --Nasser
> > >
> > > I 'm using vista home premium with my laptop: 3G RAM and 300Go HD
> > > I have also used a desktop with 512Mo RAM (more than 30 Go free HD memory=
> > ).
> > >
> > > Matlab generate the same memory limitation message (for the two machines:=
> > desktop and laptop) once the array dimension accede 3000 x 3000 pixel.
> > > So I believe (not sure) that the problem is a combination of a software-h=
> > ardware.
> > >
> > > Best regards.
> >
> > ----------------------------------------------------------------------
> > amcum:
> > 10k by 10k by 8 bytes (for double) gives about 800 MB. Now double
> > that since it'll need to also create an output image, and you're up to
> > at least 1.6 GB. You are probably just out of memory. Are you using
> > Windows? Do you have the /3GB switch (Google it) set when you run
> > windows?
> >
> > Can you type memory at the MATLAB command prompt and paste the
> > response here?
> >
> > How important is this to you? If you're willing to spend money, you
> > can get Star-P (http://www.interactivesupercomputing.com/) and get rid
> > of your memory problems in MATLAB. You can even have terabyte sized
> > arrays.
> >
> > Otherwise you may have to convolve it in smaller parts and piece them
> > together - a mess since you'll have lots of boundaries to fix up
> > because it's not simply stitching the parts together.
> > Regards,
> > ImageAnalyst
>
> The 3GB switch :
> I introduce the command to the prompt :
> bcdedit /set IncreaseUserVa 3072
> and this do not resolve my problem.
>
> - for the memory function it don’t produce any output !
> - The application is important for me, but I am not able to pay an Star-P solution !

---------------------------------------------------------------------
Well you'd better call The Mathworks support because there's something wrong with your installation. When I type memory, I get this:
>> memory
Maximum possible array: 1120 MB (1.174e+009 bytes) *
Memory available for all arrays: 2542 MB (2.666e+009 bytes) **
Memory used by MATLAB: 244 MB (2.556e+008 bytes)
Physical Memory (RAM): 3070 MB (3.219e+009 bytes)

* Limited by contiguous virtual address space available.
** Limited by virtual address space available.

Maybe you have an old version.

To get the 3GB switch working you have to have a line similar to this in c:\boot.ini:
multi(0)disk(0)rdisk(0)partition(1)\WINDOWS="Microsoft Windows XP Professional 3GB" /NoExecute=AlwaysOff /fastdetect /3GB
------------------------------------------------------------------------------------

"Image Analyst" <imageanalyst@mailinator.com> wrote in message <gjjuvl$lbo$1@fred.mathworks.com>...
> "amcum ammcum" <ammcum@yahoo.fr> wrote in message <gjjq7p$6di$1@fred.mathworks.com>...
> > ImageAnalyst <imageanalyst@mailinator.com> wrote in message <2988496d-4770-4710-9213-6596da54c8ab@f11g2000vbf.googlegroups.com>...
> > > On Jan 1, 12:43=A0pm, "amcum ammcum" <amm...@yahoo.fr> wrote:
> > > > "Nasser Abbasi" <n...@12000.org> wrote in message <%S67l.7852$pr6.4...@fl=
> > > pi149.ffdc.sbc.com>...
> > > >
> > > > > "amcum ammcum" <amm...@yahoo.fr> wrote in message
> > > > >news:gjiqsl$mnr$1@fred.mathworks.com...
> > > >
> > > > > > The problem is with the 'Out of memory message'
> > > >
> > > > > Ok, How much memory does your PC/laptop have?
> > > >
> > > > > --Nasser
> > > >
> > > > I 'm using vista home premium with my laptop: 3G RAM and 300Go HD
> > > > I have also used a desktop with 512Mo RAM (more than 30 Go free HD memory=
> > > ).
> > > >
> > > > Matlab generate the same memory limitation message (for the two machines:=
> > > desktop and laptop) once the array dimension accede 3000 x 3000 pixel.
> > > > So I believe (not sure) that the problem is a combination of a software-h=
> > > ardware.
> > > >
> > > > Best regards.
> > >
> > > ----------------------------------------------------------------------
> > > amcum:
> > > 10k by 10k by 8 bytes (for double) gives about 800 MB. Now double
> > > that since it'll need to also create an output image, and you're up to
> > > at least 1.6 GB. You are probably just out of memory. Are you using
> > > Windows? Do you have the /3GB switch (Google it) set when you run
> > > windows?
> > >
> > > Can you type memory at the MATLAB command prompt and paste the
> > > response here?
> > >
> > > How important is this to you? If you're willing to spend money, you
> > > can get Star-P (http://www.interactivesupercomputing.com/) and get rid
> > > of your memory problems in MATLAB. You can even have terabyte sized
> > > arrays.
> > >
> > > Otherwise you may have to convolve it in smaller parts and piece them
> > > together - a mess since you'll have lots of boundaries to fix up
> > > because it's not simply stitching the parts together.
> > > Regards,
> > > ImageAnalyst
> >
> > The 3GB switch :
> > I introduce the command to the prompt :
> > bcdedit /set IncreaseUserVa 3072
> > and this do not resolve my problem.
> >
> > - for the memory function it don’t produce any output !
> > - The application is important for me, but I am not able to pay an Star-P solution !
>
> ---------------------------------------------------------------------
> Well you'd better call The Mathworks support because there's something wrong with your installation. When I type memory, I get this:
> >> memory
> Maximum possible array: 1120 MB (1.174e+009 bytes) *
> Memory available for all arrays: 2542 MB (2.666e+009 bytes) **
> Memory used by MATLAB: 244 MB (2.556e+008 bytes)
> Physical Memory (RAM): 3070 MB (3.219e+009 bytes)
>
> * Limited by contiguous virtual address space available.
> ** Limited by virtual address space available.
>
> Maybe you have an old version.
>
> To get the 3GB switch working you have to have a line similar to this in c:\boot.ini:
> multi(0)disk(0)rdisk(0)partition(1)\WINDOWS="Microsoft Windows XP Professional 3GB" /NoExecute=AlwaysOff /fastdetect /3GB
> ------------------------------------------------------------------------------------

Can you help me to added the line:
multi(0)disk(0)rdisk(0)partition(1)\WINDOWS="Microsoft Windows XP Professional 3GB" /NoExecute=AlwaysOff /fastdetect /3GB
in boot.ini
under vista not such file exist !

"amcum ammcum" <ammcum@yahoo.fr> wrote in message <gjk0v1p[
[snip]
> ------------------------------------------------------------------------------------
>
> Can you help me to added the line:
> multi(0)disk(0)rdisk(0)partition(1)\WINDOWS="Microsoft Windows XP Professional 3GB" /NoExecute=AlwaysOff /fastdetect /3GB
> in boot.ini
> under vista not such file exist !
----------------------------------------------
Sorry - I can't help you because I'm not running Vista. But you still need to
1. Call The Mathworks to find out why your memory command doesn't work.
2. Figure out a way to do your convolution in smaller parts and reconstruct them, because you probably don't have enough RAM to do the job. (No, I don't know why it can't use the multiple GB of virtual memory on disk, but apparently it can't.)
Good luck,
ImageAnalyst

"Image Analyst" <imageanalyst@mailinator.com> wrote in message <gjk1ef$4j9$1@fred.mathworks.com>...
> "amcum ammcum" <ammcum@yahoo.fr> wrote in message <gjk0v1p[
> [snip]
> > ------------------------------------------------------------------------------------
> >
> > Can you help me to added the line:
> > multi(0)disk(0)rdisk(0)partition(1)\WINDOWS="Microsoft Windows XP Professional 3GB" /NoExecute=AlwaysOff /fastdetect /3GB
> > in boot.ini
> > under vista not such file exist !
> ----------------------------------------------
> Sorry - I can't help you because I'm not running Vista. But you still need to
> 1. Call The Mathworks to find out why your memory command doesn't work.
> 2. Figure out a way to do your convolution in smaller parts and reconstruct them, because you probably don't have enough RAM to do the job. (No, I don't know why it can't use the multiple GB of virtual memory on disk, but apparently it can't.)
> Good luck,
> ImageAnalyst
-----------------------------------------------------------------------------------------
Thank you for your help and support,
I will contact them for the memory function
- And I will try to modify the swt2 function in a way that it call conv function rather the conv2. So I will try to make the transformation line by line and column by column

Hope that this will work.

Image Analyst wrote:
> [snip]
> (No, I don't know why it can't use the multiple GB of virtual memory
 > on disk, but apparently it can't.)

The memory resource being exhausted is address space, not virtual
memory. On a 32-bit OS, any single application, such as MATLAB, has
only a 32-bit address space with which to access memory.

---
Steve Eddins
http://blogs.mathworks.com/steve/

It may not help if it's a memory issue, but if you have the Image Processing Toolbox, imfilter takes advantage of zeros in the convolution kernel, which speeds up computation of the stationary/undecimated wavelet transform enormously. As far as I can tell, conv2 doesn't, and so can be extremely slow. I'm using R2008a - I don't know if this has been sorted out in a later release.

Pete (who has just been writing his own swt2 alternative using imfilter... it seems to be worth doing)

"Pete " <pete.dot.bankhead@btinternet.dot.com> wrote in message <gooke6$iek$1@fred.mathworks.com>...
> It may not help if it's a memory issue, but if you have the Image Processing Toolbox, imfilter takes advantage of zeros in the convolution kernel, which speeds up computation of the stationary/undecimated wavelet transform enormously. As far as I can tell, conv2 doesn't, and so can be extremely slow. I'm using R2008a - I don't know if this has been sorted out in a later release.
>
> Pete (who has just been writing his own swt2 alternative using imfilter... it seems to be worth doing)



Is it possible to have some help on using swt2 with imfilter ?
many thanks