MATLAB Answers

C Zeng
0

On define a large scale arrays

Asked by C Zeng
on 6 Jan 2013

Hi, all, I want to define and store a large scale arrays, like ones(3^N,1000,N) and N can be 15. However, matlab says it is out of memory, because of the large scale.

I wonder is there any way to resolve it? I mean, to fulfill the purpose but satisfy the requirement of matlab? Actually ones(3^N, 1000,1) is still very large scale.

Thanks.

  0 Comments

Products

No products are associated with this question.

2 Answers

Answer by Image Analyst
on 6 Jan 2013
 Accepted answer

Does it need to be double? Can it be single, uint8, or logical instead? Will it have any values other than 1 or small integers?

  5 Comments

Hi, sorry, still not working here. The problem is that 3^N can be very large, for example N can be 14, so 3^N*1000*N is very large, I think it exceeds the limit of Matlab. I created the array but it takes a lot of time, stay busy...

Are you sure that you need to whole matrix in memory at one time? Can't you work in "chunks"? Like work on a smaller cube of it at a time? Will you eventually access each and every one of those elements? Or can you use "sparse" matrices? Have you read the Mathworks guidance on this issue: Memory Usage

I may not need all matrix at a time and yes I can work in chunks. Let me double check the problem. Thank you for your suggestion!


Answer by Matt J
on 6 Jan 2013
Edited by Matt J
on 6 Jan 2013

Are the entries mostly zeros? Could you use the SPARSE command?

If you need to work with n-dimensional sparse arrays, there is this:

http://www.mathworks.com/matlabcentral/fileexchange/29832-n-dimensional-sparse-arrays

  3 Comments

Thanks, will take a look. Unfortunately, entries may not be mostly zeros.

Matt J
on 6 Jan 2013

If they are mostly ones, you can express the array as

 1 + sparse_array

and rewrite your computations in terms of that.

Yes, could be helpful, let me find it out. Thanks.


Discover MakerZone

MATLAB and Simulink resources for Arduino, LEGO, and Raspberry Pi

Learn more

Discover what MATLAB® can do for your career.

Opportunities for recent engineering grads.

Apply Today

MATLAB Academy

New to MATLAB?

Learn MATLAB today!