How can I perform matrix operation efficiently?
2 views (last 30 days)
Show older comments
Ranjan Sonalkar
on 4 Jun 2014
Commented: Dan Gianotti
on 22 Jul 2014
I have an array X(n,m) where m<<n and n can be very large. First, I want to create a 3-d array of dimension (m,m,n) such that each mxm matrix in the nth location is the outer product of the n-th m-dimensional row in the original X- array.
Then I want to form a weighted sum all the mxm arrays where the weights are the elements of another n-dimensional array, Y(n).
result=zeros(m);
for i=1:n
result = result + Y(i) * X(i,:)' * X(i,:);
end
I could do this in the loop, but I think it would be slow when n is very large, compared to if there were a way to do all this with some matrix operation functions in MATLAB.
3 Comments
dpb
on 4 Jun 2014
Needs to preallocate the full 3D array, however, and store into it; otherwise it'll be the classic case of reallocation and memory thrashing as he adds planes.
That said, I'd think it likely to be reasonably-decent performing. The alternatives seem to be accumarray and the like which are basically loops themselves...
Dan Gianotti
on 22 Jul 2014
Hah! This is exactly the question I was about to ask (presumably implementing some version of the EM algorithm?)!
Did you determine if Roger's loop or James's vectorized version was faster?
Accepted Answer
Roger Stafford
on 5 Jun 2014
If m is much smaller than n and assuming Y is a column vector, try this:
R = zeros(m);
TX = X';
for ix = 1:m
R(:,ix) = TX*(X(:,ix).*Y); % <-- R is 'result'
end
More Answers (1)
James Tursa
on 4 Jun 2014
Edited: James Tursa
on 4 Jun 2014
This is vectorized, but it creates potentially large intermediate arrays, so I don't know if it will be any faster than your simple loop. Strictly from a memory use perspective, the simple loop is better.
XT = X';
XTc = reshape(XT,m,1,n);
XTr = reshape(XT,1,m,n);
XTX = bsxfun(@times,XTc,XTr);
Yn = reshape(Y,1,1,n);
YXTX = bsxfun(@times,Yn,XTX);
result = sum(YXTX,3);
0 Comments
See Also
Categories
Find more on Creating and Concatenating Matrices in Help Center and File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!