Matlab taking too much time to give output

19 views (last 30 days)
Pushkar Khatri
Pushkar Khatri on 30 May 2018
Commented: Walter Roberson on 4 Jun 2018
I'm solving a convex optimization problem which has to minimize a variable matrix of 498x498 size. As I run it, it is taking forever to give final value of x. When I terminate the process in between it shows like this
my code is
function f= coheren(x)
load ('Dictionary.mat','D');
Z = (D)*(D');
[V, U,W]=svd(Z);
a = mtimes(U,V');
b = mtimes(V,U);
f = (norm(U-(a*(x')*(x)*b)))^2;
function [c,ceq] = cohcon(x)
load ('Dictionary.mat','D');
[m,n]= size(D);%size(x)
k = D*(D');
T = (x)*k*(x');
[V1,U1,W1] =svd(T);
ceq = rank(U1)-m;
c= [];

Answers (3)

Walter Roberson
Walter Roberson on 30 May 2018
Never load() inside a cost function. Load the data outside the function and pass the data in.
In your case, for coheren(), you could pre-calculate U, a, and b, and pass those all in. For cohcon, you could pre-calculate k = D*(D') and pass that in.
Walter Roberson
Walter Roberson on 4 Jun 2018
Convex optimization would be more associated with linear constraints rather than with nonlinear constraints.

Sign in to comment.

Aakash Deep
Aakash Deep on 31 May 2018
Hey Pushkar,
Solving a convex optimization problem is a big task. Yes, it can take a long time to converge. You can not minimize the time of the algorithm but what you can do is, you can change your converging threshold.
As you know, the convergence plot of convex optimization problem decrease exponentially and hence the major components are already gets covered in the starting. So, you can give a threshold (try to keep the threshold at or below 0.1) such that whenever your error value gets below the threshold then stop the algorithm.
Walter Roberson
Walter Roberson on 1 Jun 2018
The only hope I see while using fmincon() is if the algorithm can be expressed for use in large scale solvers.
When I look at the nonlinear constraint, after some thinking, it looks to me as if it testing whether the matrix is singular in the sense of having at least one zero singular value. It calculates the rank of the 498 x 498 diagonal matrix, with the rank being the same as the number of non-zero diagonal elements, and it subtracts off the number of rows of the D matrix (498) and returns that. That would be negative in the case where there was at least one zero singular value, and would be 0 in the cast where the passed in matrix had no non-zero singular values.
... But -- nonlinear inequalities are consider satisfied if the output is <= 0, which is always going to be the case because rank minus 498 with rank maximum 498, can never be positive. With the two cases distinguished in theory seeming to be either singular or not, then I suspect that 1 should have been added to the result of the test so that the result would be positive in the case where the input was full rank.
When I look at it says you can calculate the rank of a matrix by calculating the number of non-zero singular values -- which is what appears to be happening here. But it also says that rank() is provided for that purpose. This suggest that even if the nonlinear constraint is still required, that the SVD calculation followed by finding the rank of the diagonal, could be replaced by simply calling rank() on the matrix.
As I look through the way that matrix is being constructed, rank(Z) is 215, and I do not think it is possible for the calculations it is doing to create a greater rank matrix. So my thought is that at least for this D matrix, that the nonlinear constraint will always return negative (meaning constraint not violated). If my logic is correct then the nonlinear constraint call could be removed. That could be important for the purpose of converting to large scale algorithms.
Unfortunately at the moment I have no idea how one would calculate the hessian pattern for the large scale algorithms.

Sign in to comment.

Rishabh Rathore
Rishabh Rathore on 4 Jun 2018
Edited: Rishabh Rathore on 4 Jun 2018
For the convergence problem, the upper bound could be used on the number of iterations, as suggested by Aakash. As for the problem with size of array being too large, Tall arrays could be used to overcome the issue as Tall arrays are not loaded in the memory at once.
You could refer:- Tall Arrays
Note:- the computation would take time since the size of the data to be manipulated and the number of calculations to be performed is very high.

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!