What is the scale problem in lsqcurvefit optimization?
3 views (last 30 days)
Show older comments
Hi,
I'm trying to optimize only two parameters in a computationally expensive model, and I'm using lsqcurvefit with the Levenberg-Marquardt Algorithm.
I want to limit the minimum step sizes (or change magnitude in parameter values) to certain values; because the change in parameter values is very small by default, the gain of the loss functions is very small which lead the optimizer of getting stuck in local minima.
I tried to set a minimum variable difference, but the "MinDiffChange" can only be one scalar applied to both, while the two parameter values are not normalized to each other. This means that one parameter is 1, while another parameter is 10000. So changing the first parameter by 1 is a big deal, changing the second parameter by 1 is not!
How can I make sure the optimizer takes minimum step sizes proportional to each parameter used?
What is the "ScaleProblem" parameter in the optimization options of lsqcurvefit? Is it related to my issue?
Thanks,
H
1 Comment
Bjorn Gustavsson
on 22 Dec 2020
Wouldn't the simples solution be that you rescale your parameters such that you use "kilo-unit-one" for the larger and "unit-two" for the smaller, that way you know what's going on, as long as you document what scalings you use...
Answers (1)
See Also
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!