Why the mean square error value is changing for different training functions ?

1 view (last 30 days)
I have used the training function "traingdm" in training my neural network.
_
%%%%%%%%%%%%%%%%%%%%%
net=newff(minmax(in'),[20,1],{'tansig','purelin'},'traingdm');
%%%%%%%%%%%%%%%%%%%%%
_
What will happen if I change the training function from "traingdm" to "traindx" ?
Does the change affect the mean square error ?

Accepted Answer

Greg Heath
Greg Heath on 19 Feb 2013
If the problem is not a trivial one do not expect the weights and MSEs to be the same.
To make a valid comparison you have to reset the random number generator to the same intial state(e.g., seed = 0, rng(seed)) to obtain the same default random data division and random weight initialization.
Different minimization algorithms cannot be expected to reach the same local minimum when started from the same initial point.
When you reset the random number generator and make new trial runs, please post a summary of the results. I'm interested in the % of times the results are the same.
Hope this helps.
Thank you for formally accepting my answer
Greg
  1 Comment
Mohan
Mohan on 25 Feb 2013
Thank you for your reply Greg. When I reset the random number generator to the same initial state and make new trials, I am getting the same result again and again, even if I run it N number of times.
Only when I change the training function, I could see the change in the result. Even then, if I reset the random number generator to the same initial state, then the results are again the same. ( for that training function ).

Sign in to comment.

More Answers (0)

Categories

Find more on Deep Learning Toolbox in Help Center and File Exchange

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!