How are the automatic values of hyper-parameters in Matlab Regression Learner determined?
4 views (last 30 days)
Using Matlab regression learner one can choose the auto option for the values of the various hyper-parameters such as epsilon and Kernel scale mode in SVM's. In this case is stated that if auto is chosen the app uses a heuristic procedure to select the kernel scale. Also the same applies in the Gaussian Processes. When Kernel scale mode is set to Auto, it is stated that the app uses a heuristic procedure to select the initial kernel parameters. -What is the heuristic procedure followed? -Are the values given optimised? -If they are why the "tips" encourage the user to give values manualy?
Ilya on 6 Aug 2018
If you type
in your MATLAB session and hit Return, the editor will bring up the code for that heuristic procedure.
You won't know if these parameters are optimal or not without doing optimization. These are based on a guess. The guess is often good but it can fail from time to time.