My training data is too big for regression

2 views (last 30 days)
John Albert
John Albert on 19 Nov 2015
Commented: Greg Heath on 17 Dec 2015
The training data input is (12925*7) and my training data output is (12925*1). It takes alot of time to train the network.Similarly the testing data is (4000*7)and (4000*1). I want to do estimation(regression) using neural network and rbfnn but the matlab rbfnn function doesnot work with this dataset. its too big for it to do the required task.All the data is numerical. I am new to data mining.What should i do? Need help

Answers (1)

Greg Heath
Greg Heath on 16 Dec 2015
Randomly divide the dataset into m subsets that are small enough to train.
Run all of the data thru each of the m nets.
Rank the performances of the m nets.
If the performance of the best net is unsatisfactory, average the outputs of the best 2 nets, etc.
Hope this helps.
Thank you for formally accepting my answer
Greg
  1 Comment
Greg Heath
Greg Heath on 17 Dec 2015
Since weight initialization and datadivision are random, it may take multiple runs to obtain good deigns for each of the m nets.

Sign in to comment.

Tags

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!