Regression with a rolling window

I would like to run a regression with a rolling window. The number of observation is 10000, so my code took a long time. Could you let me know how to improve my code so that I can save time?
for i=1:(k-m)/12-1
for j=1:n
whichstats = {'all'};
stats = regstats(a(1+12*(i-1):12*(i+1),j), b(1+12*(i-1):12*(i+1)), 'linear',whichstats);
c(i,j) = std(stats.r);
end
end

3 Comments

jonas
jonas on 17 Jul 2018
Edited: jonas on 17 Jul 2018
Can you provide part of the data set? I would suggest preallocating the variable c, but I don't think it will help much.
Also, what is k, m and n?
jonas
jonas on 17 Jul 2018
Edited: jonas on 17 Jul 2018
I think you will have better chances of getting a good answer if you provide a part of your data. At least to me, there is no obvious way to reduce the time other than pre-allocation. Having the data and code, I would try substituting the regstats function for something else.
Grouping the segments and calling regstats using splitapply instead of the loop could also help..
I'm not sure my answer below would change. Did you even try it?

Sign in to comment.

Answers (1)

Image Analyst
Image Analyst on 17 Jul 2018
Edited: Image Analyst on 17 Jul 2018
"Regression with a rolling window" <== this is exactly what the Savitzky-Golay filter is. If you have the Signal Processing Toolbox, use sgolayfilt().
I also don't know why you chose not to do Jonas's request (twice) "Can you provide part of the data set?". Come on, make it EASY for us to help you, not hard.

2 Comments

Image Analyst
Image Analyst on 17 Jul 2018
Edited: Image Analyst on 17 Jul 2018
Attach your "a" (please pick a more descriptive name!) and say which column of the 1000 columns is "b" (again, a better name would be good) in a .mat file with the paper clip icon. Say which row or column is supposed to be filtered with a sliding polynomial regression. And say what order of regression (linear, quadratic, cubic, etc.).
Say which row or column is supposed to be filtered with a sliding polynomial regression. And say what order of regression (linear, quadratic, cubic, etc.).

Sign in to comment.

Tags

Asked:

on 17 Jul 2018

Commented:

on 17 Jul 2018

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!