How to "teach" Matlab how to remove inconsistent data?
7 views (last 30 days)
Show older comments
Hello!
I have a set of data consisting of measured values in time, over several days. You can see on the plot below the "normal" shape, and the moments at which data is inconsistent (mostly in the left and right parts of the plot). Note that this is values from one of my measurement devices, other ones have a more consistent shape with values decreasing at the beginning and at the end. I would like to remove this inconsistent data. How can I do this? I thought of doing some machine learning, for example by training the algorithm and teaching it what is "good" or "bad" data.
Thank you
Romain
0 Comments
Answers (2)
Star Strider
on 11 Aug 2015
One possibility is for you to sort your data by the independent variable and then plot it. That might at least make it a bit easier to understand. You could then decide what the outliers are.
4 Comments
Star Strider
on 14 Aug 2015
I’m not quite sure what you’re measuring, but it would seem that 100% occupancy aren’t correct data. I would remove those (perhaps anything greater than 95%, and the associated time data), and then see what the data are. You might not need anything more sophisticated than thresholding your data.
See Also
Categories
Find more on Logical in Help Center and File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!