From: "Greg Heath" <>
Newsgroups: comp.soft-sys.matlab
Subject: Re: Unexpected neural network output
Date: Thu, 2 May 2013 05:05:09 +0000 (UTC)
Organization: The MathWorks, Inc.
Lines: 31
Message-ID: <klss65$j8m$>
References: <klqncu$s1o$> <klqoic$1km$> <klqpia$41h$>
Reply-To: "Greg Heath" <>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
X-Trace: 1367471109 19734 (2 May 2013 05:05:09 GMT)
NNTP-Posting-Date: Thu, 2 May 2013 05:05:09 +0000 (UTC)
X-Newsreader: MATLAB Central Newsreader 2929937
Xref: comp.soft-sys.matlab:794723

"Ton Schomaker" <> wrote in message <klqpia$41h$>...
> "Greg Heath" <> wrote in message <klqoic$1km$>...
> > "Ton Schomaker" <> wrote in message <klqncu$s1o$>...
> > > I have trained a very good ff neural network with the restiction that any increase of each input parameters A, B, C... must give higher output values (R2 = 0.94). However when I use the best trained NN using better (i.e. increased) input data the output sometimes is lower than the original target value. 
> > > Does someone have a solution for this problem? 
> > 
> > Good solutions have a mean error of 0. Therefore, ~50% of the answers should be above the target value.
> > 
> > Hope this helps.
> > 
> > Greg
> You are right Greg, but that is not my problem. Let me try to explain. I am using NN to improve water quality of natural swimming waters. So I use data from a lot of these water with amongst others the amount of sewer outlets. With less outlets as input for the trained NN I sometimes get worse water quality while expecting a better one.
> How can I train a new networks that avoids this error?
> Kind regads, Ton

I'm sorry I don't fully understand your problem. However, the basic assumption 
is that the training data adequately characterizes the probability distribution of the 
operational data. If that is not true, then you have to add simulated data which 
contains the correct characteristics.

Well trained NNs can be excellent interpolators BUT terrible extrapolators.

I would expect if you used the smallest amount of hidden nodes possible, 
you might get better extrapolation; However, don't bet on it with the kids 

Hope this helps