Neuromongers, don't pass by :) need advice - page 8

 

OK, let's forget about the training one for now.

I have a network approximating 1 value, which is whether price will go up or down. I will not go into details.

We can take a test sample (not those data on which the network learns but the data where the training of the neural network stops when the error on this sample stops falling) as a single piece and this piece will come right after the training sample and before the OOS period where the network actually trades. In this case we estimate the network generalization error on data that may differ significantly from the training array.

Another option I mentioned is to generate a control sample randomly from the array of samples going before the OOS. The samples would be shuffled. ) So it turns out (at least in my case) that the adjacent samples are similar and the network learns on one sample (training sample) and immediately the network generalization error is estimated on the adjacent (control) sample. In this case, the error minimum on the test sample can be much deeper than in the case when the test sample is taken by one separate piece.

 

It's more or less clear now. I have no training. At all.

So there can be no test sampling in the form you suggest.

To be honest, I doubt it would be very effective at all.

I am not against its application, but I don't see an effective scheme.

To be truly testable, the sample must be not on the training interval. I.e., well before the OOS. Which essentially gives a delay in use and no guarantee of improvement :) . Test sampling is good when you train once, test it and then use it dumbly, I don't see the point of using it to predict price series.

Don't take it as a reason to get rid of it (this is an appeal to all readers :) ), it's just an imho.

 

It's all reasonable what you said. I just want to test my assumptions with practice, although I myself also go from one option to another and then come back... ))) But have made it a rule to always use a test sample in some way.

I also, by the way, always check the system on a forward test before placing an EA on an account. I can tell you that all my EAs pass a single forward test (I've had enough time to do multiple forwards only for EURUSD H1). If they didn't pass, I don't even bother putting them through, because I no longer have any confidence ))))

 

Another spoonful of tar. An individual net.

1    -1021.00   870    0.95    -1.17   2253.80    21.60%   Fake=0   
2    1336.30    862    1.08    1.55    939.40     8.90%    Fake=1  
3    2174.60    869    1.12    2.50    1471.40    14.45%   Fake=2
4    2239.00    844    1.15    2.65    942.70     9.42%    Fake=3 
5    2433.90    901    1.15    2.70    1191.70    9.43%    Fake=4
6    3746.20    864    1.24    4.34    777.60     7.41%    Fake=5 
7    -1804.60   868    0.90    -2.08   2966.00    28.61%   Fake=6
8    555.30     842    1.03    0.66    1360.90    12.77%   Fake=7

You can see that the average is +, but, holy shit, the spread is not small at all.

 
TheXpert:

Another spoonful of tar. Separate network.

Of course you can see that the average is +, but, holy crap, the spread is not small at all.



Hello!

Have you done any devolatilisation (found in the articles) for the inductors you feed to the net input?

You could also try to make the inductions devolatile.

 
Alas... I don't serve turkeys.
 
TheXpert:
Alas... I don't serve any indices.


Interesting...

What about normalisation to a single interval (or at least an interval)?

Dare I ask an immodest question: what's the teacher? maximising profits through forecasting a few bars ahead?

 
renegate:

Dare I ask an immodest question: what's the teacher? maximising profits through forecasting several bars ahead?

No, this approach does not integrate well with the echo network. Already said in this thread about the teacher.

renegate:

What about rationing to a single interval (or at least an interval)?

Well, if it's just like that, yes, I do :)

 
Didn't find a teacher in this thread. I'll have a look later. It'll be better in the morning...
 

We forgot about our "sheep"). The starting message is "How to improve?"

I suggest we abstract away a little (just a little) and think about how to improve the NS result in general, and not just this one, in the application area we are interested in. Here, point by point:

1) Choice of inputs/outputs (a matter of intimate and almost always not subject to discussion, in this case, it is based on a theory approved by two experienced in our business forum members, and we believe that there is nothing to improve)

2) Inputs preprocessing (the question seems rather simple and quite open, we can discuss if it will be known, what and how is done in this case (although I have a sensible NS which basic "zest" is original (not met anywhere) coding of the input data, which I am not going to share yet))

3) Mathematics of NS. (Everything was invented here before us. You may feel free to share and discuss anything you like. Except that all attempts to improve something here are more like shamanism and blind experiments than conscious action)

4) "Organizational" questions of NS. (How / when to train / retrain, periods / intervals, the logic of the network output interpreter, MM, etc. We have seen reports on the entire TS in general. Saw, but sensible ideas for improvement by looking at reports other than some trivial MM comes to mind.

What have I missed?

Where/what theoretically can be improved by taking advice of a person who is not immersed in the essence of development? That leaves items 2 and 3. Point 2 is omitted by TopikStarter as not worthy of attention "there all the usual" (although in my opinion, there may be variants). Point 3, there are articles which you can not understand without 100 grams, and which I personally can not yet fully comprehend (an attempt to implement even a simple echo network has failed so far).

TheXpert, can you tell me something else about your TS that is not a secret? We would a priori be interested, as you have a certain result (I personally think so), and it may "backfire" with smart advice. For example, I wonder:

- Why the "echo"? You've been there, tell me about its pros and cons. How did you dig it out in the first place?

- Inputs/outputs: Mr. joo talks about "flowing patterns" and type 2 TC. I think "flowing" is worthy of discussion, the 2nd type is just an evil one imho.

a) Are you really sure that the inputs/outputs cannot be improved?

b) Pre-processing: How does it look like? Has there been an analysis of the distribution of the input values, for example?

Reason: