Machine learning in trading: theory, models, practice and algo-trading - page 2706

 
Aleksey Vyazmikin #:

You can't compare methods of feature generation, as I haven't created a system in code yet. You can compare your system with my set of predictors and the system/method of their selection.

Anyone can get data from the historical interval of the MQL server - you want a continuous history. But the final sample, which will be used for training, will be an order of magnitude smaller strings with examples, but with additional predictors.

The Expert Advisor that I propose to use will save the open predictors and at the end of the csv file there will be columns with the financial result and target - you can take information on the time of triggering of the "initial rule"/activation function from there, so there is no need to reproduce the algorithm in R.

I suggest the time interval - from 2010 to 2020 - training, the rest of the time for checking the results outside the training.

When you create your predictors, you can save the result in csv - and I will do so. You can either merge the columns and study on different ranges or just separately - you need it to compare the correctness of synchronisation.

I can send purely markup, if you don't want to get into it at all.

Let's get back to the logic

there can be many different attributes and they may or may not be informative, it depends on their relation to the target.

what is the difference between a relation and a fit? the degree of informative dependence expressed through some measure

the lower the information dependence of labels on each individual feature, the more features are required for training.

Increasing the number of features leads to fitting because the system starts to have so many free parameters

what is the only correct approach in this case? Minimising the number of features while increasing their ratio to the target features

That's why it is necessary to bombard not only features, but also target features, according to some information-binding criterion.

If someone will work in this direction, I will help with the code.
 
Maxim Dmitrievsky #:

Let's get back to the logic

there can be many different attributes and they may or may not be informative, it depends on their relation to the target attributes.

what is the difference between a relation and a fit? the degree of informative dependence expressed through some measure

the lower the information dependence of labels on each individual feature, the more features are required for training.

Increasing the number of features leads to fitting because the system starts to have so many free parameters

what is the only correct approach in this case? Minimising the number of features while increasing their ratio to the target features

That's why it is necessary to bombard not only features, but also target features, according to some information-binding criterion.

If someone will work in this direction, I will help with the code.

Of course I agree with the logic, that's why I suggested earlier - that we identify predictors at random and then use them for markup.

For me, these points that have predictive ability are events, which I generally think to train separately, or to separate sheets from them, and then to carry out any cumulative training procedure.

Such an Event can be considered as a separate trading system and the behaviour/efficiency of these systems can be analysed.

Now for me on netting the problem is independent accounting of these events, i.e. virtual support that would work correctly on real data with loss of communication and other delights.

 
Aleksey Vyazmikin #:

The feature generation methods cannot be compared as I have not yet created the system in code.

Comparison of methods.
That's the only thing I'm interested in.


I have my own samples, but I don't have the energy/motivation to finish and apply my superduper algorithm to them, that's what I'm doing this for motivation...
And you're telling me to take my sample, and also get into µl)))) and you won't do anything yourself....
No thanks...

I don't want to pull my wagon and you tell me to pull my wagon too. That's exactly how it looks.

 
mytarmailS #:
Comparison of methods
That's the only thing I'm interested in.

So compare human and machine predictor generation methods :)

 
Aleksey Vyazmikin #:

So compare the methods of generating predictors by human and machine :)

Why are you in this whole business?


 
mytarmailS #:
What are you doing in this whole business, then?


Just to clarify, my generated predictors.

 
Aleksey Vyazmikin #:

Specifically, my generated predictors.

You really think there's any value in that?
 
Aleksey Vyazmikin #:

Of course I agree with the logic, that's why I suggested earlier - that we identify predictors at random and then use them for markup.

For me, these points that have predictive ability are events that I generally think to train separately, or to separate sheets from them, and then to carry out any aggregate training procedure.

Such an Event can be considered as a separate trading system and the behaviour/efficiency of these systems can be analysed.

Now for me on netting the problem is independent accounting of these events, i.e. virtual support that would work correctly on real data with loss of communication and other delights.

First of all it is necessary to remove unnecessary words and terms that interfere with thinking. Otherwise co-op is simply impossible. There are general approaches to selecting signs, but they need to be adapted to time series and specifics of trading. It is to take a ready-made one and figure out how to use it better when marking up a chart. The whole toolkit is available.

Events, points, rules, signals... all this is not about machine learning and blurs the understanding of what you really do. You end up transferring mush from one head to another.

You all write about your bicycles, supposedly you have invented some scientific method, and something is about to happen, but you lack computing power, or desire, or slaves, and so everything is on track. At the same time, you cannot give a strict definition of what exactly you are doing and whether there is logic in it. These are excuses for yourself, an emotional approach.

Sometimes it is useful to write one more article to systematise scattered words and thoughts, then the logic of actions will be clear. Otherwise, you are doing something, but you have forgotten about the foundation, where you started, see if everything is in order with logic and if it is not detached from reality.
 
mytarmailS #:
You really think there's any value in that?

Of course there is. You can see what kind of gain your method gives you. Maybe it is so insignificant that there is no point in implementing it, or vice versa.

 
Maxim Dmitrievsky #:
First of all, you need to remove unnecessary words and terms that interfere with thinking. Otherwise, co-op is simply impossible. There are general approaches to selecting signs, but they need to be adapted to time series and trading specifics. It is to take a ready-made one and figure out how to use it better when marking up a chart. All the tools are available.

Events, points, rules, signals... all this is not about machine learning and blurs the understanding of what you really do. As a result, you end up transferring mush from one head to another.

You all write about your bicycles, supposedly you have invented some scientific method, and something is about to happen, but you lack computing power, or desire, or slaves, and so everything is on track. At the same time you can't give a strict definition of what exactly you are doing and whether there is logic in it. These are excuses for yourselves, an emotional approach.

Sometimes it is useful to write one more article to systematise scattered words and thoughts, then the logic of actions will be clear. Otherwise, you are doing something, but you have forgotten about the foundation, where you started, see if everything is in order with logic and if it has not become detached from reality.

New terms are introduced just to organise the accumulated information and to be able to generalise it and move on.

The fact that I come up with different things is so, something works, something doesn't. You will not deny that you repeated in your article one of my ideas stated here, will you?

You shouted that I was a fool to pick leaves a couple of years ago, and now mytarmailS is doing the same thing.

I may be taking something from the public lucubrations of reason in this thread, but I don't speak disparagingly until I understand or verify.

Reason: