Can you tell me, who knows, how much do mismatch errors in graphs distort the test result, can this test be trusted?
>> distort. By how much? Different every time. But it's better to have no mistakes at all, don't you agree? Here's a link where Igor Kim explains popularly how to make a quality story
All ticks (most accurate method based on all smallest available timeframes)
Parameters
Lot=0.1; StopLoss=0; TrailingStop=0;
Bars in history
8716
Modelled ticks
1462505
Modeling quality
n/a
Chart mismatch errors
797
Initial deposit
1000.00
Net profit
851.04
Total profit
928.34
Total loss
-77.30
Profitability
12.01
Expected payoff
40.53
Absolute drawdown
3.30
Maximum drawdown
83.40 (4.44%)
Relative drawdown
5.60% (64.50)
Total trades
21
Short positions (% win)
8 (75.00%)
Long positions (% win)
13 (92.31%)
Profitable trades (% of all)
18 (85.71%)
Loss trades (% of all)
3 (14.29%)
Largest
profitable trade
124.84
losing deal
-52.90
Average
profitable deal
51.57
losing trade
-25.77
Maximum number
continuous wins (profit)
12 (637.50)
Continuous losses (loss)
1 (-52.90)
Maximum
Continuous Profit (number of wins)
637.50 (12)
Continuous loss (number of losses)
-52.90 (1)
Average
continuous winnings
5
Continuous loss
1
The results are completely different, I can only explain this by the fact that the ticks are randomly generated in each variant and because of this the TS works differently, and what to do about it, how can anything be adjusted if the result of the run depends on random tick formation and will be different each time?
The quality should be in percentages. And you have n/a.
It's not just the quality of the data that is the problem. I have TC running on ticks analysis and the fact that they are formed randomly leads to unstable operation of the system. I reloaded the history and run it with the same settings but the results are not stable.
But the results of the last two stats are very similar. There are EAs that produce different results every time, but this is very rare... Maybe it makes sense to move on? I think the profits are very good.
OrlandoMagic писал(а)>> But the results of the last two stats are very similar. There are Expert Advisors that show different results every time, but they are very rare. Maybe it makes sense to move further. The profits seem to be very good.
Of course I'm not going to stop, but I don't want to fight with windmills, you try to achieve stability by debugging the system, but the problem is that the quotes are not stable (I mean not the stability of quotes formation in the tester), but not the TS, and it often takes a long time to understand what is wrong and who is to blame.
All the numbers we play with in the tester reports are very relative, just one losing trade, which may follow immediately after the test stops, is enough to completely distort the picture of profits, drawdowns, etc. And it is impossible to guarantee that the next trade will not be loss-making. That is why I ask experienced real traders what to focus on when setting up a system for working in a real account, what parameters to use when performing system debugging.
For example, here is another test to the above mentioned one with slightly changed parameters. Which variant is more preferable for real trading, with bigger profit and bigger drawdown or vice versa?
All the numbers we play with in the tester reports are very relative, just one losing trade, which may follow immediately after the test stops, is enough to completely distort the picture of profits, drawdowns, etc. And it is impossible to guarantee that the next trade will not be loss-making. That is why I ask experienced real traders what to focus on when setting up a system for working in real trading, what parameters to use when performing system debugging.
For example, here is another test to the above mentioned one with slightly changed parameters. Which variant is more preferable for real trading, with bigger profit and bigger drawdown or vice versa?
Strategy Tester Report
Total trades
19
let me reiterate - this number of trades is not suitable for analysis, it's like pointing your fingers at luck!
Move on, I mean optimise on single (large) periods, and do forwards. But optimise on all ticks. By the way, about divergences, it's good to find out what causes them, maybe it's a bug in the code after all?
Once again, this number of trades is not suitable for analysis, it's like pointing a finger in the sky at luck!
Can you draw any conclusions based on this number? I cannot use a larger interval, I have no one-minute history. My TS is not optimized, I've given up optimizing it, it does not do me any good, but it spends too much time. I have adjusted my entries/exits using August's history (trades from 82 to 93). However I do not know what to do further, even 10% drawdown bothers me, and in this case it is more than 14%, if MM is used, it may increase many times.
Can you tell me, who knows, how much do mismatch errors in graphs distort the test result, can this test be trusted?
The tester is killing me! Again the question is how to treat this and what to believe?
Here are two TC runs in a row, with the same settings and on the same interval:
The results are completely different, I can only explain this by the fact that the ticks are randomly generated in each variant and because of this the TS works differently, and what to do about it, how can anything be adjusted if the result of the run depends on random tick formation and will be different each time?
The quality should be in percentages. And you have n/a
The quality should be in percentages. And you have n/a.
It's not just the quality of the data that is the problem. I have TC running on ticks analysis and the fact that they are formed randomly leads to unstable operation of the system. I reloaded the history and run it with the same settings but the results are not stable.
But the results of the last two stats are very similar. There are Expert Advisors that show different results every time, but they are very rare. Maybe it makes sense to move further. The profits seem to be very good.
Of course I'm not going to stop, but I don't want to fight with windmills, you try to achieve stability by debugging the system, but the problem is that the quotes are not stable (I mean not the stability of quotes formation in the tester), but not the TS, and it often takes a long time to understand what is wrong and who is to blame.
All the numbers we play with in the tester reports are very relative, just one losing trade, which may follow immediately after the test stops, is enough to completely distort the picture of profits, drawdowns, etc. And it is impossible to guarantee that the next trade will not be loss-making. That is why I ask experienced real traders what to focus on when setting up a system for working in a real account, what parameters to use when performing system debugging.
For example, here is another test to the above mentioned one with slightly changed parameters. Which variant is more preferable for real trading, with bigger profit and bigger drawdown or vice versa?
All the numbers we play with in the tester reports are very relative, just one losing trade, which may follow immediately after the test stops, is enough to completely distort the picture of profits, drawdowns, etc. And it is impossible to guarantee that the next trade will not be loss-making. That is why I ask experienced real traders what to focus on when setting up a system for working in real trading, what parameters to use when performing system debugging.
For example, here is another test to the above mentioned one with slightly changed parameters. Which variant is more preferable for real trading, with bigger profit and bigger drawdown or vice versa?
Total trades
19
let me reiterate - this number of trades is not suitable for analysis, it's like pointing your fingers at luck!
Once again, this number of trades is not suitable for analysis, it's like pointing a finger in the sky at luck!
Can you draw any conclusions based on this number? I cannot use a larger interval, I have no one-minute history. My TS is not optimized, I've given up optimizing it, it does not do me any good, but it spends too much time. I have adjusted my entries/exits using August's history (trades from 82 to 93). However I do not know what to do further, even 10% drawdown bothers me, and in this case it is more than 14%, if MM is used, it may increase many times.