Forward Results wrong and other issues.

New comment
 

When I use the strategy tester to backtest and then do forward testing there are some weird things that happen. First until some seemingly random power of 2 (512 for this example) it does way more passes than 512 to get there. It will show in the agents viewer that passes are being completed but they don't add to the final passes at the bottom. It then stays at the power of 2 (512) for a long time while there are still passes that are completed. Then after a while it will slowly start to speed up again. So just 1 more pass at a time at first but it will slowly ramp up speed. Finally it hits a steady amount that actually correlates to the passes shown in the agents. This might all happen because the backtest will go on for say 100,000 passes and the forward test will say out of 50,000. So it says 50,000 but it is actually doing al 100,000. The second more important problem is that some of the forward test results are just flat out wrong. This only happens near the highest results achieved on the backtest. It will just display for the forward results a number way higher than it should be. I have a custom function that to determine the results and when I calculate it myself its way lower than what shows up. You can also see it with passes that are correct and very near the forward results. When they are run they have near the same result but the graph and the forward tab (not forward results) show they have way different profits. The profit is most of my custom functions output. I'm attaching some pictures if that will help anyone tell me what is going on. Two show the slow starting of the test. One shows two very similar forward results but the one that is 780 is wrong. The other 2 show the results graph for the 410 backtest and the 780 backtest. The one that shows a higher result for the forward test is the 410 backtest. The 780 which should be very similar gets a much lower profit.

Here is my messy weird needlessly complicated custom results function. Multiply and stopitboi are if the test ends early by going below a certain dollar amount.

   float multiply = 1;
   if(stopitboi)
      multiply = .75f;
   if(TesterStatistics(STAT_PROFIT) < 0)
     {
      if(TesterStatistics(STAT_TRADES) < 15)
         return -10;
      return ((TesterStatistics(STAT_PROFIT) - TesterStatistics(STAT_TRADES) * .02) + TesterStatistics(STAT_RECOVERY_FACTOR) * .5) * multiply;
     }
   if(TesterStatistics(STAT_TRADES) < 15)
      multiply = .25f;
   if(TesterStatistics(STAT_TRADES) == 0)
      return -10;
   if(TesterStatistics(STAT_PROFIT) < 75)
      return (TesterStatistics(STAT_PROFIT) * 1.25 + TesterStatistics(STAT_EXPECTED_PAYOFF) + 100 + TesterStatistics(STAT_PROFIT) * TesterStatistics(STAT_EXPECTED_PAYOFF) + (TesterStatistics(STAT_PROFIT) - TesterStatistics(STAT_TRADES) * .02) - TesterStatistics(STAT_BALANCEDD_PERCENT) * (5 / ((76 - TesterStatistics(STAT_PROFIT))))) * multiply;
   return (TesterStatistics(STAT_PROFIT) * 1.25 + TesterStatistics(STAT_EXPECTED_PAYOFF) + 100 + TesterStatistics(STAT_PROFIT) * TesterStatistics(STAT_EXPECTED_PAYOFF) + (TesterStatistics(STAT_PROFIT) - TesterStatistics(STAT_TRADES) * .02) - TesterStatistics(STAT_BALANCEDD_PERCENT) * 5) * multiply;
  }
New comment