Yalnızca ürünü satın alan veya kiralayan kullanıcılar yorum yazabilir
12
31416  
Dear developer. I have given a try to your forecasting tool. So far it looks intuitive. I know it is still work in progress. I would like to receive any update on improved performance and enhanced capabilities, please. Many thanks. jorge.cidmoreno@gmail.com.
Vahidreza Heidar Gholami  
jorge_cid #:
Dear developer. I have given a try to your forecasting tool. So far it looks intuitive. I know it is still work in progress. I would like to receive any update on improved performance and enhanced capabilities, please. Many thanks. jorge.cidmoreno@gmail.com.

Hello,

Thank you for your interest in my products. You will be automatically notified by the MQL5 system for any new updates.

silvioit CORRAO  
Hi, I’d like to know if are implemented push notifications, thank you!

Silvio
Vahidreza Heidar Gholami  
silvioit #:
Hi, I’d like to know if are implemented push notifications, thank you!

Silvio

Hello,

Push notifications are useful when there's an algorithm continually checking the market for a certain event. However, MetaForecast version 1.6 does not have such an algorithm, but I consider it to be included in subsequent versions.

Thank you

Lev Vladimirovic Marushkin  
hi, thank you for the update! interesting! but i dont understand one thing: does the indicator save the neural network data somewhere? it looks like not. so when i close the chart or change the pair then all trained data is lost? thank you for clarification 👍😊
Vahidreza Heidar Gholami  
Lev Vladimirovic Marushkin #:
hi, thank you for the update! interesting! but i dont understand one thing: does the indicator save the neural network data somewhere? it looks like not. so when i close the chart or change the pair then all trained data is lost? thank you for clarification 👍😊
Hello, saving and loading AI models will be available soon in the next version. Thank you.
Lev Vladimirovic Marushkin  
Vahidreza Heidar Gholami #:
Hello, saving and loading AI models will be available soon in the next version. Thank you.

😊👍👌😁

Vahidreza Heidar Gholami  
Lev Vladimirovic Marushkin #:

😊👍👌😁

The latest version is now available! You can now save and load AI models. Simply press 'S' to save a model or 'L' to load it. Additionally, There is a new input under Neural Network settings where you can specify a file name for your AI model. The models are saved with .ai extensions in the \MetaForecast\Models folder. You can share your models with other users.

Thank you for your support!
Lev Vladimirovic Marushkin  
Thank you very much for your work! I'm excited to test this indicator later! 😊👍

I have a question about leveraging my RTX 4090 OC GPU for a substantial project: I am considering developing a very large neural network to analyze M15 timeframe data using a decade's worth of historical information. (+10 years history data!!)

Before I begin, I'd like your expert opinion. Do you think it's feasible to use this indicator for such an extensive analysis? If so, could you recommend any specific settings or a configuration file that would best suit this long-term data approach?

Thanks a lot! 👌😁
Vahidreza Heidar Gholami  
Lev Vladimirovic Marushkin #:
Thank you very much for your work! I'm excited to test this indicator later! 😊👍

I have a question about leveraging my RTX 4090 OC GPU for a substantial project: I am considering developing a very large neural network to analyze M15 timeframe data using a decade's worth of historical information. (+10 years history data!!)

Before I begin, I'd like your expert opinion. Do you think it's feasible to use this indicator for such an extensive analysis? If so, could you recommend any specific settings or a configuration file that would best suit this long-term data approach?

Thanks a lot! 👌😁

I think the Past Size for 10 years in the M15 timeframe will be about 250,000 bars. For a GPU like the 4090, it will be easy to train a model using this amount of data. Try Layers=[1000, 2000, 100] or [10000,100]. You can test other different architectures for your layers to find the desired network. Thank you
Lev Vladimirovic Marushkin  
Thank you for your help! Unfortunately when setting Neural Network as Prediction Method and using Degree = 0 then it looks like there is a bug or something.. i dont know... all i know is that it does not really work. Even if i set past size a small number like 1000, 3000 or 5000 it is always the same problem. All i get are some huge lines up and down which are completely useless, please see image: 
Hope you can fix the problem. Thank you 👍

Vahidreza Heidar Gholami  
Lev Vladimirovic Marushkin #:
Thank you for your help! Unfortunately when setting Neural Network as Prediction Method and using Degree = 0 then it looks like there is a bug or something.. i dont know... all i know is that it does not really work. Even if i set past size a small number like 1000, 3000 or 5000 it is always the same problem. All i get are some huge lines up and down which are completely useless, please see image: 
Hope you can fix the problem. Thank you 👍


No, this is not a bug. When you receive an output like this without a fitted yellow line, it indicates that the model is unable to learn from the data. Please ensure that the degree input is greater than zero. However, it's important to note that in the current version, the neural network method does not support degrees greater than one. Any degree greater than one will be internally changed back to one.

Lev Vladimirovic Marushkin  
Vahidreza Heidar Gholami #:

No, this is not a bug. When you receive an output like this without a fitted yellow line, it indicates that the model is unable to learn from the data. Please ensure that the degree input is greater than zero. However, it's important to note that in the current version, the neural network method does not support degrees greater than one. Any degree greater than one will be internally changed back to one.

Dear Vahidreza,

lets go step by step.

Step 1:

You say: " without a fitted yellow line, it indicates that the model is unable to learn from the data"

The point is that the yellow line is NOT missing. It is there but on the screenshot you can not see it because of the chart scale. Please check the next screenshot where i used an extreme chart scale to make everything visible. As you see on the screenshot below in the middle we have the "squeezed" price data (because of the chart scale) and you also see the pink forecast data with HUGE swings up and down and you can also see the blue regression line and the yellow line. So everything is there but the data is useless obviously.




Step 2:

You say:

0 For degree 0, it is recommended to use a large value for the "Past size" input to cover all peaks and troughs and details in the price.
1
For degree 1, MetaForecast can understand trends and generate better results with a smaller "Past size".


So what is my mistake? I want to use large value for the past size and therefore i have set degree = 0 as recommended on the product page. I want to build a neural network based on the last 10 years on M15 TF. So i set degree = 0. Because as you say degree = 1 is for smaller past size! right? So i have set degree = 0

Step 3: Here is the log


Step 4:

Here are my settings




I am a very experienced user regarding Metatrader. Please tell me detailed how to create a usable neural network model with your indicator with degree = 0.  I am setting degree = 0 only because i am following your instructions:

Degree Description
0 For degree 0, it is recommended to use a large value for the "Past size" input to cover all peaks and troughs and details in the price.

Thank you very much! 👍😊

Vahidreza Heidar Gholami  
Lev Vladimirovic Marushkin #:

Dear Vahidreza,

lets go step by step.

Step 1:

You say: " without a fitted yellow line, it indicates that the model is unable to learn from the data"

The point is that the yellow line is NOT missing. It is there but on the screenshot you can not see it because of the chart scale. Please check the next screenshot where i used an extreme chart scale to make everything visible. As you see on the screenshot below in the middle we have the "squeezed" price data (because of the chart scale) and you also see the pink forecast data with HUGE swings up and down and you can also see the blue regression line and the yellow line. So everything is there but the data is useless obviously.




Step 2:

You say:

0 For degree 0, it is recommended to use a large value for the "Past size" input to cover all peaks and troughs and details in the price.
1
For degree 1, MetaForecast can understand trends and generate better results with a smaller "Past size".


So what is my mistake? I want to use large value for the past size and therefore i have set degree = 0 as recommended on the product page. I want to build a neural network based on the last 10 years on M15 TF. So i set degree = 0. Because as you say degree = 1 is for smaller past size! right? So i have set degree = 0

Step 3: Here is the log


Step 4:

Here are my settings




I am a very experienced user regarding Metatrader. Please tell me detailed how to create a usable neural network model with your indicator with degree = 0.  I am setting degree = 0 only because i am following your instructions:

Degree Description
0 For degree 0, it is recommended to use a large value for the "Past size" input to cover all peaks and troughs and details in the price.

Thank you very much! 👍😊

As I mentioned in my previous response, for the neural network method, use degree one. In the product description, it states that for degree 0, it's better to use a large past size. However, this doesn't mean the opposite is true. So, for large past sizes, you don't need degree 0. The most important parameters you should focus on are the past size and the layers input. The neural network method is different from the trigonometric method. I will create a tutorial video about the recent new features as soon as possible.
Lev Vladimirovic Marushkin  
Vahidreza Heidar Gholami #:
As I mentioned in my previous response, for the neural network method, use degree one. In the product description, it states that for degree 0, it's better to use a large past size. However, this doesn't mean the opposite is true. So, for large past sizes, you don't need degree 0. The most important parameters you should focus on are the past size and the layers input. The neural network method is different from the trigonometric method. I will create a tutorial video about the recent new features as soon as possible.

😊👍😁👌❤️

Lev Vladimirovic Marushkin  

Please be so kind and answer one more question:

I do not understand the relationship between:

a) 

Past Size

Specifies the number of bars that MetaForecast uses to create a model for generating future predictions. The model is represented by a yellow line drawn over the selected bars.

and:

b)

Layers

This input configures a brain for your AI model. For example, if we enter [1000, 2000, 100], this indicates that the model accepts 1000 past bars as input, utilizes 2000 neurons to forecast 100 bars into the future. If we enter [1000, 2000, 500, 200, 100], this signifies that the model accepts 1000 past bars as input and employs a deep neural network with 3 layers containing 2000, 500, and 200 neurons, respectively, to forecast 100 bars into the future. As you can see, you can create a network with any desired depth. For the examples above, a minimum past size of 1000 is recommended. However, a past size of 3000 is generally better. As a rule of thumb, the larger the size of the layers in your model, the larger the past size should be.


For example if i set "Past Size" = 10.000 bars  and then i set "Layers" to for example:  [1000, 2000, 100]

Now the indicator will train based on 10.000 bars (past size) but the neural network only "accepts" the last 1000 past bars as input.

What does this really mean?

Will the training now be based on the last 10.000 bars (past size setting) OR: based on the last 1000 bars because of the layers setting  [1000, 2000, 100] ?

Thanks 

Vahidreza Heidar Gholami  
Lev Vladimirovic Marushkin #:

Please be so kind and answer one more question:

I do not understand the relationship between:

a) 

Past Size

Specifies the number of bars that MetaForecast uses to create a model for generating future predictions. The model is represented by a yellow line drawn over the selected bars.

and:

b)

Layers

This input configures a brain for your AI model. For example, if we enter [1000, 2000, 100], this indicates that the model accepts 1000 past bars as input, utilizes 2000 neurons to forecast 100 bars into the future. If we enter [1000, 2000, 500, 200, 100], this signifies that the model accepts 1000 past bars as input and employs a deep neural network with 3 layers containing 2000, 500, and 200 neurons, respectively, to forecast 100 bars into the future. As you can see, you can create a network with any desired depth. For the examples above, a minimum past size of 1000 is recommended. However, a past size of 3000 is generally better. As a rule of thumb, the larger the size of the layers in your model, the larger the past size should be.


For example if i set "Past Size" = 10.000 bars  and then i set "Layers" to for example:  [1000, 2000, 100]

Now the indicator will train based on 10.000 bars (past size) but the neural network only "accepts" the last 1000 past bars as input.

What does this really mean?

Will the training now be based on the last 10.000 bars (past size setting) OR: based on the last 1000 bars because of the layers setting  [1000, 2000, 100] ?

Thanks 

MetaForecast doesn't know the future of the last 1000 bars among the 10,000 selected bars. That's why it feeds the network with other chunks of data from these 10,000 bars, whose futures are known, to train your network.

Lev Vladimirovic Marushkin  
tried a lot of stuff. here are the results:

When i do everything as recommended then i either get a useless small model which will show an extremely squeezed prediction line where regression line is almost horizontal all the time so zero predictive value OR i get errors like this:

2024.04.22 15:42:37.059 MetaForecast M5 (AUDCAD,M15) Processing data...
2024.04.22 15:42:37.077 MetaForecast M5 (AUDCAD,M15) Inferencing futrue...
2024.04.22 15:42:37.080 MetaForecast M5 (AUDCAD,M15) Writing future...
2024.04.22 15:42:37.080 MetaForecast M5 (AUDCAD,M15) Creating regression lines ...
2024.04.22 15:42:38.710 MetaForecast M5 (AUDCAD,M15) Model Initialized.
2024.04.22 15:42:44.330 MetaForecast M5 (AUDCAD,M15) Processing data...
2024.04.22 15:42:44.347 MetaForecast M5 (AUDCAD,M15) Creating dataset and writing to GPU...
2024.04.22 15:42:44.555 MetaForecast M5 (AUDCAD,M15) Error in Tensor.Write. Error code=5101
2024.04.22 15:42:44.555 MetaForecast M5 (AUDCAD,M15) Error in Tensor.Write. Error code=5101
2024.04.22 15:42:44.555 MetaForecast M5 (AUDCAD,M15) Training...
2024.04.22 15:42:44.559 MetaForecast M5 (AUDCAD,M15) Error in ReadAt. Error code=5101
2024.04.22 15:42:44.559 MetaForecast M5 (AUDCAD,M15) 100% >>   Epoch: 1   Loss: 0.00000000
2024.04.22 15:42:44.559 MetaForecast M5 (AUDCAD,M15) Time= 3ms
2024.04.22 15:42:44.572 MetaForecast M5 (AUDCAD,M15) Inferencing past...
2024.04.22 15:42:44.572 MetaForecast M5 (AUDCAD,M15) Error in Tensor.Write. Error code=5101
2024.04.22 15:42:44.572 MetaForecast M5 (AUDCAD,M15) Error in Tensor.Write. Error code=5101
2024.04.22 15:42:44.572 MetaForecast M5 (AUDCAD,M15) Error in BufferRead. Error code=5101
2024.04.22 15:42:44.585 MetaForecast M5 (AUDCAD,M15) Inferencing futrue...
2024.04.22 15:42:44.585 MetaForecast M5 (AUDCAD,M15) Error in Tensor.Write. Error code=5101
2024.04.22 15:42:44.595 MetaForecast M5 (AUDCAD,M15) Error in BufferRead. Error code=5101
2024.04.22 15:42:44.595 MetaForecast M5 (AUDCAD,M15) Writing past...
2024.04.22 15:42:44.598 MetaForecast M5 (AUDCAD,M15) Writing future...
2024.04.22 15:42:44.598 MetaForecast M5 (AUDCAD,M15) Creating regression lines ...



The only way i found to create a big like 1,5 GB sized model which seems to be of value is by using past size = 32.000 and layers:  [32000, 10000, 100] or similar layer settings.

The weird thing here is that based on your last reply my settings make no sense at all, because basically i am telling the indicator past size = 32.000 bars and MetaForecast doesn't know the future of the last 32.000 bars among the 32.000 selected bars.

So this means there are ZERO bars the indicator can train on. But instead of showing me an error or similar the indicator uses like 16GB of VRAM and 100% usage of my monster GPU for a longer time and produces a huge 1,5 GB sized model.

What is going on? And when i do what is recommend basically it either produces a useless model of a few MB size or an error like the one above and no model at all.


Vahidreza Heidar Gholami  
Lev Vladimirovic Marushkin #:
tried a lot of stuff. here are the results:

When i do everything as recommended then i either get a useless small model which will show an extremely squeezed prediction line where regression line is almost horizontal all the time so zero predictive value OR i get errors like this:

2024.04.22 15:42:37.059 MetaForecast M5 (AUDCAD,M15) Processing data...
2024.04.22 15:42:37.077 MetaForecast M5 (AUDCAD,M15) Inferencing futrue...
2024.04.22 15:42:37.080 MetaForecast M5 (AUDCAD,M15) Writing future...
2024.04.22 15:42:37.080 MetaForecast M5 (AUDCAD,M15) Creating regression lines ...
2024.04.22 15:42:38.710 MetaForecast M5 (AUDCAD,M15) Model Initialized.
2024.04.22 15:42:44.330 MetaForecast M5 (AUDCAD,M15) Processing data...
2024.04.22 15:42:44.347 MetaForecast M5 (AUDCAD,M15) Creating dataset and writing to GPU...
2024.04.22 15:42:44.555 MetaForecast M5 (AUDCAD,M15) Error in Tensor.Write. Error code=5101
2024.04.22 15:42:44.555 MetaForecast M5 (AUDCAD,M15) Error in Tensor.Write. Error code=5101
2024.04.22 15:42:44.555 MetaForecast M5 (AUDCAD,M15) Training...
2024.04.22 15:42:44.559 MetaForecast M5 (AUDCAD,M15) Error in ReadAt. Error code=5101
2024.04.22 15:42:44.559 MetaForecast M5 (AUDCAD,M15) 100% >>   Epoch: 1   Loss: 0.00000000
2024.04.22 15:42:44.559 MetaForecast M5 (AUDCAD,M15) Time= 3ms
2024.04.22 15:42:44.572 MetaForecast M5 (AUDCAD,M15) Inferencing past...
2024.04.22 15:42:44.572 MetaForecast M5 (AUDCAD,M15) Error in Tensor.Write. Error code=5101
2024.04.22 15:42:44.572 MetaForecast M5 (AUDCAD,M15) Error in Tensor.Write. Error code=5101
2024.04.22 15:42:44.572 MetaForecast M5 (AUDCAD,M15) Error in BufferRead. Error code=5101
2024.04.22 15:42:44.585 MetaForecast M5 (AUDCAD,M15) Inferencing futrue...
2024.04.22 15:42:44.585 MetaForecast M5 (AUDCAD,M15) Error in Tensor.Write. Error code=5101
2024.04.22 15:42:44.595 MetaForecast M5 (AUDCAD,M15) Error in BufferRead. Error code=5101
2024.04.22 15:42:44.595 MetaForecast M5 (AUDCAD,M15) Writing past...
2024.04.22 15:42:44.598 MetaForecast M5 (AUDCAD,M15) Writing future...
2024.04.22 15:42:44.598 MetaForecast M5 (AUDCAD,M15) Creating regression lines ...



The only way i found to create a big like 1,5 GB sized model which seems to be of value is by using past size = 32.000 and layers:  [32000, 10000, 100] or similar layer settings.

The weird thing here is that based on your last reply my settings make no sense at all, because basically i am telling the indicator past size = 32.000 bars and MetaForecast doesn't know the future of the last 32.000 bars among the 32.000 selected bars.

So this means there are ZERO bars the indicator can train on. But instead of showing me an error or similar the indicator uses like 16GB of VRAM and 100% usage of my monster GPU for a longer time and produces a huge 1,5 GB sized model.

What is going on? And when i do what is recommend basically it either produces a useless model of a few MB size or an error like the one above and no model at all.


Encountering these errors indicates that your layer sizes are excessively large for your current settings, leading to the generation of tensors that exceed MT5's capacity to handle.

Please note that upon encountering these errors, closing the chart and restarting your terminal is necessary to restore proper functionality.

Implementing neural networks within MT5 indicators presents several limitations. MT5's array indexing operates on 32-bit integers. Using large sizes alongside multiple symbols and the multi-modle feature result in index overflows or negative indexing, triggering system errors. For instance, the mentioned layer sizes could produce matrices as large as 32000 x 10000, potentially overwhelming your GPU that makes it to be not a monster any more. However, smaller models remain valuable. With MetaForecast, you can construct adequately big models relative to the available data for a given asset.

Using a past size smaller than the network's input size is acceptable because MetaForecast uses PastSize + InputSize amount of data, and it will inform you in case this amount of data is not available.

If you don't want to wait for the training process and want to break it, simply remove the indicator from your chart.

Lev Vladimirovic Marushkin  
Vahidreza Heidar Gholami #:

MetaForecast doesn't know the future of the last 1000 bars among the 10,000 selected bars. That's why it feeds the network with other chunks of data from these 10,000 bars, whose futures are known, to train your network.

Subject: Request for Detailed Clarification on Data Utilization in MetaForecast

Dear Vahidreza,

I hope this message finds you well. I've been diligently trying to optimize the use of the MetaForecast indicator, particularly understanding how the training data is structured and utilized, especially in relation to the Past Size and Layers settings.

I have configured the indicator with a Past Size of 10,000 bars and a Layers setting of [1000, 2000, 100]. From our previous discussions, it is my understanding that MetaForecast uses Past Size plus Input Size amount of data, totaling 11,000 bars in this setup. Could you please clarify exactly how these bars are utilized for training the neural network?

To ensure clarity in our discussion, let's define each bar on the chart as follows:

  • The current live bar (which has not yet closed) is labeled as shift = 0 .
  • The most recently closed bar is shift = 1 .
  • The bar before that is shift = 2 , and so on, increasing the shift count as we go further back in history.

Given this naming convention, could you specify which exact bars are used for training? For instance, does the training use data from shift = 1 to shift = 10,000 ?

Additionally, you mentioned that MetaForecast does not know the future of the last 1,000 bars. Could you specify which bars these are? Would they be from shift = 10,000 to shift = 11,000 ? How are these bars handled during the training process? Are they used as a form of out-of-sample testing to gauge the model’s predictive accuracy, or do they serve another purpose?

Understanding these details will greatly enhance my ability to use MetaForecast effectively and contribute a well-informed positive review. I am genuinely enthusiastic about the capabilities of your tool and eager to fully grasp its operational mechanics.

Thank you very much for your time and assistance. 😊👍

Best regards,

Lev 

Yalnızca ürünü satın alan veya kiralayan kullanıcılar yorum yazabilir
12