Discussing the article: "Uncertainty as a Model (Part 6): Multiple Regression and Diagnostics"

[MetaQuotes]

Check out the new article: Uncertainty as a Model (Part 6): Multiple Regression and Diagnostics.

A practical introduction to multiple regression with deterministic factors for financial time series. Topics covered include the formulation and matrix form of ordinary least squares (OLS), residual diagnostics, EDA/CDA, R-squared and adjusted R-squared, the F-test, RESET, the Breusch–Pagan test, VIF, and Cook’s distance. Techniques for working with regressors are demonstrated: dummy variables, nonlinear transformations, and interaction terms. Examples involving trends, days of the week, and news help select factors and build models suitable for forecasting.

The dependent variable is typically influenced by a combination of factors. Analyzing them separately using simple regression yields misleading results, especially if the regressors are correlated with one another. In this case, the influence of unaccounted-for factors is transferred to the random component, thereby depriving the model of its key properties. The parameter estimates become biased: they systematically overestimate or underestimate the true degree of influence of the variables.

However, this does not mean that the model should include as many predictors as possible. Redundant variables that have no real connection to the process under study reduce the model's accuracy and lead to incorrect conclusions.

Thus, the task is to construct a multiple regression model that accounts for the simultaneous influence of several factors. To do this, we need mathematical tools to compare different specifications. This will allow us to select the set of regressors that best describes the relationship under study and is suitable for solving practical problems.

Author: Aleksey Nikolayev