Consider the function
This has been called the regression function in a textbook I'm using. I'm trying to figure out the relationship between this function and the classical linear regression model.
So, I know that it is a theorem* that we may write
for some random variable
Now suppose that we have
This is the classical 1-dimensional regression function (assuming the
Question: Is it then a mathematical theorem that if
And is this why the function
EDIT: The theorem that I am making use of is as follows (from All of Statistics pg. 89):
Regression models are sometimes written as
where