A British biometrician Sir Francis Galton defined regression as stepping back towards the average He found that the offspring of abnormally tall or short parents tends to regress or step back to average ID: 933393
Download Presentation The PPT/PDF document "REGRESSION Meaning of regression" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
REGRESSION
Meaning of regression: A British biometrician, Sir Francis Galton, defined regression as ‘stepping back towards the average’. He found that the offspring of abnormally tall or short parents tends to regress or step back to average.Line of regression: If a straight line can be drawn through the points of a scatter diagram, it is called as the line of regression.
1
Slide2Regression Equation
: Regression equation establishes a linear mathematical relationship between the two variables.Use of regression equation: Regression equations are used to estimate/ predict values of one variable from the known values of the other.2
Slide3Let the regression line be represented by the equation
Y = A + BX or Y = a + bXHere X is called the independent variable and Y is called the dependent variable.The equation of the regression line can be obtained by minimization of error from the above mentioned equation. While doing so we get the following two NORMAL EQUATIONS.
3
Slide4Σyi = n a + b Σxi --------------- 1
Σ
x
i
y
i
= a Σxi + b Σxi2 -------------- 2 These are two equations in two unknowns a and b. On solving them simultaneously, we get,
4
Slide55
Slide6Regression equation of Y on X
y = a + bxOr _ _(y-y) = byx(x-x) _ _
where
b
yx
= 1/n ∑(x
i
– x)(yi – y) _ 1/n∑(xi – x)2 6
Slide7Let the regression line be represented by the equation
X = a’ + b’Y or x = a’ + yb’Here Y is called the independent variable and X is called the dependent variable.The equation of the regression line can be obtained by minimization of error from the above mentioned equation. While doing so we get the following two NORMAL EQUATIONS.7
Slide8Σ
xi = n a’ + b’ Σyi --------------- 1Σx
i
y
i
= a’
Σ
yi + b’ Σyi2 -------------- 2 These are two equations in two unknowns a’ and b’. On solving them simultaneously, we get, 8
Slide99
Slide10Regression equation of X on Y
x = a’ + b’y _ _(x – x) = bxy(y – y) _ _where bxy
= 1/n ∑(x
i
– x)(
y
i
– y) _ 1/n∑(yi – y)210
Slide11Why are there two line of regression?
There are two lines of regression: One of Y on X and the other of X on Y. The line of regression of Y on X is used to estimate or predict the value of Y for any given value of X i.e. when Y is a dependent variable and X is an independent variable. The estimate so obtained will be best in the sense that it will have the minimum possible error as defined by the principle of least squares.
11
Slide12We can also estimate X for any given value of Y by using the same equation Y = a +
bX but the estimate so obtained will not be best since this equation is obtained by minimizing the sum of squares of errors of estimate in Y and not in X.Hence to estimate X for any given value of Y we use the regression equation of X on Y which is derived on minimizing the sum of squares of errors of estimates in X. Here X is a dependent variable and Y is an independent variable.
12
Slide13The two regression equations are not reversible or interchangeable because the basis and assumption for deriving these equations are quite different.
The regression equation of Y on X is obtained on minimizing the sum of squares of the errors parallel to the Y–axis while the regression equation of X on Y is obtained on minimizing the sum of squares of the errors parallel to the X-axis. 13
Slide14Properties of Regression Coefficients
1. Regression coefficients represent the slopes of the respective lines of regression.2. The point of intersection of the two regression lines is ____ ____
at (X, Y).
3.
A
regression coefficient represents the increment in the value of the dependent variable corresponding to a unit change in the value of the independent variable.
4. 14
Slide15Note
: The sign of r depends on the sign of the regression coefficients. If the regression coefficients are positive, r will be positive and if the regression coefficients are negative, r will be negative.4. If one of the regression coefficients is less than unity, the other must be greater than unity.i.e. if byx < 1 then b
xy
> 1 and if
b
xy
< 1 then
byx > 1 5. The arithmetic mean of the regression coefficients is always greater than or equal to the correlation coefficient. i.e. ½ (bxy + byx) > r
15