ML Polynomial Regression
y= b_{0}+b_{1}x_{1}+ b_{2}x_{1}^{2}+ b_{2}x_{1}^{3}+...... b_{n}x_{1}^{n}
Need for Polynomial Regression:The need of Polynomial Regression in ML can be understood in the below points:
Note: A Polynomial Regression algorithm is also called Polynomial Linear Regression because it does not depend on the variables, instead, it depends on the coefficients, which are arranged in a linear fashion.Equation of the Polynomial Regression Model:Simple Linear Regression equation: y = b_{0}+b_{1}x .........(a) Multiple Linear Regression equation: y= b_{0}+b_{1}x+ b_{2}x_{2}+ b_{3}x_{3}+....+ b_{n}x_{n} .........(b) Polynomial Regression equation: y= b_{0}+b_{1}x + b_{2}x^{2}+ b_{3}x^{3}+....+ b_{n}x^{n} ..........(c) When we compare the above three equations, we can clearly see that all three equations are Polynomial equations but differ by the degree of variables. The Simple and Multiple Linear equations are also Polynomial equations with a single degree, and the Polynomial regression equation is Linear equation with the nth degree. So if we add a degree to our linear equations, then it will be converted into Polynomial Linear equations. Note: To better understand Polynomial Regression, you must have knowledge of Simple Linear Regression.Implementation of Polynomial Regression using Python:Here we will implement the Polynomial Regression using Python. We will understand it by comparing Polynomial Regression model with the Simple Linear Regression model. So first, let's understand the problem for which we are going to build the model. Problem Description: There is a Human Resource company, which is going to hire a new candidate. The candidate has told his previous salary 160K per annum, and the HR have to check whether he is telling the truth or bluff. So to identify this, they only have a dataset of his previous company in which the salaries of the top 10 positions are mentioned with their levels. By checking the dataset available, we have found that there is a nonlinear relationship between the Position levels and the salaries. Our goal is to build a Bluffing detector regression model, so HR can hire an honest candidate. Below are the steps to build such a model. Steps for Polynomial Regression:The main steps involved in Polynomial Regression are given below:
Note: Here, we will build the Linear regression model as well as Polynomial Regression to see the results between the predictions. And Linear regression model is for reference.Data Preprocessing Step: The data preprocessing step will remain the same as in previous regression models, except for some changes. In the Polynomial Regression model, we will not use feature scaling, and also we will not split our dataset into training and test set. It has two reasons:
The code for preprocessing step is given below: Explanation:
Output: By executing the above code, we can read our dataset as: As we can see in the above output, there are three columns present (Positions, Levels, and Salaries). But we are only considering two columns because Positions are equivalent to the levels or may be seen as the encoded form of Positions. Here we will predict the output for level 6.5 because the candidate has 4+ years' experience as a regional manager, so he must be somewhere between levels 7 and 6. Building the Linear regression model: Now, we will build and fit the Linear regression model to the dataset. In building polynomial regression, we will take the Linear regression model as reference and compare both the results. The code is given below: In the above code, we have created the Simple Linear model using lin_regs object of LinearRegression class and fitted it to the dataset variables (x and y). Output: Out[5]: LinearRegression(copy_X=True, fit_intercept=True, n_jobs=None, normalize=False) Building the Polynomial regression model: Now we will build the Polynomial Regression model, but it will be a little different from the Simple Linear model. Because here we will use PolynomialFeatures class of preprocessing library. We are using this class to add some extra features to our dataset. In the above lines of code, we have used poly_regs.fit_transform(x), because first we are converting our feature matrix into polynomial feature matrix, and then fitting it to the Polynomial regression model. The parameter value(degree= 2) depends on our choice. We can choose it according to our Polynomial features. After executing the code, we will get another matrix x_poly, which can be seen under the variable explorer option: Next, we have used another LinearRegression object, namely lin_reg_2, to fit our x_poly vector to the linear model. Output: Out[11]: LinearRegression(copy_X=True, fit_intercept=True, n_jobs=None, normalize=False) Visualizing the result for Linear regression: Now we will visualize the result for Linear regression model as we did in Simple Linear Regression. Below is the code for it: Output: In the above output image, we can clearly see that the regression line is so far from the datasets. Predictions are in a red straight line, and blue points are actual values. If we consider this output to predict the value of CEO, it will give a salary of approx. 600000$, which is far away from the real value. So we need a curved model to fit the dataset other than a straight line. Visualizing the result for Polynomial Regression Here we will visualize the result of Polynomial regression model, code for which is little different from the above model. Code for this is given below: In the above code, we have taken lin_reg_2.predict(poly_regs.fit_transform(x), instead of x_poly, because we want a Linear regressor object to predict the polynomial features matrix. Output: As we can see in the above output image, the predictions are close to the real values. The above plot will vary as we will change the degree. For degree= 3: If we change the degree=3, then we will give a more accurate plot, as shown in the below image. SO as we can see here in the above output image, the predicted salary for level 6.5 is near to 170K$190k$, which seems that future employee is saying the truth about his salary. Degree= 4: Let's again change the degree to 4, and now will get the most accurate plot. Hence we can get more accurate results by increasing the degree of Polynomial. Predicting the final result with the Linear Regression model: Now, we will predict the final output using the Linear regression model to see whether an employee is saying truth or bluff. So, for this, we will use the predict() method and will pass the value 6.5. Below is the code for it: Output: [330378.78787879] Predicting the final result with the Polynomial Regression model: Now, we will predict the final output using the Polynomial Regression model to compare with Linear model. Below is the code for it: Output: [158862.45265153] As we can see, the predicted output for the Polynomial Regression is [158862.45265153], which is much closer to real value hence, we can say that future employee is saying true.
Next TopicClassification Algorithm
