Random Forest Tutorial for Beginners
Random Forest Tutorial for Beginners, Are you the one who is looking forward to know about random forest in Machine Learning? Or the one who is looking forward to know why random forest is better and advantages and disadvantages of random forest or Are you dreaming to become to certified Pro Machine Learning Engineer or Data Scientist, then stop just dreaming, get your Data Science certification course with Machine Learning from India’s Leading Data Science training institute.
Random forest is a supervised algorithm and can be used for both classification as well as regression type of problems in Machine Learning. It handless non linearity by exploiting correlation in between data points. In this blog, we will learn How the random forest algorithm works in Machine Learning and. Do you want to know random forest introduction and why random forest is better, So follow the below mentioned random forest tutorial for beginners from Prwatech and take advanced Data Science training with Machine Learning like a pro from today itself under 10+ Years of hands-on experienced Professionals.
Random Forest in Machine Learning
Classification is important methodology lies in supervised learning, which helps to classify the objects or data points of different properties. A precise classification is needed for classification based on different features is a key point in various business fields. Data science has provision of many algorithms for this like logistic regression, naive Bayes classifier, and support vector machine and decision trees. But the most popular technique is Random Forest.
Random forest is nothing but combination of decisions to identify and locate the data point in appropriate class. Before moving towards Random forest let’s revise Decision Tree algorithm.
Decision Tree- basic building block for random forest:
Decision tree is the most influential and popular tool for classification and prediction. Let’s see one example. Let’s consider we have dataset having some objects. For classifying that we have to ask some questions.
Although we saw the classification method for very simple example, the logic for the classification remains same for real time datasets. But for real time larger data set, it will be more beneficial to classify the objects using different decision trees performing collectively to give more efficient prediction. Here comes concept of Random Forest.
Random Forest Introduction:
Random forest is nothing but a set of a large number of discrete decision trees that work collaboratively. Each individual tree in the random forest gives a class prediction and the class with the most votes becomes model’s final prediction. For example, a Random forest has 6 decision trees giving results as follows:
Most of decision trees are giving output prediction as ‘1’. So, the overall prediction output in this random forest will be ‘1’. So random forest is said to be a large number of relatively uncorrelated trees operating as a committee, which will beat any of the individual integral models. Here the key is a low correlation between trees. Uncorrelated models can generate collaborative predictions that are more precise than any of the individual predictions.
The trees prevent from individual errors as long as they don’t constantly give errors in same direction. So, the prerequisites for random forest include some signal in features so that models built using those features do better than random guessing. The predictions and errors made by the individual trees need to have low correlations with each other. Hence chances of getting appropriate prediction are more.
Advantages and Disadvantages of Random Forest:
Random forest can be used for regression and classification problems, making it a miscellaneous model.
Prevents over fitting of data.
Fast to train with test data.
Process of predictions becomes slow, once model is made.
Presence of outliers can impact on overall performance.
Why Random Forest is Better?
We have to use the mean squared error (MSE), while applying random forest algorithm to see how your data divides from each node.
N : Number of data points
fi : The value returned by the model
yi : The actual value for data point i
Above formula measures the distance of each node from the predicted actual value, helps to decide which branch has the better decision for your forest. ‘yi’ is value of data point that is tested at specific node and ‘fi’ is returned value, by decision tree.
While performing Random Forests based on a classification dataset, you must know that you are normally using the Gini index, or the formula used to decide how nodes on a decision tree branch.
In this formula the class and probability to determine the Gini of each branch on a node, determining which branches are more likely to occur. Here, pi represents relative frequency of a class you are observing in dataset and c represents the number of classes. You can even use entropy to determine how nodes branch in a decision tree.
Entropy uses the probability of a certain outcome to make a decision on how a node should branch.
How Random Forest Algorithm works in Machine Learning?
Using python we can implement random forest as follows:
Initialize and import Libraries
import numpy as np
import pandas as pd
import matplotlib.pyplot as plt
Import the data set
data = pd.read_csv(“Your File Path”)
Divide the data set into independent and dependent parts and perform feature selection
x = data.iloc[:,0:20] #independent columns
y = data.iloc[:,-1] #dependent columns
Split the dataset into two parts for training and testing
from sklearn.model_selection import train_test_split
X_train, X_test, y_train, y_test = train_test_split(X, y, random_state = 47, test_size = 0.33)
Import Random Forest model from sklearn and build random forest model.
from sklearn.ensemble import RandomForestClassifier
clf = RandomForestClassifier(n_jobs=2, random_state=0)
Fit the training data set of dependent and independent values
Predict the output as per trained model
preds = clf.predict(X_test)
Check the Accuracy of the Model (More the value close to 100% better the model)
We hope you understand random forest tutorial for beginners.Get success in your career as a Data Scientist by being a part of the Prwatech, India’s leading Data Science training institute in Bangalore.