Categorical Data Encoding

  • date 29th January, 2020 |
  • by Prwatech |


Approaches for Categorical Data Encoding



Categorical Data Encoding, Are you the one who is looking forward to knowing types of categorical data encoding in machine learning? Or the one who is looking forward to know Categorical Data Encoding concepts in Machine Learning or Are you dreaming to become to certified Pro Machine Learning Engineer or Data Scientist, then stop just dreaming, get your Data Science certification course from India’s Leading Data Science training institute.


Many Machine Learning algorithms need to covert categorical data into numerical data as they cannot handle categorical variables. Also, the performance of algorithms will vary based on how the categorical variables are encoded. In this blog, we will learn types of categorical data encoding and how to convert categorical data to numerical data with detail information. Do you want to know categorical data encoding in machine learning, So follow the below mentioned Python categorical data encoding guide from Prwatech and take advanced Data Science training like a pro from today itself under 10+ Years of hands-on experienced Professionals.


Advantages of Data Encoding


In practical datasets there is variety of categorical variables. These variables represent different characteristics which are generally stored in text values. For example: In some cases the gender category like Male, Female, weather can have categories like ‘sunny’, ‘rainy’ or ‘cold’, size having categories like ‘Small’, ‘Medium’, ‘Large’. We have to utilize this kind of data for analysis. Many machine learning algorithms can process these categorical values without further manipulation or encoding, but there are many algorithms too that do not support these formats. So in those cases it is mandatory that, the data set should be manipulated to get these text attributes into numerical values for further processing.


Types of Categorical Data Encoding


There cannot be a single answer about how to approach this problem. Different approaches come with different potential impact on the result of the analysis. So here an overview is given for data encoding approaches used mostly for categorical data.


Label Encoding in Machine Learning


It is one of the popular techniques used to encode categorical data. It is nothing but converting each text value in a column to a number. Label encoding means to convert the labels into some machine readable values format. Example, if the column named ‘Intensity’ contains categorical values like LOW, MEDIUM, HIGH. Then with label encoding, a unique number is assigned to each one alphabetically as.



LOW =1



From here we come to know the weight age of particular category.


How to convert Categorical Data to Numerical Data on Label Encoding?


Let’s see example on Label Encoding:


age Gender BMI Diabetes region
19 female 27.9 yes southwest
18 male 33.77 no southeast
28 male 33 no southeast
33 male 22.705 yes northwest
32 male 28.88 no northwest
31 female 25.74 no southeast
46 female 33.44 yes southeast
37 female 27.74 no northwest
37 male 29.83 no northeast
60 female 25.84 no northwest


Let’s go step by step:


First we have to check the columns , which contain dtype as category. For that:


df=pd.read_csv (“Your File Path”)





Categorical Data Encoding - Label encoding in Machine Learning


Then check the data types of columns in df






Categorical Data Encoding - Label encoding in Machine Learning


It shows that although columns ‘Gender’, ’Diabetes’ and ‘region’ are of categorical type, their data type is ‘object’. Let’s test on field ‘Gender’. We will convert its type to category.







Categorical Data Encoding - Label encoding in Machine Learning


Now we can apply codes on column named ‘Gender’ to convert its text values into numerical values.





Categorical Data Encoding - Label encoding in Machine Learning


As we can see in result the column has been converted in to 0 and 1 (female – 0, male – 1). In this manner we can apply the to all columns.


In above case the columns were limited and we could count the categories in each column easily. But the solution gets critical if number of columns and categories get increased. So in that case scikit-learn’s Label Encoder comes in picture.


For this, we have to import LabelEncoder from sklearn.preprocessing


Categorical Data Encoding - Label encoding in Machine Learning


And now we can select and encode the expected columns as follows:


Categorical Data Encoding - Label encoding in Machine Learning


Here we get all selected columns in the form of numerical values.


But in case of Label encoding there is a problem of misinterpretation of numerical values while analysis and processing. Example, here region category is presents, in that different regions are assigned with different numeric values. In further processing the more weight age can be given to category ‘southwest’ as it has value 4. This unwanted weight interpretation can miss guide the machine learning algorithm.


One Hot Encoding in Machine Learning:


One hot encoding means a strategy to encode each category value into a new column and allocate a 1 or 0 (True/False) value to the column. Unlike Label Encoding it will not weight values improperly. Let’s see above example with one hot encoder. For that we have to import Label Encoder as shown in above example.  Then we will apply function get_dummies as follows:





Result will be dummied columns with categories in those, for selected columns:


Categorical Data Encoding - One hot encoding in Machine Learning


Although one-hot encoding solves the problem of unequal weights given to categories, it is not very useful when there are too many categories featuring a column, since that will result in creation of new columns in table leading to increase in total dataset.


Binary Encoding in Machine Learning


In this technique, first the categories are encoded in integers, and then those integers are converted into binary code, then the digits from that binary string are split into separated columns. In comparison with one hot encoder this techniques encodes data with lower dimensionality.  We can use binary encoder by just installing category_encoders as follows:


pip install category_encoders

import category_encoders as ce


Now we can apply binary encoder as follows:



binencode=ce.BinaryEncoder(cols=[‘Gender’, ‘Dibetes’,‘region’])

df_binary =binencode.fit_transform(dfbin)





Categorical Data Encoding - Binary Encoding in Machine Learning



We hope you understand Categorical Data Encoding in Machine Learning concepts and types of categorical data encoding, how to convert categorical data to numerical data. Get success in your career as a Data Scientist by being a part of the Prwatech, India’s leading Data Science training institute in Bangalore.






Quick Support

image image