Hadoop HBase Serialization and DeSerialization Tutorial

  Hadoop HBase Serialization and DeSerialization Tutorial, are you looking for the information of Serialization and DeSerialization in hadoop? Or the one who is casually glancing for the best platform which is providing bucketing in hive with examples for beginners? Then you’ve landed on the Right Platform which is packed with tons of Tutorials of bucketing in Hadoop hive. Follow the below mentioned Bucketing in Hive tutorial for Beginners which were originally designed by the world-class Trainers of Hadoop Training institute Professionals.   If you are the one who is a hunger to become the certified Pro Hadoop Developer? Or the one who is looking for the best Hadoop Training institute in Bangalore  which offering advanced tutorials and Hadoop certification course to all the tech enthusiasts who are eager to learn the technology from starting Level to Advanced Level.  

HBase Configuration Serialization

 

Add these libraries to your java project build path.

  avro-1.8.1.jar avro-tools-1.8.1.jar log4j-api-2.0-beta9.jar log4j-core-2.0-beta9.jar  

Step 1 - Change the directory to /home/cloudera/Desktop/Avro

  $ cd /home/cloudera/Desktop/Avro  

Step 2 - Make a new directory schema in /home/cloudera/Desktop/Avro

  $ mkdir /home/hduser/Desktop/AVRO/schema  

Step 3 - Change the directory to /home/cloudera/Desktop/Avro/Schema

  $ cd /home/cloudera/Desktop/Avro/Schema  

Step 4 - Create a new avro schema Prwatech.avsc in /home/cloudera/Desktop/Avro/schema. It creates a new Prwatech.avsc file if it doesn't exists and opens for editing.

  $ gedit Prwatech.avsc      

Step 5 - Add these following lines to Prwatech.avsc  file. Save and close it.

  >> Open eclipse and write following program: package com.test.avro; import java.io.File; import java.io.IOException; import org.apache.avro.Schema; import org.apache.avro.file.DataFileWriter; import org.apache.avro.generic.GenericData; import org.apache.avro.generic.GenericDatumWriter; import org.apache.avro.generic.GenericRecord; import org.apache.avro.io.DatumWriter;   public class SerializeNew { public static void main(String args[]) throws IOException { // Instantiating the Schema.Parser class. Schema schema = new Schema.Parser().parse(new File( "/home/cloudera/Desktop/Avro/Schema/Prwatech.avsc")); // Instantiating the GenericRecord class. GenericRecord e1 = new GenericData.Record(schema); // Insert data according to schema e1.put("name", "Ramman"); e1.put("id", 001); e1.put("course", "Hadoop"); e1.put("DOQ", "Feb"); e1.put("location", "Bangalore"); GenericRecord e2 = new GenericData.Record(schema); e2.put("name", "Akash"); e2.put("id", 002); e2.put("course", "Python"); e2.put("DOQ", "March"); e2.put("location", "Pune"); DatumWriter<GenericRecord> datumWriter = new GenericDatumWriter<GenericRecord>( schema); DataFileWriter<GenericRecord> dataFileWriter = new DataFileWriter<GenericRecord>( datumWriter); dataFileWriter.create(schema, new File( "/home/cloudera/Desktop/Avro/data.txt")); dataFileWriter.append(e1); dataFileWriter.append(e2); dataFileWriter.close(); System.out.println("data successfully serialized"); } }

Now compile the program

     

Output will be

   

HBase Configuration DeSerialization

 

Input Data will be

   

Run following command in eclipse within same package (but create different class)

  package com.test.avro; import java.io.File; import org.apache.avro.Schema; import org.apache.avro.file.DataFileReader; import org.apache.avro.generic.GenericDatumReader; import org.apache.avro.generic.GenericRecord; import org.apache.avro.io.DatumReader; public class DeserializeNew { public static void main(String args[]) throws Exception { // Instantiating the Schema.Parser class. Schema schema = new Schema.Parser().parse(new File( /home/cloudera/Desktop/Avro/Schema/Prwatech.avsc")); DatumReader<GenericRecord> datumReader = new GenericDatumReader<GenericRecord>(schema); DataFileReader<GenericRecord> dataFileReader = new DataFileReader<GenericRecord>( new File("/home/cloudera/Desktop/Avro/data.txt"),datumReader); GenericRecord emp = null; while (dataFileReader.hasNext()) { emp = dataFileReader.next(emp); System.out.println(emp); } System.out.println("data deserialized"); } }  

After DeSerialization the output will be

        Get success in your career as a Hadoop developer by being a part of the Prwatech, India's leading Hadoop training institute in Bangalore.