Forum Replies Created

Viewing 5 posts - 1 through 5 (of 5 total)
  • Author
    Posts
  • in reply to: pig #3193
    Sanchita Sen
    Participant

    How physical translator works at the time of compilation of pig query
    After the logical plan is generated,script executation moves to the physical plan, Apache script will use to execute the pig script. During the creation of physical plan, co-group logical operator is converted into three physical operators namely : Local Rearrange, Global Rearrange and Package. Load and store functions usually get resolved in the physical plan. Physical plan is more or less similar to mapreduce join.

    in reply to: pig #3186
    Sanchita Sen
    Participant

    PiggyBank and application
    Piggy Bank is a place for Pig users to share the Java UDFs they have written for use.The function ia written as “as-is”.If anyone find bug in function,take time fix it and contribute the fix to Piggy Bank.

    in reply to: pig #3179
    Sanchita Sen
    Participant

    How to achieve performance tuning in PIG ?
    Performance tuning in PIG can be achieved in PIG with the following:
    1.We can use Optimization
    2. We can use Types. If types are not specified in the load statement, Pig assumes the type of =double= for numeric computations.
    3. Pig determine when a field is no longer needed and drop the field from the row.
    4.It is fruitful to use filters to reduce the amount of data through pipeline
    5.It is better to reduce the operator pipelinbe

    in reply to: MapReduce #3158
    Sanchita Sen
    Participant

    Limitation of MapReduce
    1. MapReduce is a disk process.
    2. It works for batch processing.
    3. It consumes time for processing the code

    in reply to: MapReduce #3140
    Sanchita Sen
    Participant

    Difference between Old API and New API
    Old API New API
    1.JobConf(used by mapper class,reducer class, 1.JobClass(used for configuration by mapper,reducer)
    input file)

    2.It is present in org.apache.hadoop.mapred 2.It is present in org.apache.mapreduce

    3.Works with Tool,Toolrunner 3.Does not work with such classes
    4.Uses mapper and reducer as interface 4.Uses mapper and reducer as class

Viewing 5 posts - 1 through 5 (of 5 total)
Prwatech