This topic contains 0 replies, has 1 voice, and was last updated by  hyndavi 2 years ago.

Viewing 1 post (of 1 total)
  • Author
    Posts
  • #2016 Reply

    hyndavi
    Participant

    1.Dfs.datanode.plugins
    Comma-separated list of datanode plug-ins to be activated.
    2.Mapred.task.cache.levels
    It is used by jobtracker to create task caches for node at various levels.this makes data locality scheduling possible. If I set mapred.task.cache.levels to 0 & use default network topology then MR job will stall forever.The reason is JobInProgress::find NewMapTask always return -1.Field “nonRunningMapCache” is empty & field ” nonLocalMaps” is empty.
    3.Hadoop.tmp.dir
    Haddop.tmp.dir is used as a temporary directory for both local file system & for HDFS.We will use the directory ‘/app/hadoop/tmp/’.We need to create the directory & change the ownership.
    4.map.sort.class
    The method map.sort.class determines the sorting algorithm used for sorting keys.the default is QuickSort implemented in org.apache.hadoop.util.QuickSort.
    5.dfs.namenode.decommission.nodes.per.interval
    The no:of nodes namenode checks if decommission is complete in each dfs.namenode. decommission.interval
    6.mapreduce.jdbc.input.table.names
    Table from which to fetch data mapreduce jdbc.input.field.names columns to fetch.jdbc.input.field.orderby column by which splitting will happen across various mapper .this propertly controls the parallelizatin of fetching data from db.
    7.dfs.datanode.data.dir.permthis is used by the datanode to set the permission of its data directories.
    8.mapred.system.dir
    The directory where mapreduce store control files.
    9.mapred.jobtracker.persist.jobstatus.hours
    The no:of hours job status information is persisted in dfs the job status info will be available after it drops of memory queue b/w job tracker restarts.

Viewing 1 post (of 1 total)
Reply To: job tracker status
Your information:




cf22

Your Name (required)

Your Email (required)

Subject

Phone No

Your Message

Cart

  • No products in the cart.