This topic contains 0 replies, has 1 voice, and was last updated by  hyndavi 2 years, 8 months ago.

Viewing 1 post (of 1 total)
  • Author
    Posts
  • #1992

    hyndavi
    Participant

    Sorting saves time for the reducer, helping it easily distinguish when a new reduce task should start. It simply starts a new reduce task, when the next key in the sorted input data is different than the previous, to put it simply.

    Partitioning, that you mentioned in one of the answers, is a different process. It determines in which reducer a (key, value) pair, output of the map phase, will be sent.
    reducer is different than a reduce task. A reducer can run multiple reduce tasks. Note also that shuffling and sorting are performed locally, by each reducer, for its own input data, whereas partioning is not local.

Viewing 1 post (of 1 total)

The forum ‘BIG DATA & HADOOP INTERNSHIP BATCH – 2015’ is closed to new topics and replies.