Forum

This topic contains 0 replies, has 1 voice, and was last updated by  hyndavi 2 years ago.

Viewing 1 post (of 1 total)
  • Author
    Posts
  • #1992 Reply

    hyndavi
    Participant

    Sorting saves time for the reducer, helping it easily distinguish when a new reduce task should start. It simply starts a new reduce task, when the next key in the sorted input data is different than the previous, to put it simply.

    Partitioning, that you mentioned in one of the answers, is a different process. It determines in which reducer a (key, value) pair, output of the map phase, will be sent.
    reducer is different than a reduce task. A reducer can run multiple reduce tasks. Note also that shuffling and sorting are performed locally, by each reducer, for its own input data, whereas partioning is not local.

Viewing 1 post (of 1 total)
Reply To: what is shuffling and unsorting?how it works in real time?
Your information:




cf22

Your Name (required)

Your Email (required)

Subject

Phone No

Your Message

Cart

  • No products in the cart.