What combiners are and when you should use a combiner in a mapreduce job?



What combiners are and when you should use a combiner in a mapreduce job?..

Answer / Akhilesh Kumar Kushwaha

Combiners are a feature of the MapReduce programming model that allows intermediate results from map tasks to be partially reduced before they are written to disk. This can help reduce the amount of data that needs to be shuffled between the map and reduce phases, thereby improving the overall performance of the job. Combiners should be used when the reduce function is commutative and associative, meaning that the order in which map output pairs are processed does not affect the final result and the operation can be performed in multiple steps without changing the outcome. For example, if you have a MapReduce job to find the sum of values for each key, using a combiner would help reduce the number of intermediate calculations before the actual reduction.

Is This Answer Correct ?    0 Yes 0 No

Post New Answer

More MapReduce Interview Questions

What is Hadoop Map Reduce ?

1 Answers  


What is the function of mapreduce partitioner?

1 Answers  


How to write MapReduce Programs?

1 Answers  


mapper or reducer?

1 Answers  


What is shuffling in mapreduce?

1 Answers  


What is difference between a MapReduce InputSplit and HDFS block

1 Answers  


Where sorting is done in Hadoop MapReduce Job?

1 Answers  


What are the primary phases of a Reducer?

1 Answers  


Is it necessary to write a mapreduce job in java?

1 Answers  


Define MapReduce?

1 Answers  


What is a "map" in Hadoop?

1 Answers  


What does conf.setmapper class do?

1 Answers  


Categories