Whether the output of mapper or output of partitioner written on local disk?
Answer / Akash Babu
No, the output of both Mapper and Partitioner are not written to local disk. They are only stored in memory until they are shuffled and sorted by Hadoop.
| Is This Answer Correct ? | 0 Yes | 0 No |
How to submit extra files(jars, static files) for Hadoop MapReduce job during runtime?
what daemons run on a master node and slave nodes?
Explain JobConf in MapReduce.
For a Hadoop job, how will you write a custom partitioner?
What is a scarce system resource?
Can you tell us how many daemon processes run on a hadoop system?
How to change the name of the output file from part-r-00000 in Hadoop MapReduce?
What is shuffling and sorting in Hadoop MapReduce?
What is the InputSplit in map reduce ?
What combiners are and when you should use a combiner in a mapreduce job?
Explain about the partitioning, shuffle and sort phase
What is the difference between HDFS block and input split?
Apache Hadoop (394)
MapReduce (354)
Apache Hive (345)
Apache Pig (225)
Apache Spark (991)
Apache HBase (164)
Apache Flume (95)
Apache Impala (72)
Apache Cassandra (392)
Apache Mahout (35)
Apache Sqoop (82)
Apache ZooKeeper (65)
Apache Ambari (93)
Apache HCatalog (34)
Apache HDFS Hadoop Distributed File System (214)
Apache Kafka (189)
Apache Avro (26)
Apache Presto (15)
Apache Tajo (26)
Hadoop General (407)