what happens when Hadoop spawned 50 tasks for a job and one of the task failed?
- 1 Answers
- 796 Views
- I also Faced
- E-Mail Answers
Answer / Anesh Kumar
When a task fails, Hadoop reschedules it to run again on a different node. The specific behavior depends on the MapReduce job's configuration. For example, if a map task fails, the entire split is re-attempted, and for a reduce task, only the failed portion of the data is re-attempted.
| Is This Answer Correct ? | 0 Yes | 0 No |
Describe what happens to a mapreduce job from submission to output?
Explain slot in Hadoop Map-Reduce v1?
Explain the difference between a MapReduce InputSplit and HDFS block?
What happens when a DataNode fails during the write process?
What is a distributed cache in mapreduce framework?
Is it legal to set the number of reducer task to zero? Where the output will be stored in this case?
What is the InputSplit in map reduce ?
what is the Hadoop MapReduce APIs contract for a key and value class?
Where the mapper's intermediate data will be stored?
What is LazyOutputFormat in MapReduce?
What is OutputCommitter?
List the network requirements for using Hadoop ?
-
Apache Hadoop (394) - MapReduce (354)
- Apache Hive (345)
- Apache Pig (225)
- Apache Spark (991)
- Apache HBase (164)
- Apache Flume (95)
- Apache Impala (72)
- Apache Cassandra (392)
- Apache Mahout (35)
- Apache Sqoop (82)
- Apache ZooKeeper (65)
- Apache Ambari (93)
- Apache HCatalog (34)
- Apache HDFS Hadoop Distributed File System (214)
- Apache Kafka (189)
- Apache Avro (26)
- Apache Presto (15)
- Apache Tajo (26)
- Hadoop General (407)
