Map reduce jobs take too long. What can be done to improve the performance of the cluster?
- 1 Answers
- 799 Views
- I also Faced
- E-Mail Answers
Answer / Santosh Kumar Rena
To improve MapReduce performance, you can consider reducing the number of intermediary results, increasing the number of mappers and reducers, optimizing data formats, or using a faster distributed computing system like Apache Spark.
| Is This Answer Correct ? | 0 Yes | 0 No |
What is a mapreduce algorithm?
MapReduce Types and Formats and Setting up a Hadoop Cluster?
Why Mapper runs in heavy weight process and not in a thread in MapReduce?
How to submit extra files(jars, static files) for MapReduce job during runtime?
What is the difference between Hadoop and RDBMS?
What is Output Format in MapReduce?
What do you understand by compute and storage nodes?
Define Writable data types in Hadoop MapReduce?
How many InputSplits is made by a Hadoop Framework?
When is it not recommended to use MapReduce paradigm for large
How to configure the number of the Combiner in MapReduce?
how can you debug Hadoop code?
-
Apache Hadoop (394) - MapReduce (354)
- Apache Hive (345)
- Apache Pig (225)
- Apache Spark (991)
- Apache HBase (164)
- Apache Flume (95)
- Apache Impala (72)
- Apache Cassandra (392)
- Apache Mahout (35)
- Apache Sqoop (82)
- Apache ZooKeeper (65)
- Apache Ambari (93)
- Apache HCatalog (34)
- Apache HDFS Hadoop Distributed File System (214)
- Apache Kafka (189)
- Apache Avro (26)
- Apache Presto (15)
- Apache Tajo (26)
- Hadoop General (407)
