Interested to Buy Any Domain ? << Click Here >> for more details...
Explain transformation in rdd. How is lazy evaluation helpful in reducing the complexity of the system?
- 1 Answers
- 360 Views
- I also Faced
- E-Mail Answers
Answer / Anshul Tripathi
"Transformation in RDD (Resilient Distributed Dataset) refers to operations applied on an existing RDD to produce a new RDD. Examples include map(), filter(), and reduce(). Lazy Evaluation is crucial for reducing complexity as it allows multiple transformations to be chained together without immediate execution, only triggering the actual computation when an action is called. This delay in evaluation enables efficient memory management and parallel processing.n
| Is This Answer Correct ? | 0 Yes | 0 No |
Which one is better hadoop or spark?
Is spark better than hadoop?
How do I start a spark server?
What is full form of rdd?
By Default, how many partitions are created in RDD in Apache Spark?
What is pyarrow?
Explain the repartition() operation in Spark?
Explain the action count() in Spark RDD?
Can you explain spark rdd?
Does spark store data?
What is Spark Driver?
What happens when you submit spark job?
-
Apache Hadoop (394) - MapReduce (354)
- Apache Hive (345)
- Apache Pig (225)
- Apache Spark (991)
- Apache HBase (164)
- Apache Flume (95)
- Apache Impala (72)
- Apache Cassandra (392)
- Apache Mahout (35)
- Apache Sqoop (82)
- Apache ZooKeeper (65)
- Apache Ambari (93)
- Apache HCatalog (34)
- Apache HDFS Hadoop Distributed File System (214)
- Apache Kafka (189)
- Apache Avro (26)
- Apache Presto (15)
- Apache Tajo (26)
- Hadoop General (407)
