Explain transformation and action in RDD in Apache Spark?
Answer / Pratibha Gangwar
In Apache Spark, transformations are operations that create a new RDD from an existing one without executing the computation immediately. Examples of transformations include map(), filter(), reduce(), join(), groupByKey(), and sortBy(). Actions, on the other hand, trigger the execution of previously defined transformations and produce a result in the driver program. Examples of actions are count(), collect(), saveAsTextFile(), and foreach(). Transformations in Spark are lazy evaluations, while actions are eager evaluations.
| Is This Answer Correct ? | 0 Yes | 0 No |
Define Partition and Partitioner in Apache Spark?
What operations does the "RDD" support?
What languages support spark?
Explain the default level of parallelism in Apache Spark
Explain the operations of Apache Spark RDD?
What is graphx spark?
Explain the run-time architecture of Spark?
What does a Spark Engine do?
Explain SparkContext in Apache Spark?
Can you explain spark mllib?
What is executor memory and driver memory in spark?
Why does the picture of Spark come into existence?
Apache Hadoop (394)
MapReduce (354)
Apache Hive (345)
Apache Pig (225)
Apache Spark (991)
Apache HBase (164)
Apache Flume (95)
Apache Impala (72)
Apache Cassandra (392)
Apache Mahout (35)
Apache Sqoop (82)
Apache ZooKeeper (65)
Apache Ambari (93)
Apache HCatalog (34)
Apache HDFS Hadoop Distributed File System (214)
Apache Kafka (189)
Apache Avro (26)
Apache Presto (15)
Apache Tajo (26)
Hadoop General (407)