How is transformation on rdd different from action?
Answer / Mahendra Singh Kotwal
A transformation on an RDD in Apache Spark creates a new logical plan without executing the operations immediately. It returns a new RDD with the transformed data and does not trigger any physical data processing until an action is called. Examples of transformations include map(), filter(), join(). An action, on the other hand, triggers the execution of the entire logical plan and generates a physical result such as collect(), count(), saveAsTextFile(). Transformations allow users to chain multiple operations together without executing them immediately, while actions force the computation to be executed.
| Is This Answer Correct ? | 0 Yes | 0 No |
Name commonly-used Spark Ecosystems
Is the following approach correct? Is the sqrt Of Sum Of Sq a valid reducer?
What is the use of spark in big data?
What is apache spark architecture?
What is pagerank in graphx?
How to start and stop spark in interactive shell?
How do you stop a spark?
What is difference between scala and spark?
How will you connect Apache Spark with Apache Mesos?
Who invented the first spark plug?
What makes Apache Spark good at low-latency workloads like graph processing and machine learning?
Is there an api for implementing graphs in spark?
Apache Hadoop (394)
MapReduce (354)
Apache Hive (345)
Apache Pig (225)
Apache Spark (991)
Apache HBase (164)
Apache Flume (95)
Apache Impala (72)
Apache Cassandra (392)
Apache Mahout (35)
Apache Sqoop (82)
Apache ZooKeeper (65)
Apache Ambari (93)
Apache HCatalog (34)
Apache HDFS Hadoop Distributed File System (214)
Apache Kafka (189)
Apache Avro (26)
Apache Presto (15)
Apache Tajo (26)
Hadoop General (407)