how can you identify whether a given operation is transformation or action?
Answer / Janak Kumar
Transformations are operations in Apache Spark that create a new Dataset, DataFrame, or RDD from an existing one but do not execute the actions immediately. They return new logical plans and do not trigger any physical data processing. Examples of transformations include map(), filter(), join(). Actions, on the other hand, trigger the execution of the entire logical plan and generate a physical result such as collect(), count(), saveAsTextFile(). The difference is that transformations do not cause any actual data to be processed or materialized until an action is called.
| Is This Answer Correct ? | 0 Yes | 0 No |
What is PageRank in Spark?
What is a worker node in Apache Spark?
Explain accumulators in apache spark.
How does executor work in spark?
Do I need to know hadoop to learn spark?
Explain about trformations and actions in the context of rdds?
What are the limitations of Apache Spark?
What does a Spark Engine do?
Define Partitions?
When should you use spark cache?
How do sparks work?
What is meant by in-memory processing in Spark?
Apache Hadoop (394)
MapReduce (354)
Apache Hive (345)
Apache Pig (225)
Apache Spark (991)
Apache HBase (164)
Apache Flume (95)
Apache Impala (72)
Apache Cassandra (392)
Apache Mahout (35)
Apache Sqoop (82)
Apache ZooKeeper (65)
Apache Ambari (93)
Apache HCatalog (34)
Apache HDFS Hadoop Distributed File System (214)
Apache Kafka (189)
Apache Avro (26)
Apache Presto (15)
Apache Tajo (26)
Hadoop General (407)