What are accumulators in Apache Spark?



What are accumulators in Apache Spark?..

Answer / Vivek Kumar Mishra

Accumulators in Apache Spark are variables that can be updated by tasks running on executors during the execution of an action. They provide a way to aggregate results across multiple tasks without the need for shuffling data. Accumulators can be used for various purposes, such as tracking the number of records processed or maintaining a moving average. Users can define their own accumulator classes using Scala or Java.

Is This Answer Correct ?    0 Yes 0 No

Post New Answer

More Apache Spark Interview Questions

What are the ways to create RDDs in Apache Spark? Explain.

1 Answers  


What is tungsten in spark?

1 Answers  


What is apache spark written in?

1 Answers  


What operations does rdd support?

1 Answers  


How many ways we can create rdd?

1 Answers  


How do I use spark with big data?

1 Answers  


What happens to rdd when one of the nodes on which it is distributed goes down?

1 Answers  


What is Apache Spark Streaming?

1 Answers  


How can we create RDD in Apache Spark?

1 Answers  


What is Apache Spark Machine learning library?

1 Answers  


Which is better hadoop or spark?

1 Answers  


Is there a module to implement sql in spark? How does it work?

1 Answers  


Categories