Accumulators in Apache Spark are variables that can be updated by tasks run

What are accumulators in Apache Spark?

Question Posted / Vivek Kumar Mishra

1 Answers
334 Views
I also Faced
E-Mail Answers

Answer Posted / Vivek Kumar Mishra

Accumulators in Apache Spark are variables that can be updated by tasks running on executors during the execution of an action. They provide a way to aggregate results across multiple tasks without the need for shuffling data. Accumulators can be used for various purposes, such as tracking the number of records processed or maintaining a moving average. Users can define their own accumulator classes using Scala or Java.

Is This Answer Correct ?

0 Yes

0 No

Post New Answer View All Answers

Please Help Members By Posting Answers For Below Questions

List the advantage of Parquet file in Apache Spark?

474

What is meant by Transformation? Give some examples.

328

What is the latest version of spark?

288

Explain how RDDs work with Scala in Spark

355