Coalesce operation in Apache Spark is used to reduce the number of partitio

What is difference between coalesce and repartition?

Question Posted / Amit Kumar Singh

1 Answers
385 Views
I also Faced
E-Mail Answers

Answer Posted / Amit Kumar Singh

Coalesce operation in Apache Spark is used to reduce the number of partitions for a DataFrame or RDD, while maintaining their existing order. It combines the contiguous partitions. On the other hand, repartition operation is used to change the total number of partitions for a DataFrame or RDD, which might cause the shuffle of data, and can affect the performance due to increased network traffic.

Is This Answer Correct ?

0 Yes

0 No

Post New Answer View All Answers

Please Help Members By Posting Answers For Below Questions

What is meant by Transformation? Give some examples.

328

List the advantage of Parquet file in Apache Spark?

474

Explain how RDDs work with Scala in Spark

355

What is the latest version of spark?

288