What is coalesce in spark sql?
Answer / Ved Prakash Tiwari
Coalesce in Spark SQL is a command used to decrease the number of partitions in a DataFrame or Dataset. It is often used after an operation that creates too many partitions for efficiency reasons, and then you want to reduce the number of partitions.
| Is This Answer Correct ? | 0 Yes | 0 No |
What is spark in big data?
What are the languages supported by apache spark?
Can you explain spark rdd?
What is a pipelinedrdd?
Is spark sql a database?
What is the biggest shortcoming of Spark?
What is an "RDD Lineage"?
What is a reliable and unreliable receiver in Spark?
What are the main components of spark?’
What is Spark DataFrames?
Define the run-time architecture of Spark?
What does it mean by Columnar Storage Format?
Apache Hadoop (394)
MapReduce (354)
Apache Hive (345)
Apache Pig (225)
Apache Spark (991)
Apache HBase (164)
Apache Flume (95)
Apache Impala (72)
Apache Cassandra (392)
Apache Mahout (35)
Apache Sqoop (82)
Apache ZooKeeper (65)
Apache Ambari (93)
Apache HCatalog (34)
Apache HDFS Hadoop Distributed File System (214)
Apache Kafka (189)
Apache Avro (26)
Apache Presto (15)
Apache Tajo (26)
Hadoop General (407)