Golgappa.net | Golgappa.org | BagIndia.net | BodyIndia.Com | CabIndia.net | CarsBikes.net | CarsBikes.org | CashIndia.net | ConsumerIndia.net | CookingIndia.net | DataIndia.net | DealIndia.net | EmailIndia.net | FirstTablet.com | FirstTourist.com | ForsaleIndia.net | IndiaBody.Com | IndiaCab.net | IndiaCash.net | IndiaModel.net | KidForum.net | OfficeIndia.net | PaysIndia.com | RestaurantIndia.net | RestaurantsIndia.net | SaleForum.net | SellForum.net | SoldIndia.com | StarIndia.net | TomatoCab.com | TomatoCabs.com | TownIndia.com
Interested to Buy Any Domain ? << Click Here >> for more details...

Describe Partition and Partitioner in Apache Spark?

Answer Posted / Hariom Akash Sahay

In Apache Spark, a partition refers to a logical subset of data within a Resilient Distributed Dataset (RDD). Each RDD partition is stored on one or more worker nodes. A Partitioner is responsible for determining how the data is distributed across partitions. By default, Spark uses a HashPartitioner, which evenly distributes data based on a hash function.

Is This Answer Correct ?    0 Yes 0 No



Post New Answer       View All Answers


Please Help Members By Posting Answers For Below Questions

What is the latest version of spark?

288


What is meant by Transformation? Give some examples.

328


List the advantage of Parquet file in Apache Spark?

474


Explain how RDDs work with Scala in Spark

355