Explain the Differences between Hive and Spark SQL?



Explain the Differences between Hive and Spark SQL?..

Answer / Sachin Mishra

Hive and Spark SQL are both SQL-like querying systems built on top of Apache Hadoop. However, they have several differences: 1. Data Storage: Hive stores data in HDFS, while Spark SQL can work with a variety of data sources including HDFS, Cassandra, and S3. 2. Query Execution: Hive compiles queries into MapReduce jobs, while Spark SQL uses Spark's distributed data processing engine (RDD or DataFrame). 3. Performance: Spark SQL is generally faster than Hive due to its in-memory computation and better query optimization.

Is This Answer Correct ?    0 Yes 0 No

Post New Answer

More Apache Hive Interview Questions

What is bag?

1 Answers  


Is it possible to overwrite Hadoop MapReduce configuration in Hive?

1 Answers  


What is the major difference between local and remote meta-store?

1 Answers  


How many types of Tables in Hive?

1 Answers  


How Hive organize the data?

1 Answers  


Is it possible to add 100 more nodes when we already have 100 nodes in Hive?

1 Answers  


What are the uses of explode hive?

1 Answers  


What is CTAS Table in Hive?

1 Answers  


Specify the different methods of hive?

1 Answers  


Does 'ILLUSTRATE' run MR job?

1 Answers  


Can you execute Hadoop dfs Commands from Hive CLI? How?

1 Answers  


Is it possible to change the default location of a managed table?

1 Answers  


Categories