Big Data Interview Questions, Answers for Freshers and Experienced asked in various Company Job Interviews

Big Data Interview Questions

Questions Answers Views Company eMail

By Default, how many partitions are created in RDD in Apache Spark?

300

What are broadcast variables in Apache Spark? Why do we need them?

310

Is it necessary to start Hadoop to run any Apache Spark Application ?

277

What is write ahead log(journaling)?

310

Does Apache Spark provide checkpoints?

284

What is Apache Spark Machine learning library?

314

What is the use of map transformation?

312

Explain the run-time architecture of Spark?

296

List the advantage of Parquet files?

301

Name the Spark Library which allows reliable file sharing at memory speed across different cluster frameworks.

308

Please provide an explanation on DStream in Spark.

282

List the languages supported by Apache Spark?

311

Explain the Parquet File format in Apache Spark. When is it the best to choose this?

361

Explain lineage graph

320

Is the following approach correct? Is the sqrt Of Sum Of Sq a valid reducer?

451

Un-Answered Questions { Big Data }

What is Flume?

112

Why is HDFS only suitable for large data sets and not the correct tool to use for many small files?

Explain Spark join() operation?

286

What language is apache spark?

288

How does master slave architecture in the hadoop?

815

What is the difference between dataset and dataframe in spark?

364

Explain the maximum size of a message that can be received by the Kafka?

718

When to use coalesce and repartition in spark?

319

While starting hadoop services, datanode service is not running?

439

Explain the Reducer's reduce phase?

1052

What are barriers?

Hive new version supported Hadoop Versions ?

604

How to create an rdd?

300

Explain the usage of Context Object?

476

Name some companies that are already using Spark Streaming?

268

For More Un-Answered { Big Data } Questions Click Here