Answer Posted / Bhasker Sah

Hadoop and Spark are both big data processing frameworks, but they have distinct differences. Hadoop MapReduce is a batch-oriented, distributed processing system that breaks down large datasets into smaller chunks (maps), processes them independently (reduces), and combines the results. Spark, on the other hand, offers faster performance for iterative and interactive data processing through in-memory caching and lazy evaluation of operations. Spark also supports streaming, machine learning, SQL queries, and graph processing, while Hadoop's focus is primarily on batch processing.

List the advantage of Parquet file in Apache Spark?

474

Explain how RDDs work with Scala in Spark

355

What is the latest version of spark?

288

What is meant by Transformation? Give some examples.

328