Answer / Ashish Kumar Jaiswal

An RDD (Resilient Distributed Dataset) is a fundamental data structure in Apache Spark, designed to be highly resilient and fault-tolerant. RDDs are distributed collections of objects that can be processed in parallel across multiple nodes in a cluster. They consist of a logical dataset divided into partitions, each partition being stored on one worker node in the cluster. RDDs can be created from Hadoop Distributed File System (HDFS), local file system, or even by transforming other RDDs. Operations on RDDs are lazily evaluated and transformed into a series of tasks that are executed in parallel.

What are the major features/characteristics of rdd (resilient distributed datasets)?

1 Answers  

---

Describe Partition and Partitioner in Apache Spark?

1 Answers  

---

Define the level of parallelism and its need in spark streaming?

1 Answers  

---

Is apache spark an etl tool?

1 Answers  

---

What do you understand by Lazy Evaluation?

1 Answers  

---

Is java required for spark?

1 Answers  

---

Can You Use Apache Spark To Analyze and Access Data Stored In Cassandra Databases?

1 Answers  

---

What is a spark shuffle?

1 Answers  

---

Define sparksession in apache spark? Why is it needed?

1 Answers  

---

Why does spark skip stages?

1 Answers  

---

Explain Spark Core?

1 Answers  

---

What is paired rdd in spark?

1 Answers  

---