Answer / Padmabahadur Yadav

The following are the explanations of various transformations on Apache Spark's RDD:

1. distinct(): It is used to remove duplicate elements from an RDD. The resulting RDD will contain only unique elements.
2. union(): It combines all the given RDDs into a single RDD containing all elements from each input RDD. The order of elements in the output RDD may not be the same as any of the input RDDs.
3. intersection(): It returns an RDD that contains only the common elements present in both the given RDDs. If there are no common elements, it will return an empty RDD.
4. subtract(): It returns a RDD containing all elements from the first RDD that do not exist in the second RDD.

In how many ways RDDs can be created? Explain.

1 Answers  

---

What are the roles of the file system in any framework?

1 Answers  

---

Explain the use of File system API in Apache Spark

1 Answers  

---

What is the biggest shortcoming of Spark?

1 Answers  

---

What is sparksession and sparkcontext?

1 Answers  

---

Explain different transformation on DStream?

1 Answers  

---

Is there any benefit of learning MapReduce, then?

1 Answers  

---

Explain Accumulator in Spark?

1 Answers  

---

What are Actions?

1 Answers  

---

What is external shuffle service in spark?

1 Answers  

---

Explain the difference between Spark SQL and Hive.

1 Answers  

---

Explain sum(), max(), min() operation in Apache Spark?

1 Answers  

---