Answer / Neeraj Gupta

{"In Apache Spark, map() applies a function to each element of an RDD or DataFrame, creating a new collection with the transformed elements. FlatMap(), on the other hand, splits each input element into zero or more output elements (similar to map()) and then concatenates them all together, creating a single collection instead of a collection per input element. This can be useful for processing streams or breaking down complex data structures."}

What is catalyst framework in spark?

1 Answers  

---

Is spark a language?

1 Answers  

---

Define Partitions?

1 Answers  

---

Explain distnct(),union(),intersection() and substract() transformation in Spark?

1 Answers  

---

What operations RDD support?

1 Answers  

---

What is the difference between DSM and RDD?

1 Answers  

---

What does map transformation do? Provide an example.

1 Answers  

---

Does spark use java?

1 Answers  

---

Explain Machine Learning library in Spark?

1 Answers  

---

Describe Accumulator in detail in Apache Spark?

1 Answers  

---

What is Apache Spark and what are the benefits of Spark over MapReduce?

1 Answers  

---

Explain various level of persistence in Apache Spark?

1 Answers  

---