Interested to Buy Any Domain ? << Click Here >> for more details...
Explain the various Transformation on Apache Spark RDD like distinct(), union(), intersection(), and subtract()?
- 1 Answers
- 315 Views
- I also Faced
- E-Mail Answers
Answer Posted / Padmabahadur Yadav
The following are the explanations of various transformations on Apache Spark's RDD:
1. distinct(): It is used to remove duplicate elements from an RDD. The resulting RDD will contain only unique elements.
2. union(): It combines all the given RDDs into a single RDD containing all elements from each input RDD. The order of elements in the output RDD may not be the same as any of the input RDDs.
3. intersection(): It returns an RDD that contains only the common elements present in both the given RDDs. If there are no common elements, it will return an empty RDD.
4. subtract(): It returns a RDD containing all elements from the first RDD that do not exist in the second RDD.
| Is This Answer Correct ? | 0 Yes | 0 No |
Post New Answer View All Answers
