Explain transformation in rdd. How is lazy evaluation helpful in reducing the complexity of the system?
Answer Posted / Anshul Tripathi
"Transformation in RDD (Resilient Distributed Dataset) refers to operations applied on an existing RDD to produce a new RDD. Examples include map(), filter(), and reduce(). Lazy Evaluation is crucial for reducing complexity as it allows multiple transformations to be chained together without immediate execution, only triggering the actual computation when an action is called. This delay in evaluation enables efficient memory management and parallel processing.n
| Is This Answer Correct ? | 0 Yes | 0 No |
Post New Answer View All Answers