Interested to Buy Any Domain ? << Click Here >> for more details...
Explain transformation in rdd. How is lazy evaluation helpful in reducing the complexity of the system?
- 1 Answers
- 362 Views
- I also Faced
- E-Mail Answers
Answer / Anshul Tripathi
"Transformation in RDD (Resilient Distributed Dataset) refers to operations applied on an existing RDD to produce a new RDD. Examples include map(), filter(), and reduce(). Lazy Evaluation is crucial for reducing complexity as it allows multiple transformations to be chained together without immediate execution, only triggering the actual computation when an action is called. This delay in evaluation enables efficient memory management and parallel processing.n
| Is This Answer Correct ? | 0 Yes | 0 No |
How can you trigger automatic clean-ups in Spark to handle accumulated metadata?
What file systems Spark support?
What is coalesce in spark?
What happens when you submit spark job?
Explain Spark map() transformation?
What according to you is a common mistake apache spark developers make when using spark ?
How do I optimize my spark code?
Explain about the different types of transformations on DStreams?
What is apache spark and what is it used for?
What is meant by rdd in spark?
Why lazy evaluation is good in spark?
What are the common mistakes developers make when running Spark applications?
-
Apache Hadoop (394) - MapReduce (354)
- Apache Hive (345)
- Apache Pig (225)
- Apache Spark (991)
- Apache HBase (164)
- Apache Flume (95)
- Apache Impala (72)
- Apache Cassandra (392)
- Apache Mahout (35)
- Apache Sqoop (82)
- Apache ZooKeeper (65)
- Apache Ambari (93)
- Apache HCatalog (34)
- Apache HDFS Hadoop Distributed File System (214)
- Apache Kafka (189)
- Apache Avro (26)
- Apache Presto (15)
- Apache Tajo (26)
- Hadoop General (407)
