What is lazy evaluation and how is it useful?
Answer / Ajay Kant Singh
"Lazy Evaluation" in Apache Spark refers to a process where the computation of an action or transformation is not performed immediately but only when the result is required. This strategy helps in improving the efficiency of the system as it reduces memory consumption and allows for better resource utilization. Lazy evaluation also enables pipeline parallelism, allowing multiple operations to be scheduled on available resources and executed concurrently.n
| Is This Answer Correct ? | 0 Yes | 0 No |
Can you define rdd lineage?
What is data ingestion pipeline?
What are the benefits of Spark lazy evaluation?
How you can use Akka with Spark?
Can you explain broadcast variables?
In how many ways can we use Spark over Hadoop?
Explain about the different types of trformations on dstreams?
What is Spark MLlib?
What are the features of apache spark?
Explain transformation in rdd. How is lazy evaluation helpful in reducing the complexity of the system?
In how many ways RDDs can be created? Explain.
Why is spark used?
Apache Hadoop (394)
MapReduce (354)
Apache Hive (345)
Apache Pig (225)
Apache Spark (991)
Apache HBase (164)
Apache Flume (95)
Apache Impala (72)
Apache Cassandra (392)
Apache Mahout (35)
Apache Sqoop (82)
Apache ZooKeeper (65)
Apache Ambari (93)
Apache HCatalog (34)
Apache HDFS Hadoop Distributed File System (214)
Apache Kafka (189)
Apache Avro (26)
Apache Presto (15)
Apache Tajo (26)
Hadoop General (407)