What are communicated and Accumilators?
Answer / Mahesh Kumar Kureel
Communication is a method for sharing data between different tasks in Spark, while Accumulators allow users to modify a variable during task execution that can be accessed after all tasks have completed. They are useful for maintaining running totals or custom metrics.
| Is This Answer Correct ? | 0 Yes | 0 No |
What is a pyspark dataframe?
How is AI executed in Spark?
How is Streaming executed in Spark? Clarify with precedents.
What is pyspark in python?
Is pyspark dataframe immutable?
What is parallelize in pyspark?
What are communicated and Accumilators?
What is the difference between pyspark and spark?
Notice a few Transformations and Actions?
Can I use pandas in pyspark?
Explain about the parts of Spark Architecture?
Explain the key highlights of Apache Spark?