Is pyspark dataframe immutable?
Answer / Amit Prasad Singh
PySpark DataFrame is not strictly immutable. Although you cannot modify the data in a DataFrame directly, you can create new DataFrames from existing ones by applying transformations like map(), filter(), etc., which return new DataFrames with modified data.
| Is This Answer Correct ? | 0 Yes | 0 No |
Why is pyspark used?
Can I use pandas in pyspark?
How is AI executed in Spark?
Does pyspark require spark?
What is the hugeness of Sliding Window task?
What are the different dimensions of constancy in Apache Spark?
Is pyspark slower than scala?
What are activities and changes?
How would you determine the quantity of parcels while making a RDD? What are the capacities?
What is map in pyspark?
What are communicated and Accumilators?
What is ancestry in Spark? How adaptation to internal failure is accomplished in Spark utilizing Lineage Graph?