What are the various levels of persistence in Apache Spark?
Answer Posted / Kailash Chandra Singh
Apache Spark provides three levels of RDD persistence: (1) StorageLevel.MEMORY_ONLY, which stores data only in memory and does not write to disk unless explicitly asked to do so. (2) StorageLevel.MEMORY_AND_DISK_SER, which stores data in memory as well as on disk using serialized format. (3) StorageLevel.MEMORY_ONLY_2, which is similar to MEMORY_AND_DISK_SER but uses a more efficient version of serialization.
| Is This Answer Correct ? | 0 Yes | 0 No |
Post New Answer View All Answers